-- Logs begin at Wed 2022-08-24 10:36:58 UTC, end at Wed 2022-08-24 11:58:22 UTC. -- Aug 24 11:22:47.911449 dv-cinder-854274-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 24 11:22:47.920032 dv-cinder-854274-2-iscsi devstack@n-api.service[106030]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 24 11:22:47.922131 dv-cinder-854274-2-iscsi devstack@n-api.service[106030]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 24 11:22:47 2022] *** Aug 24 11:22:47.922131 dv-cinder-854274-2-iscsi devstack@n-api.service[106030]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 24 11:22:47.922131 dv-cinder-854274-2-iscsi devstack@n-api.service[106030]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 24 11:22:47.922131 dv-cinder-854274-2-iscsi devstack@n-api.service[106030]: nodename: dv-cinder-854274-2-iscsi Aug 24 11:22:47.922131 dv-cinder-854274-2-iscsi devstack@n-api.service[106030]: machine: x86_64 Aug 24 11:22:47.922131 dv-cinder-854274-2-iscsi devstack@n-api.service[106030]: clock source: unix Aug 24 11:22:47.922131 dv-cinder-854274-2-iscsi devstack@n-api.service[106030]: pcre jit disabled Aug 24 11:22:47.922131 dv-cinder-854274-2-iscsi devstack@n-api.service[106030]: detected number of CPU cores: 4 Aug 24 11:22:47.922131 dv-cinder-854274-2-iscsi devstack@n-api.service[106030]: current working directory: / Aug 24 11:22:47.922131 dv-cinder-854274-2-iscsi devstack@n-api.service[106030]: detected binary path: /usr/bin/uwsgi-core Aug 24 11:22:47.922131 dv-cinder-854274-2-iscsi devstack@n-api.service[106030]: your processes number limit is 47680 Aug 24 11:22:47.922896 dv-cinder-854274-2-iscsi devstack@n-api.service[106030]: your memory page size is 4096 bytes Aug 24 11:22:47.922896 dv-cinder-854274-2-iscsi devstack@n-api.service[106030]: detected max file descriptor number: 2048 Aug 24 11:22:47.922896 dv-cinder-854274-2-iscsi devstack@n-api.service[106030]: lock engine: pthread robust mutexes Aug 24 11:22:47.922896 dv-cinder-854274-2-iscsi devstack@n-api.service[106030]: thunder lock: enabled Aug 24 11:22:47.922896 dv-cinder-854274-2-iscsi devstack@n-api.service[106030]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 24 11:22:47.922896 dv-cinder-854274-2-iscsi devstack@n-api.service[106030]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 24 11:22:47.961297 dv-cinder-854274-2-iscsi devstack@n-api.service[106030]: Python main interpreter initialized at 0x559e1bbf99c0 Aug 24 11:22:47.961297 dv-cinder-854274-2-iscsi devstack@n-api.service[106030]: python threads support enabled Aug 24 11:22:47.961297 dv-cinder-854274-2-iscsi devstack@n-api.service[106030]: your server socket listen backlog is limited to 100 connections Aug 24 11:22:47.961297 dv-cinder-854274-2-iscsi devstack@n-api.service[106030]: your mercy for graceful operations on workers is 90 seconds Aug 24 11:22:47.961640 dv-cinder-854274-2-iscsi devstack@n-api.service[106030]: mapped 403077 bytes (393 KB) for 2 cores Aug 24 11:22:47.961719 dv-cinder-854274-2-iscsi devstack@n-api.service[106030]: *** Operational MODE: preforking *** Aug 24 11:22:47.961947 dv-cinder-854274-2-iscsi devstack@n-api.service[106030]: *** uWSGI is running in multiple interpreter mode *** Aug 24 11:22:47.961947 dv-cinder-854274-2-iscsi devstack@n-api.service[106030]: spawned uWSGI master process (pid: 106030) Aug 24 11:22:47.962136 dv-cinder-854274-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 24 11:22:47.962670 dv-cinder-854274-2-iscsi devstack@n-api.service[106030]: spawned uWSGI worker 1 (pid: 106031, cores: 1) Aug 24 11:22:47.962997 dv-cinder-854274-2-iscsi devstack@n-api.service[106030]: spawned uWSGI worker 2 (pid: 106032, cores: 1) Aug 24 11:22:47.964129 dv-cinder-854274-2-iscsi devstack@n-api.service[106030]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 24 11:22:48.624530 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 11:22:48.637452 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 11:22:49.740529 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 11:22:49.740529 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: from cryptography.utils import int_from_bytes Aug 24 11:22:49.741110 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 11:22:49.741110 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: from cryptography.utils import int_from_bytes Aug 24 11:22:49.741490 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 11:22:49.741490 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: from cryptography.utils import int_from_bytes Aug 24 11:22:49.741907 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 11:22:49.741907 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: from cryptography.utils import int_from_bytes Aug 24 11:22:52.241519 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 11:22:52.242088 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 11:22:52.242265 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 11:22:52.242635 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 11:22:52.242735 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 11:22:52.242817 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 11:22:52.242896 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 11:22:52.242978 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 11:22:52.243235 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.243325 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 11:22:52.243556 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.243652 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 11:22:52.243874 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.243967 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.244190 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.244286 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.244525 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.244615 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.244863 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.244980 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.245184 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.245282 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.245498 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.245583 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.245820 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.245923 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.246072 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.246158 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.246383 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.246477 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.246691 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.246790 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854274-2-iscsi {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.247005 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.247100 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.247305 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.247396 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854274-2-iscsi {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.247610 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.247713 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.247924 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.248010 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.248224 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.248309 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.248539 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.248636 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.248859 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.248958 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.249184 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.249351 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.249502 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.249856 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.250044 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.250149 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.250304 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.250474 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.250640 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.250787 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.250954 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.251104 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.251240 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.251388 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.251544 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.251704 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.251852 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.252012 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.252170 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.252330 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.253026 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.253198 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.253364 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.253586 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854274-2-iscsi {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.253682 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.253900 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.254040 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854274-2-iscsi {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.254210 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.254357 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.254516 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.254669 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.254922 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.255070 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.255244 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.255384 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.255522 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.255681 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.255823 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.255979 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.256174 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.256299 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.256462 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.256620 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.256789 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.256952 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.257128 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.257279 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.257445 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.257597 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.257764 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.257915 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.258067 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.258234 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.258373 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.258534 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.258680 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.258838 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.258998 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.259145 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.259300 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.259465 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.259602 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.259765 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.259850 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.260070 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.260237 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.260376 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.260527 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.260664 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.260839 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.260929 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.261089 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.261259 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.261347 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.261565 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.261666 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.261831 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.261920 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.262049 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.262186 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.262477 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.262573 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.262782 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.262869 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.263086 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.263173 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.263389 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.263486 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.263690 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.263776 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.263991 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.264086 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.264292 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.264386 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.264598 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.264698 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.264924 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.265016 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.265232 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.265331 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.265549 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.265643 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.265861 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.265947 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.266180 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.266276 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.266486 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.266626 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.84 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.266809 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.266921 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.84 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.267167 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.267261 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.84 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.267441 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.84 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.267533 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.267746 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.267840 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.268727 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.268872 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.269296 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.269630 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.269723 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.269943 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.270051 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.270254 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.270374 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.270562 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.270700 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.270884 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.271009 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.271220 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.271305 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.271527 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.271613 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.271779 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.271915 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.272080 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.272250 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.272384 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.272553 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.272704 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.272790 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.273034 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.273120 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.273340 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.273449 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.273645 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.273731 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.273943 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.274027 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.274247 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.274331 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.274551 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.274645 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.274859 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.274954 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.275161 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.275255 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.275465 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.275549 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.275764 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.275875 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.276064 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.276174 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.276367 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.276470 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.276662 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.276746 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.276993 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.277093 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.277298 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.277383 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.277598 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.277690 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.277901 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.277995 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.278203 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.278297 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.278506 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.278592 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.278808 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.278901 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.279110 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.279201 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.279409 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.279495 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.279727 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.279858 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.280026 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.280112 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.280328 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.280487 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.280643 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.280822 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.280952 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.281048 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.281256 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.281413 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.281570 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.281670 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.281862 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.281954 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.282165 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.282250 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.282477 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.282562 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.282774 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.282866 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.283071 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.283158 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.283369 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.283463 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.283703 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.283836 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.284000 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.284161 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.284307 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.284466 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.284608 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.284766 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.284934 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.285094 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.285241 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.285390 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.285544 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.285703 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.285848 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.286018 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.286146 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.286322 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.286476 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.286625 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.286765 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.286925 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.287061 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.287240 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.287363 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.287571 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.287656 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.287901 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.287987 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:22:52.288239 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.288323 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.288548 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.288632 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.288901 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.288992 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.289231 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.289316 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.289546 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.289712 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.289855 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.289947 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.290163 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.290248 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.290488 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.290595 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.290793 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.290879 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.291100 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.291191 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.291408 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.291501 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.291717 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.291800 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.292024 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.292107 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.292339 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.292446 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.292650 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.292737 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.292986 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.293073 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.293300 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.293397 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.293605 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.293690 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.293917 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.294000 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.294233 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.294326 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.294547 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.294657 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.294853 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.294938 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.295194 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.295332 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.295537 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.295650 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.295847 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.295995 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.296169 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.296348 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.296544 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.296663 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.296790 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.297014 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.297111 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.297333 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.297428 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.297646 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.297792 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.297958 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.298067 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.298266 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.298363 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.298588 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.298673 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.298915 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.299012 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.299249 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.299393 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.299642 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.299735 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.299861 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.299950 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.300170 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.300257 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.300480 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.300565 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.300791 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.300909 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.301119 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.301205 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.301452 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.301556 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.301761 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.301847 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.302066 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.302160 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.302371 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.302465 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.302675 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.302769 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.302976 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.303062 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.303276 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.303371 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.303574 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.303660 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.303875 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.303960 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.304172 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.304265 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.304474 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.304565 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.304782 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.304891 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.305106 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.305206 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.305426 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.305511 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.305724 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.305820 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.306030 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.306126 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.306338 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.306446 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.306641 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.306735 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.306940 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.307028 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.307249 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.307347 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.307549 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.307635 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.307850 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.307938 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.308156 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.308242 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.308462 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.308555 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.308762 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.308871 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.309103 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.309201 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.309404 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.309492 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.309705 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.309793 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.310013 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.310099 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.310316 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.310408 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.310620 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.310762 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.310924 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.311009 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.311230 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.311324 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.311540 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.311626 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.311844 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.311928 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.312153 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.312332 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.312471 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.312558 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.312782 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.312898 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.313105 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.313193 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.313425 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.313518 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.313742 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.313836 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.314051 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.314137 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.314348 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.314432 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.314653 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.314739 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.315495 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.315612 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.315790 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.315896 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.316091 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.316190 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.316395 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.316510 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.316704 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.316813 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.317017 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.317113 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.317318 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.317406 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.317617 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.317701 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.317914 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.318012 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.318213 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.318298 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.318516 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.318602 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.318814 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.318913 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.319110 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.319198 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.319409 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.319502 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.319716 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.319809 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.320017 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.320102 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.320320 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.320406 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.320661 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.320861 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.320990 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.321076 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.321310 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.321395 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.321619 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.321706 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.321930 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.322015 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.322235 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.322321 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.322541 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.322628 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.322847 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.322941 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.323153 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.323237 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.323464 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.323550 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.323769 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.323860 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.324076 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.324161 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.324378 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.324464 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.324696 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.324787 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.325023 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.325121 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.325333 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.325417 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.325637 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.325728 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.325947 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.326039 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.326263 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.326349 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.326565 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.326650 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.326876 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.326970 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.327202 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.327287 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.327510 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.327661 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.327819 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.327919 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.328123 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.328209 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.328428 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.328514 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.328732 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.328851 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.329065 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.329151 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.329374 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.329458 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.329675 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.329761 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.329982 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.330065 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.330284 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.330376 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.331157 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.331302 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.331485 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.331618 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.331793 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.331888 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.332092 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.332178 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.332401 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.332486 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.332714 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.332816 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.333043 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.333138 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.333357 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.333444 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.333662 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.333755 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.333978 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.334063 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.334283 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.334376 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.334589 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.334691 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.334897 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.334984 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.335196 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.335282 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.335501 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.335598 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.335805 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.335897 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.336106 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.336198 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.336413 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.336567 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.336717 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.336834 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.337042 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.337140 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.337349 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.337438 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.337655 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.337755 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.337950 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.338037 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.338248 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.338337 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.338551 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.338645 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.338853 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.338939 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.339153 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.339249 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.339461 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.339548 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.339777 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.339862 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.340077 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.340165 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.340375 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.340461 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.340693 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.340896 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.341018 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.341104 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.341320 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.341479 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.341622 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.341844 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.341984 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.342119 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.342253 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.342387 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.342581 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.342717 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.342852 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.342995 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.343146 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.343328 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.343456 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.343620 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.343761 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.343895 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.344031 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.344164 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.344307 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.344449 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.344583 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.344717 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.344886 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.344989 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.345185 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.345280 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.345495 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.345592 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.345799 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.345887 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.346122 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.346215 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.346433 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.346527 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.346748 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.346877 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.347052 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.347151 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.347352 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.347447 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.347669 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.347816 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.347958 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.348045 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.348258 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.348353 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.348561 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.348657 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.348888 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.348981 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.349193 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.349454 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.349539 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.349784 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.349872 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.350094 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.350357 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.350450 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.350688 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.350793 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.351004 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.351090 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.351321 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.351429 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.351643 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.351741 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.351957 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.352052 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.352256 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.352352 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.352559 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.352653 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.352884 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.352976 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.353186 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.353288 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.353492 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.353579 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.353791 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.353891 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.354091 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.354177 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.354391 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.354542 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.354694 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.354792 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.354993 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.355079 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.355290 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.355387 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.355592 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.355680 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.355890 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.355978 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.356189 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.356275 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.356485 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.356573 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.356784 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.356955 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.357108 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.357239 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.357408 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.357496 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.357716 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.357808 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.358015 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.358111 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.358311 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.358399 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.358607 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.358701 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.358968 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.359077 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.359212 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.359300 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.359530 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.359636 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.359856 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.359957 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.360159 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.360259 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.360477 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.360563 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.360779 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.360909 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.361374 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.361475 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.361680 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.361852 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.362013 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.362126 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.362314 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.362426 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.362621 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.362739 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.362926 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.363045 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.363225 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.363433 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.363521 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.363749 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.363850 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.364062 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.364169 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.364374 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.364469 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.364682 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.364791 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.365010 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.365105 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.365313 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.365400 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.365617 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.365705 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.365920 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.366013 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.366219 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.366305 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.366518 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.366604 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.366820 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.366926 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.367124 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.367236 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.367423 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.367526 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.367722 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.367808 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.368018 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.368124 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.368320 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.368413 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.368616 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.368712 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.368936 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.369039 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.369237 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.369321 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.369539 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.369626 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.369841 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.369935 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.370137 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.370229 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.370438 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.370529 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.370743 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.370836 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.371041 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.371129 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.371340 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.371433 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.371642 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.371735 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.371940 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.372036 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.372236 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.372378 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.372535 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.372623 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.372860 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.372949 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.373164 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.373248 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.373466 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.373562 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.373773 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.373866 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.374096 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.374189 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.374393 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.374536 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.374690 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.374784 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.374990 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.375076 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.375288 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.375383 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.375580 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.375664 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.375876 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.375970 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.376172 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.376259 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.376469 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.376556 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.376766 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.376876 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.377087 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.377187 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.377928 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.378050 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.378312 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.378425 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.378617 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.378842 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.378960 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.379153 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.379276 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.379459 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.379606 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.379762 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.379908 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.380065 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.380218 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.380533 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.380618 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.380862 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.380953 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.381174 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.381285 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.381482 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.381586 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.381780 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.381884 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.382091 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.382199 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.382395 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.382496 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.382703 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.382801 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.383000 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.383093 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.383298 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.383384 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.383606 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.383698 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.383910 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.384003 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.384215 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.384301 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.384514 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.384606 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.384832 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.384923 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.385161 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.385258 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.385465 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.385564 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.385770 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.385863 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.386074 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.386158 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.386377 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.386470 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.386679 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.386774 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.386985 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.387071 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.387294 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.387453 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.387599 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.387743 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.387892 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.388054 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.388184 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.388322 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.388465 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.388600 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.388761 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.388869 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.389092 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.389190 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.389395 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.389479 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.389695 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.389788 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.390000 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.390152 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.390305 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.390391 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.390603 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.390687 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.390906 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.391006 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.391206 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.391298 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.391509 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.391592 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.391808 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.391895 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.392112 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.392228 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.392422 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.392552 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.392724 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.392863 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.393113 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.393808 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.394099 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.394222 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.394422 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.394516 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.394734 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.394828 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.395047 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.395133 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.395351 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.395447 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.395710 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.395794 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.396019 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.396117 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.396334 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.396419 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.396646 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.396731 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.396972 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.397077 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.397275 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.397391 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.397579 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.397718 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.397898 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.397997 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.398198 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.398309 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.398498 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.398614 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.398798 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.398917 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.399115 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.399224 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.399413 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.399548 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.399730 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.399852 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.400139 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.400225 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.400444 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.400527 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.400743 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.400858 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.401079 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.401165 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.401399 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.401484 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.401768 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.401861 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.402085 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.402170 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.402403 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.402491 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.402723 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.402842 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.403021 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.403121 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.403329 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.403428 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.403635 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.403721 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.403952 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.404048 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.404270 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.404356 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.404575 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.404673 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.404907 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.404998 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.405209 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.405294 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.405531 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.405697 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.405851 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.405938 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.406157 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.406241 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.406465 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.406559 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.406770 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.406856 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.407095 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.407196 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.407413 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.407508 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.407726 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.407822 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.408047 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.408133 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.408368 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.408461 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.408692 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.408925 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.409046 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.409242 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.409475 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.409572 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.409789 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.409875 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.410110 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.410197 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.410412 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.410500 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.410718 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.410812 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.411022 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.411116 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.411326 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.411420 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.411625 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.411719 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.411922 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.412017 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.412233 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.412318 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.412528 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.412616 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.412855 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.412962 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.413161 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.413256 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.413464 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.413551 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.413783 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.413878 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.414083 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.414168 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.414399 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.414484 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.414703 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.414798 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.415000 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.415086 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.415297 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.415390 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.415602 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.415697 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.415935 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.416028 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.416233 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.416317 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.416533 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.416619 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.416854 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.416955 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.417161 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.417254 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.417495 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.417581 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.417797 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.417890 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.418114 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.418200 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.418442 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.418528 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.418756 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.418851 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.419063 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.419158 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.419363 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.419448 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.419661 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.419746 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.419966 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.420061 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.420265 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.420352 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.420564 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.420657 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.420886 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.420992 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.421191 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.421285 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.421489 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.421576 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.421786 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.421880 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.422084 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.422178 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.422399 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.422530 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.422697 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.422786 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.422999 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.423084 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.423301 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.423387 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.423597 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.423692 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.423896 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.423983 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.424194 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.424333 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.424629 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.424862 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.424967 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.425236 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.425331 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.425558 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.425657 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.425862 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.425958 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.426183 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.426268 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.426494 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.426580 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.426806 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.426893 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.427113 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.427200 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.427422 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.427510 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.427733 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.427867 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.428045 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.428130 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.428352 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.428439 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.428657 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.428750 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.428991 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.429091 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.429299 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.429385 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.429608 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.429694 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.429918 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.430122 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.430231 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.430445 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.430531 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.430754 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.430840 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.431064 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.431352 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.431439 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.431669 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.431753 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.431978 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.432074 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.432287 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.432374 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.432631 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.432729 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.432918 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.433008 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.433230 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.433343 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.433539 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.433624 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.433851 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.433938 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.434162 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.434248 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.434473 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.434568 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.434792 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.434880 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.435105 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.435199 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.435417 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.435517 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.435734 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.435869 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.436052 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.436137 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.436370 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.436483 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.436675 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.436761 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.437014 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.437109 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.437326 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.437429 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.437637 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.437724 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.437944 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.438037 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.438248 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.438336 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.438556 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.438642 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.438863 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.438957 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.439168 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.439256 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.439475 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.439570 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.439782 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.440384 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.440645 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.440739 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.441041 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.441141 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.441300 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.441401 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.441613 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.441700 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.441927 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.442020 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.442252 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.442347 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.442588 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.442737 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.442932 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.443107 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.443251 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.443420 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.443507 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.443749 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.443835 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.444073 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.444318 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.444413 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.444636 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.444723 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.444995 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.445083 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.445333 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.445422 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.445637 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.445722 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.445940 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.446033 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.446252 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.446347 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.446559 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.446644 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.446860 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.446955 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.447168 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.447253 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.447472 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.447556 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.447774 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.447869 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.448077 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.448162 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.448382 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.448468 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.448697 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.448937 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.449029 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.449284 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.449370 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.449598 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.449684 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.449925 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.450149 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.450235 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.450499 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.450586 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.450817 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.450910 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.451143 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.451228 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.451444 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.451528 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.451749 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.451837 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.452062 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.452148 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.452368 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.452454 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.452670 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.452766 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.453000 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.453090 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.453312 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.453411 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.453621 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.453708 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.453923 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.454008 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.454231 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.454327 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.454533 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.454644 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.454855 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.454949 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.455158 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.455257 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.455460 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.455623 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.456327 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.456472 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.456628 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.456734 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.456921 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.457023 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.457223 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.457310 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.457525 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.457612 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.457826 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.457912 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.458126 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.458210 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.458424 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.458517 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.458725 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.458810 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.459022 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.459114 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.459327 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.459416 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.459628 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.459761 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.459934 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.460029 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.460231 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.460324 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.460537 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.460621 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.460861 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.460962 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.461171 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.461258 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.461476 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.461562 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.461799 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.461956 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.462104 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.462191 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.462411 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.462498 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.462718 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.462813 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.463057 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.463141 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.463367 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.463452 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.463677 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.463901 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.463989 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.464234 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.464404 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.464552 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.464724 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.464908 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.465223 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.465308 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.465529 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.465617 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.465832 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.465920 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.466140 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.466277 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.466463 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.466589 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.466771 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.466900 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.467079 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.467210 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.467385 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.467519 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.467692 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.467846 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.467996 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.468177 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.468301 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.468547 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.468636 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.468888 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.468993 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.469203 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.469291 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.469514 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.469602 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.469818 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.469905 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.470120 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.470207 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.470425 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.470513 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.470728 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.470815 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.471038 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.471190 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.471433 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.471561 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.471751 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.471878 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.472065 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.472202 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.472378 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.472518 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.472689 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.472858 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.473025 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.473207 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.473332 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.473529 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.473638 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.473846 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.473931 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.474164 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.474260 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.474483 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.474569 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.474795 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.474895 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.475108 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.475195 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.475423 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.475534 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.475732 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.475827 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.476047 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.476155 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.476378 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.476464 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.476695 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.476789 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.477026 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.477112 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.477402 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.477487 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.477710 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.477806 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.478026 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.478112 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.478333 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.478418 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.478650 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.478737 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.478973 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.479059 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.479297 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.479384 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.479609 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.479696 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.479910 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.479994 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.480213 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.480308 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.480516 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.480602 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.480845 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.480935 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.481157 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.481312 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.481463 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.481549 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.481763 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.481857 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.482062 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.482163 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.482366 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.482453 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.482664 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.482749 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.482962 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.483050 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.483261 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.483365 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.483559 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.483653 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.483861 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.483960 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.484158 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.484251 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.484457 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.484543 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.484754 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.484854 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.485077 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.485180 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.485375 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.485462 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.485673 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.485760 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.485971 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.486310 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.486519 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.486624 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.486856 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.486959 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.487231 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.487477 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.487573 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.487758 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.487846 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.488064 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.488150 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.488374 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.488506 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.488679 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.488768 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.489010 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.489098 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.489314 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.489400 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.489618 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.489706 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.489921 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.490015 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.490255 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.490354 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.490582 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.490668 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.490894 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.490979 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.491198 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.491291 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.491514 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.491641 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.491818 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.491904 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.492122 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.492218 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.492427 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.492522 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.492731 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.492836 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.493065 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.493167 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.493372 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.493467 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.493694 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.493778 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.494000 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.494089 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.494304 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.494389 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.494611 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.494696 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.494920 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.495010 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.495233 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.495326 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.495541 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.495634 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.495846 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.495932 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.496173 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.496260 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.496478 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.496635 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.496783 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.496900 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.497112 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.497200 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.497417 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.497517 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.497722 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.497808 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.498033 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.498120 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.498336 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.498431 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.498642 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.498745 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.498953 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.499041 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.499259 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.499346 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.499570 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.499658 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.499880 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.499968 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.500197 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.500285 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.500507 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.500600 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.500843 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.500964 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.501161 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.501255 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.501475 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.501573 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.501804 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.501902 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.502132 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.502218 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.502969 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.503150 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.503324 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.503499 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.503630 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.503734 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.503915 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 11:22:52.504010 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.504276 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.504624 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.504977 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.505304 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.505618 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.505925 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:22:52.506168 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 11:22:52.658370 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: INFO dbcounter [None req-a72dc6bc-8124-456c-b823-649a92e11a3a None None] Registered counter for database nova_api Aug 24 11:22:52.660837 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: INFO dbcounter [None req-dfc1c696-7613-452b-9553-3893c7c264b1 None None] Registered counter for database nova_api Aug 24 11:22:52.680721 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG oslo_db.sqlalchemy.engines [None req-a72dc6bc-8124-456c-b823-649a92e11a3a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106031) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 11:22:52.682251 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG oslo_db.sqlalchemy.engines [None req-dfc1c696-7613-452b-9553-3893c7c264b1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106032) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 11:22:52.687346 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG dbcounter [-] [106031] Writer thread running {{(pid=106031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 11:22:52.688600 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG dbcounter [-] [106032] Writer thread running {{(pid=106032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 11:22:52.745043 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.context [None req-dfc1c696-7613-452b-9553-3893c7c264b1 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),65f11403-e029-4cba-8205-60fa018f7cd7(cell1) {{(pid=106032) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 11:22:52.745217 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.context [None req-a72dc6bc-8124-456c-b823-649a92e11a3a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),65f11403-e029-4cba-8205-60fa018f7cd7(cell1) {{(pid=106031) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 11:22:52.748788 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG oslo_concurrency.lockutils [None req-a72dc6bc-8124-456c-b823-649a92e11a3a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:22:52.748947 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG oslo_concurrency.lockutils [None req-dfc1c696-7613-452b-9553-3893c7c264b1 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:22:52.749272 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG oslo_concurrency.lockutils [None req-a72dc6bc-8124-456c-b823-649a92e11a3a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:22:52.749379 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG oslo_concurrency.lockutils [None req-dfc1c696-7613-452b-9553-3893c7c264b1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:22:52.750841 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG oslo_concurrency.lockutils [None req-dfc1c696-7613-452b-9553-3893c7c264b1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:22:52.750974 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG oslo_concurrency.lockutils [None req-a72dc6bc-8124-456c-b823-649a92e11a3a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:22:52.751574 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG oslo_concurrency.lockutils [None req-dfc1c696-7613-452b-9553-3893c7c264b1 None None] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:22:52.751695 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG oslo_concurrency.lockutils [None req-a72dc6bc-8124-456c-b823-649a92e11a3a None None] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:22:52.752016 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG oslo_concurrency.lockutils [None req-dfc1c696-7613-452b-9553-3893c7c264b1 None None] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:22:52.752136 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG oslo_concurrency.lockutils [None req-a72dc6bc-8124-456c-b823-649a92e11a3a None None] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:22:52.754798 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG oslo_concurrency.lockutils [None req-a72dc6bc-8124-456c-b823-649a92e11a3a None None] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:22:52.755250 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG oslo_concurrency.lockutils [None req-dfc1c696-7613-452b-9553-3893c7c264b1 None None] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=106032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:22:52.756739 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: INFO dbcounter [None req-a72dc6bc-8124-456c-b823-649a92e11a3a None None] Registered counter for database nova_cell0 Aug 24 11:22:52.757229 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: INFO dbcounter [None req-dfc1c696-7613-452b-9553-3893c7c264b1 None None] Registered counter for database nova_cell0 Aug 24 11:22:52.762220 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: INFO dbcounter [None req-a72dc6bc-8124-456c-b823-649a92e11a3a None None] Registered counter for database nova_cell1 Aug 24 11:22:52.762745 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: INFO dbcounter [None req-dfc1c696-7613-452b-9553-3893c7c264b1 None None] Registered counter for database nova_cell1 Aug 24 11:22:52.769331 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG oslo_db.sqlalchemy.engines [None req-a72dc6bc-8124-456c-b823-649a92e11a3a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106031) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 11:22:52.771863 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG oslo_db.sqlalchemy.engines [None req-a72dc6bc-8124-456c-b823-649a92e11a3a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106031) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 11:22:52.773360 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG oslo_db.sqlalchemy.engines [None req-dfc1c696-7613-452b-9553-3893c7c264b1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106032) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 11:22:52.775799 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG oslo_db.sqlalchemy.engines [None req-dfc1c696-7613-452b-9553-3893c7c264b1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106032) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 11:22:52.776565 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG dbcounter [-] [106031] Writer thread running {{(pid=106031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 11:22:52.779371 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG dbcounter [-] [106031] Writer thread running {{(pid=106031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 11:22:52.781632 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG dbcounter [-] [106032] Writer thread running {{(pid=106032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 11:22:52.783103 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG dbcounter [-] [106032] Writer thread running {{(pid=106032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 11:22:52.923838 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: INFO dbcounter [None req-a72dc6bc-8124-456c-b823-649a92e11a3a None None] Registered counter for database nova_cell0 Aug 24 11:22:52.928690 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: INFO dbcounter [None req-dfc1c696-7613-452b-9553-3893c7c264b1 None None] Registered counter for database nova_cell0 Aug 24 11:22:52.933572 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG oslo_db.sqlalchemy.engines [None req-a72dc6bc-8124-456c-b823-649a92e11a3a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106031) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 11:22:52.937196 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG oslo_db.sqlalchemy.engines [None req-dfc1c696-7613-452b-9553-3893c7c264b1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106032) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 11:22:52.938141 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG dbcounter [-] [106031] Writer thread running {{(pid=106031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 11:22:52.942153 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG dbcounter [-] [106032] Writer thread running {{(pid=106032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 11:22:53.395899 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: WARNING keystonemiddleware.auth_token [None req-a72dc6bc-8124-456c-b823-649a92e11a3a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 11:22:53.403270 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: WARNING keystonemiddleware.auth_token [None req-a72dc6bc-8124-456c-b823-649a92e11a3a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 11:22:53.442610 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: WARNING keystonemiddleware.auth_token [None req-dfc1c696-7613-452b-9553-3893c7c264b1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 11:22:53.449905 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: WARNING keystonemiddleware.auth_token [None req-dfc1c696-7613-452b-9553-3893c7c264b1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 11:22:53.753248 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: WARNING keystonemiddleware.auth_token [None req-a72dc6bc-8124-456c-b823-649a92e11a3a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 11:22:53.759422 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: WARNING keystonemiddleware.auth_token [None req-a72dc6bc-8124-456c-b823-649a92e11a3a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 11:22:53.764813 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x559e1bbf99c0 pid: 106031 (default app) Aug 24 11:22:53.766901 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi [None req-a72dc6bc-8124-456c-b823-649a92e11a3a None None] Calling method '>' {{(pid=106031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:22:53.768578 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: INFO nova.api.openstack.requestlog [None req-a72dc6bc-8124-456c-b823-649a92e11a3a None None] 10.222.0.84 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001758 Aug 24 11:22:53.769022 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: [pid: 106031|app: 0|req: 1/1] 10.222.0.84 () {50 vars in 788 bytes} [Wed Aug 24 11:22:53 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:22:53.802500 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: WARNING keystonemiddleware.auth_token [None req-dfc1c696-7613-452b-9553-3893c7c264b1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 11:22:53.808507 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: WARNING keystonemiddleware.auth_token [None req-dfc1c696-7613-452b-9553-3893c7c264b1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 11:22:53.813832 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x559e1bbf99c0 pid: 106032 (default app) Aug 24 11:24:18.179907 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi [None req-a72dc6bc-8124-456c-b823-649a92e11a3a None None] Calling method '>' {{(pid=106031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:24:18.180924 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: INFO nova.api.openstack.requestlog [None req-a72dc6bc-8124-456c-b823-649a92e11a3a None None] 10.222.0.84 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001422 Aug 24 11:24:18.181605 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: [pid: 106031|app: 0|req: 2/2] 10.222.0.84 () {54 vars in 931 bytes} [Wed Aug 24 11:24:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:24:18.194915 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG dbcounter [-] [106032] Writing DB stats nova_api:SELECT=3 {{(pid=106032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:24:18.196045 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG dbcounter [-] [106032] Writing DB stats nova_cell1:SELECT=3 {{(pid=106032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:24:18.197168 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG dbcounter [-] [106032] Writing DB stats nova_cell0:SELECT=3 {{(pid=106032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:24:18.198008 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG dbcounter [-] [106032] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:24:19.099904 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi [None req-30051bf4-d8e6-4b79-82f4-60f95e47f500 admin admin] Calling method '>' {{(pid=106032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:24:19.134429 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: INFO nova.api.openstack.requestlog [None req-30051bf4-d8e6-4b79-82f4-60f95e47f500 admin admin] 10.222.0.84 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.946196 Aug 24 11:24:19.135372 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: [pid: 106032|app: 0|req: 1/3] 10.222.0.84 () {60 vars in 1292 bytes} [Wed Aug 24 11:24:18 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:24:21.525942 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi [None req-a72dc6bc-8124-456c-b823-649a92e11a3a None None] Calling method '>' {{(pid=106031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:24:21.526753 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: INFO nova.api.openstack.requestlog [None req-a72dc6bc-8124-456c-b823-649a92e11a3a None None] 10.222.0.84 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001523 Aug 24 11:24:21.532189 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: [pid: 106031|app: 0|req: 3/4] 10.222.0.84 () {54 vars in 931 bytes} [Wed Aug 24 11:24:21 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:24:21.992110 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi [None req-70a19c5c-6be0-46bb-88c7-dc034363ce6c admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "id": "c1", "os-flavor-access:is_public": true, "name": "cirros256", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 256, "disk": 1}} {{(pid=106032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:24:22.012916 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 11:24:22.012916 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: warnings.warn(msg) Aug 24 11:24:22.137398 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: INFO nova.api.openstack.requestlog [None req-70a19c5c-6be0-46bb-88c7-dc034363ce6c admin admin] 10.222.0.84 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.604134 Aug 24 11:24:22.138106 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: [pid: 106032|app: 0|req: 2/5] 10.222.0.84 () {64 vars in 1283 bytes} [Wed Aug 24 11:24:21 2022] POST /compute/v2.1/flavors => generated 407 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 11:24:22.152757 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG dbcounter [-] [106031] Writing DB stats nova_api:SELECT=3 {{(pid=106031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:24:22.153625 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG dbcounter [-] [106031] Writing DB stats nova_cell1:SELECT=3 {{(pid=106031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:24:22.154692 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG dbcounter [-] [106031] Writing DB stats nova_cell0:SELECT=3 {{(pid=106031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:24:22.155765 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG dbcounter [-] [106031] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:24:22.374780 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi [None req-76d9404d-369c-48f2-8409-10643b71aac7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:24:22.379612 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 11:24:22.379612 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: warnings.warn(msg) Aug 24 11:24:22.550613 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: INFO nova.api.openstack.requestlog [None req-76d9404d-369c-48f2-8409-10643b71aac7 admin admin] 10.222.0.84 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.402885 Aug 24 11:24:22.551258 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: [pid: 106031|app: 0|req: 4/6] 10.222.0.84 () {64 vars in 1336 bytes} [Wed Aug 24 11:24:22 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:24:24.922804 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi [None req-70a19c5c-6be0-46bb-88c7-dc034363ce6c admin admin] Calling method '>' {{(pid=106032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:24:24.924558 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: INFO nova.api.openstack.requestlog [None req-70a19c5c-6be0-46bb-88c7-dc034363ce6c admin admin] 10.222.0.84 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002276 Aug 24 11:24:24.924999 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: [pid: 106032|app: 0|req: 3/7] 10.222.0.84 () {54 vars in 931 bytes} [Wed Aug 24 11:24:24 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:24:25.589481 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi [None req-1d51d64c-ec46-4651-bcdf-12e9aa47fb39 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 5, "vcpus": 1, "ram": 512, "name": "ds512M"}} {{(pid=106031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:24:25.609047 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 11:24:25.609047 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: warnings.warn(msg) Aug 24 11:24:25.782408 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: INFO nova.api.openstack.requestlog [None req-1d51d64c-ec46-4651-bcdf-12e9aa47fb39 admin admin] 10.222.0.84 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.850872 Aug 24 11:24:25.783744 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: [pid: 106031|app: 0|req: 5/8] 10.222.0.84 () {64 vars in 1283 bytes} [Wed Aug 24 11:24:24 2022] POST /compute/v2.1/flavors => generated 404 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 11:24:25.795545 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi [None req-29a8e284-cdc5-43cb-aeac-4018d38fab06 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:24:25.798427 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 11:24:25.798427 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: warnings.warn(msg) Aug 24 11:24:25.922663 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: INFO nova.api.openstack.requestlog [None req-29a8e284-cdc5-43cb-aeac-4018d38fab06 admin admin] 10.222.0.84 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.130660 Aug 24 11:24:25.923166 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: [pid: 106032|app: 0|req: 4/9] 10.222.0.84 () {64 vars in 1336 bytes} [Wed Aug 24 11:24:25 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:24:28.299907 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi [None req-1d51d64c-ec46-4651-bcdf-12e9aa47fb39 admin admin] Calling method '>' {{(pid=106031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:24:28.301040 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: INFO nova.api.openstack.requestlog [None req-1d51d64c-ec46-4651-bcdf-12e9aa47fb39 admin admin] 10.222.0.84 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001546 Aug 24 11:24:28.301492 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: [pid: 106031|app: 0|req: 6/10] 10.222.0.84 () {54 vars in 931 bytes} [Wed Aug 24 11:24:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:24:28.711025 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi [None req-ca25929b-7f7a-4587-bdc4-24166d895058 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "name": "ds1G", "disk": 10, "rxtx_factor": 1.0, "id": "d2"}} {{(pid=106032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:24:28.797842 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: INFO nova.api.openstack.requestlog [None req-ca25929b-7f7a-4587-bdc4-24166d895058 admin admin] 10.222.0.84 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.490031 Aug 24 11:24:28.799110 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: [pid: 106032|app: 0|req: 5/11] 10.222.0.84 () {64 vars in 1283 bytes} [Wed Aug 24 11:24:28 2022] POST /compute/v2.1/flavors => generated 404 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 11:24:28.811261 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi [None req-1964a1e0-29cb-4933-a953-7e5562b036ef admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:24:28.919864 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: INFO nova.api.openstack.requestlog [None req-1964a1e0-29cb-4933-a953-7e5562b036ef admin admin] 10.222.0.84 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.112412 Aug 24 11:24:28.920459 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: [pid: 106031|app: 0|req: 7/12] 10.222.0.84 () {64 vars in 1336 bytes} [Wed Aug 24 11:24:28 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:24:31.343486 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi [None req-ca25929b-7f7a-4587-bdc4-24166d895058 admin admin] Calling method '>' {{(pid=106032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:24:31.345252 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: INFO nova.api.openstack.requestlog [None req-ca25929b-7f7a-4587-bdc4-24166d895058 admin admin] 10.222.0.84 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002056 Aug 24 11:24:31.346079 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: [pid: 106032|app: 0|req: 6/13] 10.222.0.84 () {54 vars in 931 bytes} [Wed Aug 24 11:24:31 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:24:31.769964 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi [None req-fc11bc95-8302-45b3-9371-1c8a3b8f1a4f admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "os-flavor-access:is_public": true, "name": "ds2G", "disk": 10, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "d3", "ram": 2048}} {{(pid=106031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:24:31.867629 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: INFO nova.api.openstack.requestlog [None req-fc11bc95-8302-45b3-9371-1c8a3b8f1a4f admin admin] 10.222.0.84 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.515424 Aug 24 11:24:31.868413 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: [pid: 106031|app: 0|req: 8/14] 10.222.0.84 () {64 vars in 1283 bytes} [Wed Aug 24 11:24:31 2022] POST /compute/v2.1/flavors => generated 404 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 11:24:31.880894 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi [None req-8fe7e187-cdb5-406d-ba83-6c51c9ffe9d1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:24:32.003354 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: INFO nova.api.openstack.requestlog [None req-8fe7e187-cdb5-406d-ba83-6c51c9ffe9d1 admin admin] 10.222.0.84 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.126306 Aug 24 11:24:32.003969 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: [pid: 106032|app: 0|req: 7/15] 10.222.0.84 () {64 vars in 1336 bytes} [Wed Aug 24 11:24:31 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:24:34.371976 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi [None req-fc11bc95-8302-45b3-9371-1c8a3b8f1a4f admin admin] Calling method '>' {{(pid=106031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:24:34.373052 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: INFO nova.api.openstack.requestlog [None req-fc11bc95-8302-45b3-9371-1c8a3b8f1a4f admin admin] 10.222.0.84 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Aug 24 11:24:34.373448 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: [pid: 106031|app: 0|req: 9/16] 10.222.0.84 () {54 vars in 931 bytes} [Wed Aug 24 11:24:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:24:34.819749 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi [None req-29103416-6b9e-4020-b0d4-cbbce0b2dd5c admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "disk": 20, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 4, "rxtx_factor": 1.0, "id": "d4", "name": "ds4G"}} {{(pid=106032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:24:34.913402 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: INFO nova.api.openstack.requestlog [None req-29103416-6b9e-4020-b0d4-cbbce0b2dd5c admin admin] 10.222.0.84 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.533100 Aug 24 11:24:34.916287 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: [pid: 106032|app: 0|req: 8/17] 10.222.0.84 () {64 vars in 1283 bytes} [Wed Aug 24 11:24:34 2022] POST /compute/v2.1/flavors => generated 404 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 11:24:34.926315 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi [None req-4029f4f1-90e4-4871-843c-85c0c6c5eb95 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:24:35.016386 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: INFO nova.api.openstack.requestlog [None req-4029f4f1-90e4-4871-843c-85c0c6c5eb95 admin admin] 10.222.0.84 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.093918 Aug 24 11:24:35.033017 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: [pid: 106031|app: 0|req: 10/18] 10.222.0.84 () {64 vars in 1336 bytes} [Wed Aug 24 11:24:34 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:24:37.520976 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi [None req-29103416-6b9e-4020-b0d4-cbbce0b2dd5c admin admin] Calling method '>' {{(pid=106032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:24:37.521994 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: INFO nova.api.openstack.requestlog [None req-29103416-6b9e-4020-b0d4-cbbce0b2dd5c admin admin] 10.222.0.84 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001563 Aug 24 11:24:37.522402 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: [pid: 106032|app: 0|req: 9/19] 10.222.0.84 () {54 vars in 931 bytes} [Wed Aug 24 11:24:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:24:37.965595 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi [None req-6f5951bb-1525-4aea-bbeb-b74f236d0e6b admin admin] Calling method '>' {{(pid=106031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:24:37.992345 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: INFO nova.api.openstack.requestlog [None req-6f5951bb-1525-4aea-bbeb-b74f236d0e6b admin admin] 10.222.0.84 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.463478 Aug 24 11:24:37.992940 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: [pid: 106031|app: 0|req: 11/20] 10.222.0.84 () {60 vars in 1292 bytes} [Wed Aug 24 11:24:37 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:24:40.786689 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi [None req-29103416-6b9e-4020-b0d4-cbbce0b2dd5c admin admin] Calling method '>' {{(pid=106032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:24:40.787696 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: INFO nova.api.openstack.requestlog [None req-29103416-6b9e-4020-b0d4-cbbce0b2dd5c admin admin] 10.222.0.84 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Aug 24 11:24:40.788101 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: [pid: 106032|app: 0|req: 10/21] 10.222.0.84 () {54 vars in 931 bytes} [Wed Aug 24 11:24:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:24:41.204971 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi [None req-2359aca0-8b35-403b-83b1-7097fde161b1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "id": "1", "disk": 1, "os-flavor-access:is_public": true, "vcpus": 1, "name": "m1.tiny", "rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=106031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:24:41.307586 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: INFO nova.api.openstack.requestlog [None req-2359aca0-8b35-403b-83b1-7097fde161b1 admin admin] 10.222.0.84 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.513100 Aug 24 11:24:41.308146 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: [pid: 106031|app: 0|req: 12/22] 10.222.0.84 () {64 vars in 1283 bytes} [Wed Aug 24 11:24:40 2022] POST /compute/v2.1/flavors => generated 402 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 11:24:41.320035 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi [None req-2fef414a-951c-4de5-91b1-c1cd345165da admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:24:41.431548 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: INFO nova.api.openstack.requestlog [None req-2fef414a-951c-4de5-91b1-c1cd345165da admin admin] 10.222.0.84 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.115059 Aug 24 11:24:41.432102 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: [pid: 106032|app: 0|req: 11/23] 10.222.0.84 () {64 vars in 1333 bytes} [Wed Aug 24 11:24:41 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:24:43.759730 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi [None req-2359aca0-8b35-403b-83b1-7097fde161b1 admin admin] Calling method '>' {{(pid=106031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:24:43.760747 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: INFO nova.api.openstack.requestlog [None req-2359aca0-8b35-403b-83b1-7097fde161b1 admin admin] 10.222.0.84 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Aug 24 11:24:43.761207 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: [pid: 106031|app: 0|req: 13/24] 10.222.0.84 () {54 vars in 931 bytes} [Wed Aug 24 11:24:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:24:44.152170 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi [None req-9cd5fd9f-5e9f-42ad-ad19-7a7612f4838f admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "swap": 0, "ram": 2048, "name": "m1.small", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "2", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20}} {{(pid=106032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:24:44.266969 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: INFO nova.api.openstack.requestlog [None req-9cd5fd9f-5e9f-42ad-ad19-7a7612f4838f admin admin] 10.222.0.84 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.498518 Aug 24 11:24:44.267561 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: [pid: 106032|app: 0|req: 12/25] 10.222.0.84 () {64 vars in 1283 bytes} [Wed Aug 24 11:24:43 2022] POST /compute/v2.1/flavors => generated 405 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 11:24:44.279512 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi [None req-de8a1b95-c575-4f77-b0e5-18fb445db38c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:24:44.471362 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: INFO nova.api.openstack.requestlog [None req-de8a1b95-c575-4f77-b0e5-18fb445db38c admin admin] 10.222.0.84 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.195541 Aug 24 11:24:44.471990 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: [pid: 106031|app: 0|req: 14/26] 10.222.0.84 () {64 vars in 1333 bytes} [Wed Aug 24 11:24:44 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:24:46.866553 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi [None req-9cd5fd9f-5e9f-42ad-ad19-7a7612f4838f admin admin] Calling method '>' {{(pid=106032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:24:46.868180 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: INFO nova.api.openstack.requestlog [None req-9cd5fd9f-5e9f-42ad-ad19-7a7612f4838f admin admin] 10.222.0.84 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002042 Aug 24 11:24:46.869673 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: [pid: 106032|app: 0|req: 13/27] 10.222.0.84 () {54 vars in 931 bytes} [Wed Aug 24 11:24:46 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:24:47.346461 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi [None req-56aba8c2-f671-475a-925b-47466012ac03 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "disk": 40, "vcpus": 2, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "m1.medium", "swap": 0, "os-flavor-access:is_public": true}} {{(pid=106031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:24:48.147431 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: INFO nova.api.openstack.requestlog [None req-56aba8c2-f671-475a-925b-47466012ac03 admin admin] 10.222.0.84 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 1.271519 Aug 24 11:24:48.148002 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: [pid: 106031|app: 0|req: 15/28] 10.222.0.84 () {64 vars in 1283 bytes} [Wed Aug 24 11:24:46 2022] POST /compute/v2.1/flavors => generated 406 bytes in 1273 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 11:24:48.160504 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi [None req-474a2cf1-8e48-493c-8a98-394545dcc26a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:24:48.311068 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: INFO nova.api.openstack.requestlog [None req-474a2cf1-8e48-493c-8a98-394545dcc26a admin admin] 10.222.0.84 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.154742 Aug 24 11:24:48.312377 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: [pid: 106032|app: 0|req: 14/29] 10.222.0.84 () {64 vars in 1333 bytes} [Wed Aug 24 11:24:48 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:24:50.691212 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi [None req-56aba8c2-f671-475a-925b-47466012ac03 admin admin] Calling method '>' {{(pid=106031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:24:50.693097 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: INFO nova.api.openstack.requestlog [None req-56aba8c2-f671-475a-925b-47466012ac03 admin admin] 10.222.0.84 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002025 Aug 24 11:24:50.698828 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: [pid: 106031|app: 0|req: 16/30] 10.222.0.84 () {54 vars in 931 bytes} [Wed Aug 24 11:24:50 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:24:51.158269 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi [None req-39041408-1065-4ff8-aeb4-1c6781e7e226 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "id": "4", "rxtx_factor": 1.0, "name": "m1.large", "swap": 0, "os-flavor-access:is_public": true, "ram": 8192, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=106032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:24:51.164299 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG dbcounter [-] [106032] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=106032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:24:51.285127 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: INFO nova.api.openstack.requestlog [None req-39041408-1065-4ff8-aeb4-1c6781e7e226 admin admin] 10.222.0.84 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.584866 Aug 24 11:24:51.293028 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: [pid: 106032|app: 0|req: 15/31] 10.222.0.84 () {64 vars in 1283 bytes} [Wed Aug 24 11:24:50 2022] POST /compute/v2.1/flavors => generated 405 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 11:24:51.298351 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi [None req-ae8f35f0-7df9-4c74-90ac-dd160b0be295 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:24:51.430637 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: INFO nova.api.openstack.requestlog [None req-ae8f35f0-7df9-4c74-90ac-dd160b0be295 admin admin] 10.222.0.84 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.136465 Aug 24 11:24:51.431261 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: [pid: 106031|app: 0|req: 17/32] 10.222.0.84 () {64 vars in 1333 bytes} [Wed Aug 24 11:24:51 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:24:53.933487 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi [None req-39041408-1065-4ff8-aeb4-1c6781e7e226 admin admin] Calling method '>' {{(pid=106032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:24:53.935169 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: INFO nova.api.openstack.requestlog [None req-39041408-1065-4ff8-aeb4-1c6781e7e226 admin admin] 10.222.0.84 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002131 Aug 24 11:24:53.935579 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: [pid: 106032|app: 0|req: 16/33] 10.222.0.84 () {54 vars in 931 bytes} [Wed Aug 24 11:24:53 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:24:54.400294 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi [None req-1c1e89ba-e147-4924-a8f4-a64d5c4027a9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "disk": 160, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "m1.xlarge", "os-flavor-access:is_public": true, "ram": 16384, "id": "5", "rxtx_factor": 1.0}} {{(pid=106031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:24:54.501958 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: INFO nova.api.openstack.requestlog [None req-1c1e89ba-e147-4924-a8f4-a64d5c4027a9 admin admin] 10.222.0.84 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.558641 Aug 24 11:24:54.503008 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: [pid: 106031|app: 0|req: 18/34] 10.222.0.84 () {64 vars in 1283 bytes} [Wed Aug 24 11:24:53 2022] POST /compute/v2.1/flavors => generated 408 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 11:24:54.514764 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi [None req-1dbb7c38-76f7-4010-b97a-b9cb82fdf8e7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:24:54.683648 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: INFO nova.api.openstack.requestlog [None req-1dbb7c38-76f7-4010-b97a-b9cb82fdf8e7 admin admin] 10.222.0.84 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.172554 Aug 24 11:24:54.687325 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: [pid: 106032|app: 0|req: 17/35] 10.222.0.84 () {64 vars in 1333 bytes} [Wed Aug 24 11:24:54 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:25:13.485864 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi [None req-1c1e89ba-e147-4924-a8f4-a64d5c4027a9 admin admin] Calling method '>' {{(pid=106031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:13.486872 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: INFO nova.api.openstack.requestlog [None req-1c1e89ba-e147-4924-a8f4-a64d5c4027a9 admin admin] 10.222.0.84 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Aug 24 11:25:13.487270 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: [pid: 106031|app: 0|req: 19/36] 10.222.0.84 () {54 vars in 931 bytes} [Wed Aug 24 11:25:13 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:25:13.879185 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi [None req-6b807638-ec11-4f55-a607-a57876ec6ac6 admin admin] Calling method '>' {{(pid=106032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:13.898617 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: INFO nova.api.openstack.requestlog [None req-6b807638-ec11-4f55-a607-a57876ec6ac6 admin admin] 10.222.0.84 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.404728 Aug 24 11:25:13.899250 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: [pid: 106032|app: 0|req: 18/37] 10.222.0.84 () {60 vars in 1292 bytes} [Wed Aug 24 11:25:13 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:25:14.958195 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi [None req-1c1e89ba-e147-4924-a8f4-a64d5c4027a9 admin admin] Calling method '>' {{(pid=106031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:14.959206 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: INFO nova.api.openstack.requestlog [None req-1c1e89ba-e147-4924-a8f4-a64d5c4027a9 admin admin] 10.222.0.84 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001427 Aug 24 11:25:14.959607 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: [pid: 106031|app: 0|req: 20/38] 10.222.0.84 () {56 vars in 1074 bytes} [Wed Aug 24 11:25:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:25:15.487418 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi [None req-4a217463-093f-48ac-9883-47126c40f25b admin admin] Calling method '>' {{(pid=106032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:15.493241 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: INFO nova.api.openstack.wsgi [None req-4a217463-093f-48ac-9883-47126c40f25b admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 24 11:25:15.496447 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi [None req-4a217463-093f-48ac-9883-47126c40f25b admin admin] Request method failure captured: Aug 24 11:25:15.496447 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 24 11:25:15.496447 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: Accept: application/json Aug 24 11:25:15.496447 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: Accept-Encoding: gzip, deflate Aug 24 11:25:15.496447 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: Connection: keep-alive Aug 24 11:25:15.496447 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: Content-Length: 0 Aug 24 11:25:15.496447 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: Host: 10.222.0.84 Aug 24 11:25:15.496447 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: Openstack-Api-Version: compute 2.90 Aug 24 11:25:15.496447 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: Openstack-System-Scope: None Aug 24 11:25:15.496447 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: User-Agent: python-novaclient Aug 24 11:25:15.496447 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: X-Auth-Token: gAAAAABjBgqaiTiFN8OUB-kX3QVw4UK4fVZdy-tyoxokN3SBvLtROjtr7qFu4ekMEYLusSiVQNflfLbhdM4rzTT8o-FxrvXDQUhIqx9xyjS9n3J_0IDD53sXb20XjnUQ8eHwv77ZoM4uGYITABgoi9-SBJBl4K0xWKHyuMqAVAlm_OQ3-T8LfQM Aug 24 11:25:15.496447 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: X-Domain-Id: None Aug 24 11:25:15.496447 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: X-Domain-Name: None Aug 24 11:25:15.496447 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: X-Identity-Status: Confirmed Aug 24 11:25:15.496447 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: X-Is-Admin-Project: True Aug 24 11:25:15.496447 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 11:25:15.496447 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: X-Project-Domain-Id: default Aug 24 11:25:15.496447 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: X-Project-Domain-Name: Default Aug 24 11:25:15.496447 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: X-Project-Id: cd4c9f105cf4428d9f0cb67e8376cb7e Aug 24 11:25:15.496447 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: X-Project-Name: admin Aug 24 11:25:15.496447 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: X-Role: reader,admin,member Aug 24 11:25:15.496447 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: X-Roles: reader,admin,member Aug 24 11:25:15.497918 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/volume/v3/cd4c9f105cf4428d9f0cb67e8376cb7e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/volume/v3/cd4c9f105cf4428d9f0cb67e8376cb7e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/compute/v2/cd4c9f105cf4428d9f0cb67e8376cb7e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84:8080/v1/AUTH_cd4c9f105cf4428d9f0cb67e8376cb7e", "adminURL": "http://10.222.0.84:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/placement"}]}] Aug 24 11:25:15.497918 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: X-Tenant: admin Aug 24 11:25:15.497918 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: X-Tenant-Id: cd4c9f105cf4428d9f0cb67e8376cb7e Aug 24 11:25:15.497918 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: X-Tenant-Name: admin Aug 24 11:25:15.497918 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: X-User: admin Aug 24 11:25:15.497918 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: X-User-Domain-Id: default Aug 24 11:25:15.497918 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: X-User-Domain-Name: Default Aug 24 11:25:15.497918 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: X-User-Id: 4fac3b46e24449e193279323e9d64fe0 Aug 24 11:25:15.497918 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: X-User-Name: admin Aug 24 11:25:15.497918 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: method: > Aug 24 11:25:15.497918 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: exception: Flavor 42 could not be found. Aug 24 11:25:15.497918 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: action_args: {'id': '42'} Aug 24 11:25:15.497918 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: {{(pid=106032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:25:15.497918 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:25:15.500293 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 11:25:15.500293 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 11:25:15.500293 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 11:25:15.500293 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 11:25:15.500293 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 11:25:15.500293 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 11:25:15.500293 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 11:25:15.500293 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 11:25:15.500293 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 11:25:15.500293 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:25:15.500293 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 11:25:15.500293 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 11:25:15.500293 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 24 11:25:15.500293 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi Aug 24 11:25:15.500293 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:25:15.500293 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi Aug 24 11:25:15.500293 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:25:15.500293 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:25:15.500293 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:25:15.502433 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:25:15.502433 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:25:15.502433 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:25:15.502433 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:25:15.502433 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 11:25:15.502433 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:25:15.502433 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 24 11:25:15.502433 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi Aug 24 11:25:15.502433 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:25:15.502433 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi Aug 24 11:25:15.502433 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:25:15.502433 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:25:15.502433 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:25:15.502433 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:25:15.502433 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:25:15.502433 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 24 11:25:15.502433 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi Aug 24 11:25:15.502433 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi [None req-4a217463-093f-48ac-9883-47126c40f25b admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:25:15.504901 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: INFO nova.api.openstack.requestlog [None req-4a217463-093f-48ac-9883-47126c40f25b admin admin] 10.222.0.84 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.397546 Aug 24 11:25:15.504901 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: [pid: 106032|app: 0|req: 19/39] 10.222.0.84 () {60 vars in 1190 bytes} [Wed Aug 24 11:25:15 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 399 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 11:25:15.507627 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi [None req-9ee641e6-6007-464f-ab7e-afb96aaa4498 admin admin] Calling method '>' {{(pid=106031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:15.511833 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG dbcounter [-] [106031] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=106031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:25:15.530329 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: INFO nova.api.openstack.requestlog [None req-9ee641e6-6007-464f-ab7e-afb96aaa4498 admin admin] 10.222.0.84 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026193 Aug 24 11:25:15.531411 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: [pid: 106031|app: 0|req: 21/40] 10.222.0.84 () {60 vars in 1210 bytes} [Wed Aug 24 11:25:15 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 11:25:15.541532 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi [None req-84311274-cf8b-425c-b6df-35f3eddd89fa admin admin] Calling method '>' {{(pid=106032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:15.566485 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: INFO nova.api.openstack.requestlog [None req-84311274-cf8b-425c-b6df-35f3eddd89fa admin admin] 10.222.0.84 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028212 Aug 24 11:25:15.567035 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: [pid: 106032|app: 0|req: 20/41] 10.222.0.84 () {60 vars in 1210 bytes} [Wed Aug 24 11:25:15 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:25:15.576385 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi [None req-c12915cd-f178-40b4-9944-2074996cbc0e admin admin] Calling method '>' {{(pid=106031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:15.583159 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: INFO nova.api.openstack.wsgi [None req-c12915cd-f178-40b4-9944-2074996cbc0e admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 24 11:25:15.586405 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi [None req-c12915cd-f178-40b4-9944-2074996cbc0e admin admin] Request method failure captured: Aug 24 11:25:15.586405 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 24 11:25:15.586405 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: Accept: application/json Aug 24 11:25:15.586405 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: Accept-Encoding: gzip, deflate Aug 24 11:25:15.586405 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: Connection: keep-alive Aug 24 11:25:15.586405 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: Content-Length: 0 Aug 24 11:25:15.586405 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: Host: 10.222.0.84 Aug 24 11:25:15.586405 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: Openstack-Api-Version: compute 2.90 Aug 24 11:25:15.586405 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: Openstack-System-Scope: None Aug 24 11:25:15.586405 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: User-Agent: python-novaclient Aug 24 11:25:15.586405 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: X-Auth-Token: gAAAAABjBgqaiTiFN8OUB-kX3QVw4UK4fVZdy-tyoxokN3SBvLtROjtr7qFu4ekMEYLusSiVQNflfLbhdM4rzTT8o-FxrvXDQUhIqx9xyjS9n3J_0IDD53sXb20XjnUQ8eHwv77ZoM4uGYITABgoi9-SBJBl4K0xWKHyuMqAVAlm_OQ3-T8LfQM Aug 24 11:25:15.586405 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: X-Domain-Id: None Aug 24 11:25:15.586405 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: X-Domain-Name: None Aug 24 11:25:15.586405 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: X-Identity-Status: Confirmed Aug 24 11:25:15.586405 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: X-Is-Admin-Project: True Aug 24 11:25:15.586405 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 11:25:15.586405 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: X-Project-Domain-Id: default Aug 24 11:25:15.586405 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: X-Project-Domain-Name: Default Aug 24 11:25:15.586405 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: X-Project-Id: cd4c9f105cf4428d9f0cb67e8376cb7e Aug 24 11:25:15.586405 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: X-Project-Name: admin Aug 24 11:25:15.586405 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: X-Role: reader,admin,member Aug 24 11:25:15.586405 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: X-Roles: reader,admin,member Aug 24 11:25:15.595611 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/volume/v3/cd4c9f105cf4428d9f0cb67e8376cb7e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/volume/v3/cd4c9f105cf4428d9f0cb67e8376cb7e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/compute/v2/cd4c9f105cf4428d9f0cb67e8376cb7e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84:8080/v1/AUTH_cd4c9f105cf4428d9f0cb67e8376cb7e", "adminURL": "http://10.222.0.84:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/placement"}]}] Aug 24 11:25:15.595611 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: X-Tenant: admin Aug 24 11:25:15.595611 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: X-Tenant-Id: cd4c9f105cf4428d9f0cb67e8376cb7e Aug 24 11:25:15.595611 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: X-Tenant-Name: admin Aug 24 11:25:15.595611 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: X-User: admin Aug 24 11:25:15.595611 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: X-User-Domain-Id: default Aug 24 11:25:15.595611 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: X-User-Domain-Name: Default Aug 24 11:25:15.595611 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: X-User-Id: 4fac3b46e24449e193279323e9d64fe0 Aug 24 11:25:15.595611 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: X-User-Name: admin Aug 24 11:25:15.595611 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: method: > Aug 24 11:25:15.595611 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: exception: Flavor 42 could not be found. Aug 24 11:25:15.595611 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: action_args: {'id': '42'} Aug 24 11:25:15.595611 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: {{(pid=106031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:25:15.595611 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:25:15.596568 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 11:25:15.596568 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 11:25:15.596568 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 11:25:15.596568 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 11:25:15.596568 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 11:25:15.596568 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 11:25:15.596568 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 11:25:15.596568 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 11:25:15.596568 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 11:25:15.596568 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:25:15.596568 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 11:25:15.596568 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 11:25:15.596568 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 24 11:25:15.596568 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi Aug 24 11:25:15.596568 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:25:15.596568 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi Aug 24 11:25:15.596568 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:25:15.596568 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:25:15.596568 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:25:15.597867 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:25:15.597867 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:25:15.597867 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:25:15.597867 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:25:15.597867 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 11:25:15.597867 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:25:15.597867 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 24 11:25:15.597867 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi Aug 24 11:25:15.597867 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:25:15.597867 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi Aug 24 11:25:15.597867 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:25:15.597867 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:25:15.597867 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:25:15.597867 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:25:15.597867 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:25:15.597867 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 24 11:25:15.597867 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi Aug 24 11:25:15.597867 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi [None req-c12915cd-f178-40b4-9944-2074996cbc0e admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:25:15.599194 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: INFO nova.api.openstack.requestlog [None req-c12915cd-f178-40b4-9944-2074996cbc0e admin admin] 10.222.0.84 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014985 Aug 24 11:25:15.599194 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: [pid: 106031|app: 0|req: 22/42] 10.222.0.84 () {60 vars in 1190 bytes} [Wed Aug 24 11:25:15 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 24 11:25:16.590107 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi [None req-84311274-cf8b-425c-b6df-35f3eddd89fa admin admin] Calling method '>' {{(pid=106032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:16.591126 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: INFO nova.api.openstack.requestlog [None req-84311274-cf8b-425c-b6df-35f3eddd89fa admin admin] 10.222.0.84 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Aug 24 11:25:16.591518 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: [pid: 106032|app: 0|req: 21/43] 10.222.0.84 () {56 vars in 1074 bytes} [Wed Aug 24 11:25:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:25:17.127224 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi [None req-9e6e0cf9-87c4-4f80-a853-b6e208445ffa admin admin] Calling method '>' {{(pid=106031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:17.132740 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: INFO nova.api.openstack.wsgi [None req-9e6e0cf9-87c4-4f80-a853-b6e208445ffa admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 24 11:25:17.134262 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi [None req-9e6e0cf9-87c4-4f80-a853-b6e208445ffa admin admin] Request method failure captured: Aug 24 11:25:17.134262 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 24 11:25:17.134262 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: Accept: application/json Aug 24 11:25:17.134262 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: Accept-Encoding: gzip, deflate Aug 24 11:25:17.134262 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: Connection: keep-alive Aug 24 11:25:17.134262 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: Content-Length: 0 Aug 24 11:25:17.134262 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: Host: 10.222.0.84 Aug 24 11:25:17.134262 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: Openstack-Api-Version: compute 2.90 Aug 24 11:25:17.134262 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: Openstack-System-Scope: None Aug 24 11:25:17.134262 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: User-Agent: python-novaclient Aug 24 11:25:17.134262 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: X-Auth-Token: gAAAAABjBgqcAzuFQLhUvODXUbgF2JdBYloahv1wcHAnAV1FzE0sdhtfUFGo_sR8b4XGxNqHtraP1-4b99SHiXHLvagC2PXsqUtTFKyIO6dNJY7k6qpNWYnNgC7R2JV31mj_Xvld0KJqPHlaY6-wu_XUCfMa1VNLan6Nq1umIsyUPrlHhczgfeA Aug 24 11:25:17.134262 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: X-Domain-Id: None Aug 24 11:25:17.134262 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: X-Domain-Name: None Aug 24 11:25:17.134262 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: X-Identity-Status: Confirmed Aug 24 11:25:17.134262 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: X-Is-Admin-Project: True Aug 24 11:25:17.134262 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 11:25:17.134262 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: X-Project-Domain-Id: default Aug 24 11:25:17.134262 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: X-Project-Domain-Name: Default Aug 24 11:25:17.134262 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: X-Project-Id: cd4c9f105cf4428d9f0cb67e8376cb7e Aug 24 11:25:17.134262 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: X-Project-Name: admin Aug 24 11:25:17.134262 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: X-Role: reader,admin,member Aug 24 11:25:17.134262 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: X-Roles: reader,admin,member Aug 24 11:25:17.135835 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/volume/v3/cd4c9f105cf4428d9f0cb67e8376cb7e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/volume/v3/cd4c9f105cf4428d9f0cb67e8376cb7e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/compute/v2/cd4c9f105cf4428d9f0cb67e8376cb7e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84:8080/v1/AUTH_cd4c9f105cf4428d9f0cb67e8376cb7e", "adminURL": "http://10.222.0.84:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/placement"}]}] Aug 24 11:25:17.135835 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: X-Tenant: admin Aug 24 11:25:17.135835 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: X-Tenant-Id: cd4c9f105cf4428d9f0cb67e8376cb7e Aug 24 11:25:17.135835 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: X-Tenant-Name: admin Aug 24 11:25:17.135835 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: X-User: admin Aug 24 11:25:17.135835 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: X-User-Domain-Id: default Aug 24 11:25:17.135835 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: X-User-Domain-Name: Default Aug 24 11:25:17.135835 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: X-User-Id: 4fac3b46e24449e193279323e9d64fe0 Aug 24 11:25:17.135835 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: X-User-Name: admin Aug 24 11:25:17.135835 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: method: > Aug 24 11:25:17.135835 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: exception: Flavor 84 could not be found. Aug 24 11:25:17.135835 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: action_args: {'id': '84'} Aug 24 11:25:17.135835 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: {{(pid=106031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:25:17.135835 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:25:17.136689 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 11:25:17.136689 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 11:25:17.136689 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 11:25:17.136689 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 11:25:17.136689 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 11:25:17.136689 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 11:25:17.136689 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 11:25:17.136689 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 11:25:17.136689 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 11:25:17.136689 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:25:17.136689 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 11:25:17.136689 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 11:25:17.136689 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 24 11:25:17.136689 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi Aug 24 11:25:17.136689 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:25:17.136689 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi Aug 24 11:25:17.136689 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:25:17.136689 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:25:17.136689 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:25:17.137802 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:25:17.137802 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:25:17.137802 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:25:17.137802 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:25:17.137802 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 11:25:17.137802 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:25:17.137802 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 24 11:25:17.137802 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi Aug 24 11:25:17.137802 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:25:17.137802 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi Aug 24 11:25:17.137802 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:25:17.137802 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:25:17.137802 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:25:17.137802 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:25:17.137802 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:25:17.137802 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 24 11:25:17.137802 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi Aug 24 11:25:17.137802 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi [None req-9e6e0cf9-87c4-4f80-a853-b6e208445ffa admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:25:17.138902 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: INFO nova.api.openstack.requestlog [None req-9e6e0cf9-87c4-4f80-a853-b6e208445ffa admin admin] 10.222.0.84 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.404146 Aug 24 11:25:17.138902 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: [pid: 106031|app: 0|req: 23/44] 10.222.0.84 () {60 vars in 1190 bytes} [Wed Aug 24 11:25:16 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 405 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 11:25:17.146372 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi [None req-2125bad0-c688-4a38-8ea8-5f1312526ce1 admin admin] Calling method '>' {{(pid=106032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:17.161881 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: INFO nova.api.openstack.requestlog [None req-2125bad0-c688-4a38-8ea8-5f1312526ce1 admin admin] 10.222.0.84 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019010 Aug 24 11:25:17.162420 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: [pid: 106032|app: 0|req: 22/45] 10.222.0.84 () {60 vars in 1210 bytes} [Wed Aug 24 11:25:17 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:25:17.171872 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi [None req-a640fba4-bd8d-460f-a35c-d770284f1142 admin admin] Calling method '>' {{(pid=106031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:17.188052 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: INFO nova.api.openstack.requestlog [None req-a640fba4-bd8d-460f-a35c-d770284f1142 admin admin] 10.222.0.84 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019727 Aug 24 11:25:17.188594 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: [pid: 106031|app: 0|req: 24/46] 10.222.0.84 () {60 vars in 1210 bytes} [Wed Aug 24 11:25:17 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:25:17.197920 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi [None req-6d1cfaff-5811-4b84-857a-f8a01a0ddb2a admin admin] Calling method '>' {{(pid=106032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:17.203932 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: INFO nova.api.openstack.wsgi [None req-6d1cfaff-5811-4b84-857a-f8a01a0ddb2a admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 24 11:25:17.217158 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi [None req-6d1cfaff-5811-4b84-857a-f8a01a0ddb2a admin admin] Request method failure captured: Aug 24 11:25:17.217158 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 24 11:25:17.217158 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: Accept: application/json Aug 24 11:25:17.217158 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: Accept-Encoding: gzip, deflate Aug 24 11:25:17.217158 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: Connection: keep-alive Aug 24 11:25:17.217158 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: Content-Length: 0 Aug 24 11:25:17.217158 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: Host: 10.222.0.84 Aug 24 11:25:17.217158 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: Openstack-Api-Version: compute 2.90 Aug 24 11:25:17.217158 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: Openstack-System-Scope: None Aug 24 11:25:17.217158 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: User-Agent: python-novaclient Aug 24 11:25:17.217158 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: X-Auth-Token: gAAAAABjBgqcAzuFQLhUvODXUbgF2JdBYloahv1wcHAnAV1FzE0sdhtfUFGo_sR8b4XGxNqHtraP1-4b99SHiXHLvagC2PXsqUtTFKyIO6dNJY7k6qpNWYnNgC7R2JV31mj_Xvld0KJqPHlaY6-wu_XUCfMa1VNLan6Nq1umIsyUPrlHhczgfeA Aug 24 11:25:17.217158 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: X-Domain-Id: None Aug 24 11:25:17.217158 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: X-Domain-Name: None Aug 24 11:25:17.217158 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: X-Identity-Status: Confirmed Aug 24 11:25:17.217158 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: X-Is-Admin-Project: True Aug 24 11:25:17.217158 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 11:25:17.217158 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: X-Project-Domain-Id: default Aug 24 11:25:17.217158 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: X-Project-Domain-Name: Default Aug 24 11:25:17.217158 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: X-Project-Id: cd4c9f105cf4428d9f0cb67e8376cb7e Aug 24 11:25:17.217158 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: X-Project-Name: admin Aug 24 11:25:17.217158 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: X-Role: reader,admin,member Aug 24 11:25:17.217158 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: X-Roles: reader,admin,member Aug 24 11:25:17.219284 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/volume/v3/cd4c9f105cf4428d9f0cb67e8376cb7e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/volume/v3/cd4c9f105cf4428d9f0cb67e8376cb7e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/compute/v2/cd4c9f105cf4428d9f0cb67e8376cb7e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84:8080/v1/AUTH_cd4c9f105cf4428d9f0cb67e8376cb7e", "adminURL": "http://10.222.0.84:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/placement"}]}] Aug 24 11:25:17.219284 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: X-Tenant: admin Aug 24 11:25:17.219284 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: X-Tenant-Id: cd4c9f105cf4428d9f0cb67e8376cb7e Aug 24 11:25:17.219284 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: X-Tenant-Name: admin Aug 24 11:25:17.219284 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: X-User: admin Aug 24 11:25:17.219284 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: X-User-Domain-Id: default Aug 24 11:25:17.219284 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: X-User-Domain-Name: Default Aug 24 11:25:17.219284 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: X-User-Id: 4fac3b46e24449e193279323e9d64fe0 Aug 24 11:25:17.219284 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: X-User-Name: admin Aug 24 11:25:17.219284 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: method: > Aug 24 11:25:17.219284 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: exception: Flavor 84 could not be found. Aug 24 11:25:17.219284 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: action_args: {'id': '84'} Aug 24 11:25:17.219284 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: {{(pid=106032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:25:17.219284 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:25:17.220035 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 11:25:17.220035 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 11:25:17.220035 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 11:25:17.220035 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 11:25:17.220035 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 11:25:17.220035 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 11:25:17.220035 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 11:25:17.220035 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 11:25:17.220035 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 11:25:17.220035 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:25:17.220035 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 11:25:17.220035 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 11:25:17.220035 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 24 11:25:17.220035 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi Aug 24 11:25:17.220035 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:25:17.220035 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi Aug 24 11:25:17.220035 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:25:17.220035 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:25:17.220035 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:25:17.221309 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:25:17.221309 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:25:17.221309 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:25:17.221309 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:25:17.221309 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 11:25:17.221309 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:25:17.221309 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 24 11:25:17.221309 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi Aug 24 11:25:17.221309 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:25:17.221309 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi Aug 24 11:25:17.221309 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:25:17.221309 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:25:17.221309 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:25:17.221309 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:25:17.221309 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:25:17.221309 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 24 11:25:17.221309 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi Aug 24 11:25:17.221309 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi [None req-6d1cfaff-5811-4b84-857a-f8a01a0ddb2a admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:25:17.222311 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: INFO nova.api.openstack.requestlog [None req-6d1cfaff-5811-4b84-857a-f8a01a0ddb2a admin admin] 10.222.0.84 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012390 Aug 24 11:25:17.222311 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: [pid: 106032|app: 0|req: 23/47] 10.222.0.84 () {60 vars in 1190 bytes} [Wed Aug 24 11:25:17 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 24 11:25:18.174439 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi [None req-a640fba4-bd8d-460f-a35c-d770284f1142 admin admin] Calling method '>' {{(pid=106031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:18.175440 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: INFO nova.api.openstack.requestlog [None req-a640fba4-bd8d-460f-a35c-d770284f1142 admin admin] 10.222.0.84 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Aug 24 11:25:18.175839 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: [pid: 106031|app: 0|req: 25/48] 10.222.0.84 () {56 vars in 1074 bytes} [Wed Aug 24 11:25:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:25:18.698753 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi [None req-cfe63dc7-9c85-4700-b0cc-e2457f703dc3 admin admin] Calling method '>' {{(pid=106032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:18.705449 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: INFO nova.api.openstack.wsgi [None req-cfe63dc7-9c85-4700-b0cc-e2457f703dc3 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 24 11:25:18.706929 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi [None req-cfe63dc7-9c85-4700-b0cc-e2457f703dc3 admin admin] Request method failure captured: Aug 24 11:25:18.706929 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 24 11:25:18.706929 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: Accept: application/json Aug 24 11:25:18.706929 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: Accept-Encoding: gzip, deflate Aug 24 11:25:18.706929 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: Connection: keep-alive Aug 24 11:25:18.706929 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: Content-Length: 0 Aug 24 11:25:18.706929 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: Host: 10.222.0.84 Aug 24 11:25:18.706929 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: Openstack-Api-Version: compute 2.90 Aug 24 11:25:18.706929 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: Openstack-System-Scope: None Aug 24 11:25:18.706929 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: User-Agent: python-novaclient Aug 24 11:25:18.706929 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: X-Auth-Token: gAAAAABjBgqesBc0kN-E07PetzVLrD04Ga3lbiVycWKOIXOpcVAFFWgqcnhxhsZT33gpqjvvUrP_PWOoaKQY8LTquWKqIS68Qw0zIcvqjoQ25eBC1CyUdKZpVB50Lwh0yyw1ThG87WGVAGxgTPU44HSEij7e5rSQ8kvNd9ec3Co8Dxl9GE7pC6M Aug 24 11:25:18.706929 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: X-Domain-Id: None Aug 24 11:25:18.706929 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: X-Domain-Name: None Aug 24 11:25:18.706929 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: X-Identity-Status: Confirmed Aug 24 11:25:18.706929 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: X-Is-Admin-Project: True Aug 24 11:25:18.706929 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 11:25:18.706929 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: X-Project-Domain-Id: default Aug 24 11:25:18.706929 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: X-Project-Domain-Name: Default Aug 24 11:25:18.706929 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: X-Project-Id: cd4c9f105cf4428d9f0cb67e8376cb7e Aug 24 11:25:18.706929 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: X-Project-Name: admin Aug 24 11:25:18.706929 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: X-Role: reader,admin,member Aug 24 11:25:18.706929 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: X-Roles: reader,admin,member Aug 24 11:25:18.708382 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/volume/v3/cd4c9f105cf4428d9f0cb67e8376cb7e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/volume/v3/cd4c9f105cf4428d9f0cb67e8376cb7e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/compute/v2/cd4c9f105cf4428d9f0cb67e8376cb7e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84:8080/v1/AUTH_cd4c9f105cf4428d9f0cb67e8376cb7e", "adminURL": "http://10.222.0.84:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/placement"}]}] Aug 24 11:25:18.708382 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: X-Tenant: admin Aug 24 11:25:18.708382 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: X-Tenant-Id: cd4c9f105cf4428d9f0cb67e8376cb7e Aug 24 11:25:18.708382 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: X-Tenant-Name: admin Aug 24 11:25:18.708382 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: X-User: admin Aug 24 11:25:18.708382 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: X-User-Domain-Id: default Aug 24 11:25:18.708382 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: X-User-Domain-Name: Default Aug 24 11:25:18.708382 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: X-User-Id: 4fac3b46e24449e193279323e9d64fe0 Aug 24 11:25:18.708382 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: X-User-Name: admin Aug 24 11:25:18.708382 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: method: > Aug 24 11:25:18.708382 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: exception: Flavor 451 could not be found. Aug 24 11:25:18.708382 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: action_args: {'id': '451'} Aug 24 11:25:18.708382 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: {{(pid=106032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:25:18.708382 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:25:18.712818 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 11:25:18.712818 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 11:25:18.712818 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 11:25:18.712818 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 11:25:18.712818 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 11:25:18.712818 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 11:25:18.712818 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 11:25:18.712818 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 11:25:18.712818 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 11:25:18.712818 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:25:18.712818 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 11:25:18.712818 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 11:25:18.712818 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 24 11:25:18.712818 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi Aug 24 11:25:18.712818 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:25:18.712818 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi Aug 24 11:25:18.712818 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:25:18.712818 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:25:18.712818 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:25:18.714250 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:25:18.714250 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:25:18.714250 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:25:18.714250 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:25:18.714250 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 11:25:18.714250 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:25:18.714250 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 24 11:25:18.714250 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi Aug 24 11:25:18.714250 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:25:18.714250 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi Aug 24 11:25:18.714250 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:25:18.714250 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:25:18.714250 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:25:18.714250 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:25:18.714250 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:25:18.714250 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 24 11:25:18.714250 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi Aug 24 11:25:18.714250 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi [None req-cfe63dc7-9c85-4700-b0cc-e2457f703dc3 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:25:18.715454 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: INFO nova.api.openstack.requestlog [None req-cfe63dc7-9c85-4700-b0cc-e2457f703dc3 admin admin] 10.222.0.84 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.395420 Aug 24 11:25:18.715454 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: [pid: 106032|app: 0|req: 24/49] 10.222.0.84 () {60 vars in 1193 bytes} [Wed Aug 24 11:25:18 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 397 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 11:25:18.717891 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi [None req-759da109-ecf3-4f28-86b7-afe5b656b28e admin admin] Calling method '>' {{(pid=106031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:18.732716 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: INFO nova.api.openstack.requestlog [None req-759da109-ecf3-4f28-86b7-afe5b656b28e admin admin] 10.222.0.84 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018303 Aug 24 11:25:18.733267 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: [pid: 106031|app: 0|req: 26/50] 10.222.0.84 () {60 vars in 1210 bytes} [Wed Aug 24 11:25:18 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:25:18.742817 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi [None req-1675b78b-c1b6-44ea-8267-68a2502c6a09 admin admin] Calling method '>' {{(pid=106032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:18.757954 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: INFO nova.api.openstack.requestlog [None req-1675b78b-c1b6-44ea-8267-68a2502c6a09 admin admin] 10.222.0.84 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018599 Aug 24 11:25:18.758469 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: [pid: 106032|app: 0|req: 25/51] 10.222.0.84 () {60 vars in 1210 bytes} [Wed Aug 24 11:25:18 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:25:18.768324 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi [None req-9f06341f-7362-4ca8-9ec5-6ba6a132d252 admin admin] Calling method '>' {{(pid=106031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:18.773778 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: INFO nova.api.openstack.wsgi [None req-9f06341f-7362-4ca8-9ec5-6ba6a132d252 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 24 11:25:18.775253 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi [None req-9f06341f-7362-4ca8-9ec5-6ba6a132d252 admin admin] Request method failure captured: Aug 24 11:25:18.775253 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 24 11:25:18.775253 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: Accept: application/json Aug 24 11:25:18.775253 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: Accept-Encoding: gzip, deflate Aug 24 11:25:18.775253 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: Connection: keep-alive Aug 24 11:25:18.775253 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: Content-Length: 0 Aug 24 11:25:18.775253 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: Host: 10.222.0.84 Aug 24 11:25:18.775253 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: Openstack-Api-Version: compute 2.90 Aug 24 11:25:18.775253 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: Openstack-System-Scope: None Aug 24 11:25:18.775253 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: User-Agent: python-novaclient Aug 24 11:25:18.775253 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: X-Auth-Token: gAAAAABjBgqesBc0kN-E07PetzVLrD04Ga3lbiVycWKOIXOpcVAFFWgqcnhxhsZT33gpqjvvUrP_PWOoaKQY8LTquWKqIS68Qw0zIcvqjoQ25eBC1CyUdKZpVB50Lwh0yyw1ThG87WGVAGxgTPU44HSEij7e5rSQ8kvNd9ec3Co8Dxl9GE7pC6M Aug 24 11:25:18.775253 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: X-Domain-Id: None Aug 24 11:25:18.775253 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: X-Domain-Name: None Aug 24 11:25:18.775253 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: X-Identity-Status: Confirmed Aug 24 11:25:18.775253 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: X-Is-Admin-Project: True Aug 24 11:25:18.775253 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 11:25:18.775253 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: X-Project-Domain-Id: default Aug 24 11:25:18.775253 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: X-Project-Domain-Name: Default Aug 24 11:25:18.775253 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: X-Project-Id: cd4c9f105cf4428d9f0cb67e8376cb7e Aug 24 11:25:18.775253 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: X-Project-Name: admin Aug 24 11:25:18.775253 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: X-Role: reader,admin,member Aug 24 11:25:18.775253 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: X-Roles: reader,admin,member Aug 24 11:25:18.776775 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/volume/v3/cd4c9f105cf4428d9f0cb67e8376cb7e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/volume/v3/cd4c9f105cf4428d9f0cb67e8376cb7e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/compute/v2/cd4c9f105cf4428d9f0cb67e8376cb7e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84:8080/v1/AUTH_cd4c9f105cf4428d9f0cb67e8376cb7e", "adminURL": "http://10.222.0.84:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/placement"}]}] Aug 24 11:25:18.776775 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: X-Tenant: admin Aug 24 11:25:18.776775 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: X-Tenant-Id: cd4c9f105cf4428d9f0cb67e8376cb7e Aug 24 11:25:18.776775 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: X-Tenant-Name: admin Aug 24 11:25:18.776775 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: X-User: admin Aug 24 11:25:18.776775 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: X-User-Domain-Id: default Aug 24 11:25:18.776775 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: X-User-Domain-Name: Default Aug 24 11:25:18.776775 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: X-User-Id: 4fac3b46e24449e193279323e9d64fe0 Aug 24 11:25:18.776775 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: X-User-Name: admin Aug 24 11:25:18.776775 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: method: > Aug 24 11:25:18.776775 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: exception: Flavor 451 could not be found. Aug 24 11:25:18.776775 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: action_args: {'id': '451'} Aug 24 11:25:18.776775 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: {{(pid=106031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:25:18.776775 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:25:18.777750 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 11:25:18.777750 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 11:25:18.777750 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 11:25:18.777750 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 11:25:18.777750 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 11:25:18.777750 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 11:25:18.777750 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 11:25:18.777750 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 11:25:18.777750 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 11:25:18.777750 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:25:18.777750 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 11:25:18.777750 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 11:25:18.777750 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 24 11:25:18.777750 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi Aug 24 11:25:18.777750 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:25:18.777750 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi Aug 24 11:25:18.777750 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:25:18.777750 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:25:18.777750 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:25:18.779027 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:25:18.779027 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:25:18.779027 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:25:18.779027 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:25:18.779027 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 11:25:18.779027 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:25:18.779027 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 24 11:25:18.779027 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi Aug 24 11:25:18.779027 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:25:18.779027 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi Aug 24 11:25:18.779027 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:25:18.779027 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:25:18.779027 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:25:18.779027 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:25:18.779027 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:25:18.779027 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 24 11:25:18.779027 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi Aug 24 11:25:18.779027 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi [None req-9f06341f-7362-4ca8-9ec5-6ba6a132d252 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:25:18.780209 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: INFO nova.api.openstack.requestlog [None req-9f06341f-7362-4ca8-9ec5-6ba6a132d252 admin admin] 10.222.0.84 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012686 Aug 24 11:25:18.780209 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: [pid: 106031|app: 0|req: 27/52] 10.222.0.84 () {60 vars in 1193 bytes} [Wed Aug 24 11:25:18 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 11:25:19.746534 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi [None req-1675b78b-c1b6-44ea-8267-68a2502c6a09 admin admin] Calling method '>' {{(pid=106032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:19.747539 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: INFO nova.api.openstack.requestlog [None req-1675b78b-c1b6-44ea-8267-68a2502c6a09 admin admin] 10.222.0.84 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Aug 24 11:25:19.747933 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: [pid: 106032|app: 0|req: 26/53] 10.222.0.84 () {56 vars in 1074 bytes} [Wed Aug 24 11:25:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:25:20.280829 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi [None req-3af29d56-5dae-4cf5-8c60-d768c5fb6e64 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:25:20.369532 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: INFO nova.api.openstack.requestlog [None req-3af29d56-5dae-4cf5-8c60-d768c5fb6e64 admin admin] 10.222.0.84 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.480562 Aug 24 11:25:20.370084 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: [pid: 106031|app: 0|req: 28/54] 10.222.0.84 () {64 vars in 1235 bytes} [Wed Aug 24 11:25:19 2022] POST /compute/v2.1/flavors => generated 404 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 11:25:21.401002 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi [None req-1675b78b-c1b6-44ea-8267-68a2502c6a09 admin admin] Calling method '>' {{(pid=106032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:21.402016 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: INFO nova.api.openstack.requestlog [None req-1675b78b-c1b6-44ea-8267-68a2502c6a09 admin admin] 10.222.0.84 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Aug 24 11:25:21.402417 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: [pid: 106032|app: 0|req: 27/55] 10.222.0.84 () {56 vars in 1074 bytes} [Wed Aug 24 11:25:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:25:21.928302 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi [None req-1d75afdb-9c07-4006-9fdc-3aad09c1e703 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:25:22.009247 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: INFO nova.api.openstack.requestlog [None req-1d75afdb-9c07-4006-9fdc-3aad09c1e703 admin admin] 10.222.0.84 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.464143 Aug 24 11:25:22.009803 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: [pid: 106031|app: 0|req: 29/56] 10.222.0.84 () {64 vars in 1235 bytes} [Wed Aug 24 11:25:21 2022] POST /compute/v2.1/flavors => generated 405 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 11:25:22.989730 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi [None req-1675b78b-c1b6-44ea-8267-68a2502c6a09 admin admin] Calling method '>' {{(pid=106032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:22.990761 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: INFO nova.api.openstack.requestlog [None req-1675b78b-c1b6-44ea-8267-68a2502c6a09 admin admin] 10.222.0.84 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Aug 24 11:25:22.991181 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: [pid: 106032|app: 0|req: 28/57] 10.222.0.84 () {56 vars in 1074 bytes} [Wed Aug 24 11:25:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:25:23.536822 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi [None req-f106f87b-3329-4dd3-ab22-8e45cf482eae admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:25:23.634623 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: INFO nova.api.openstack.requestlog [None req-f106f87b-3329-4dd3-ab22-8e45cf482eae admin admin] 10.222.0.84 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.503122 Aug 24 11:25:23.635167 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: [pid: 106031|app: 0|req: 30/58] 10.222.0.84 () {64 vars in 1235 bytes} [Wed Aug 24 11:25:23 2022] POST /compute/v2.1/flavors => generated 407 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 11:25:24.642341 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi [None req-1675b78b-c1b6-44ea-8267-68a2502c6a09 admin admin] Calling method '>' {{(pid=106032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:24.643383 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: INFO nova.api.openstack.requestlog [None req-1675b78b-c1b6-44ea-8267-68a2502c6a09 admin admin] 10.222.0.84 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Aug 24 11:25:24.643784 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: [pid: 106032|app: 0|req: 29/59] 10.222.0.84 () {56 vars in 1074 bytes} [Wed Aug 24 11:25:24 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:25:25.172716 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi [None req-3a304b42-2b16-48c0-ae44-ec8c1cd7976d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:25:25.275571 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: INFO nova.api.openstack.requestlog [None req-3a304b42-2b16-48c0-ae44-ec8c1cd7976d admin admin] 10.222.0.84 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.493549 Aug 24 11:25:25.276047 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: [pid: 106031|app: 0|req: 31/60] 10.222.0.84 () {64 vars in 1235 bytes} [Wed Aug 24 11:25:24 2022] POST /compute/v2.1/flavors => generated 409 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 11:25:26.242687 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi [None req-1675b78b-c1b6-44ea-8267-68a2502c6a09 admin admin] Calling method '>' {{(pid=106032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:26.243696 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: INFO nova.api.openstack.requestlog [None req-1675b78b-c1b6-44ea-8267-68a2502c6a09 admin admin] 10.222.0.84 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Aug 24 11:25:26.244092 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: [pid: 106032|app: 0|req: 30/61] 10.222.0.84 () {56 vars in 1074 bytes} [Wed Aug 24 11:25:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:25:26.777175 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi [None req-feab5e46-913a-4439-b4f2-1f93e6f87251 admin admin] Calling method '>' {{(pid=106031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:26.799051 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: INFO nova.api.openstack.requestlog [None req-feab5e46-913a-4439-b4f2-1f93e6f87251 admin admin] 10.222.0.84 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.418025 Aug 24 11:25:26.799581 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: [pid: 106031|app: 0|req: 32/62] 10.222.0.84 () {60 vars in 1202 bytes} [Wed Aug 24 11:25:26 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:26:20.874416 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi [None req-1675b78b-c1b6-44ea-8267-68a2502c6a09 admin admin] Calling method '>' {{(pid=106032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:26:20.875433 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: INFO nova.api.openstack.requestlog [None req-1675b78b-c1b6-44ea-8267-68a2502c6a09 admin admin] 10.222.0.84 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Aug 24 11:26:20.875843 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: [pid: 106032|app: 0|req: 31/63] 10.222.0.84 () {54 vars in 931 bytes} [Wed Aug 24 11:26:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:26:20.886258 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG dbcounter [-] [106031] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=106031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:26:21.265567 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi [None req-b0ba158b-2552-4ddb-ab19-11845a2d8e1d admin admin] Calling method '>' {{(pid=106031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:26:21.285590 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: INFO nova.api.openstack.requestlog [None req-b0ba158b-2552-4ddb-ab19-11845a2d8e1d admin admin] 10.222.0.84 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.403718 Aug 24 11:26:21.286058 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: [pid: 106031|app: 0|req: 33/64] 10.222.0.84 () {60 vars in 1292 bytes} [Wed Aug 24 11:26:20 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:26:21.308387 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG dbcounter [-] [106032] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=22,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=106032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:26:21.312958 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi [None req-0edbd201-8803-403b-b440-8ef2e917d092 admin admin] Calling method '>' {{(pid=106032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:26:21.320723 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: INFO nova.api.openstack.requestlog [None req-0edbd201-8803-403b-b440-8ef2e917d092 admin admin] 10.222.0.84 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013787 Aug 24 11:26:21.321434 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: [pid: 106032|app: 0|req: 32/65] 10.222.0.84 () {60 vars in 1283 bytes} [Wed Aug 24 11:26:21 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:26:21.333175 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi [None req-577cbcba-4526-4914-931f-ea8ea277c433 admin admin] Calling method '>' {{(pid=106031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:26:21.340970 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: INFO nova.api.openstack.requestlog [None req-577cbcba-4526-4914-931f-ea8ea277c433 admin admin] 10.222.0.84 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011334 Aug 24 11:26:21.341484 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: [pid: 106031|app: 0|req: 34/66] 10.222.0.84 () {60 vars in 1286 bytes} [Wed Aug 24 11:26:21 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:26:21.352682 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi [None req-65a112b0-41d4-4f4c-b475-54d5c8c7dad9 admin admin] Calling method '>' {{(pid=106032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:26:21.361135 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: INFO nova.api.openstack.requestlog [None req-65a112b0-41d4-4f4c-b475-54d5c8c7dad9 admin admin] 10.222.0.84 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011980 Aug 24 11:26:21.361647 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: [pid: 106032|app: 0|req: 33/67] 10.222.0.84 () {60 vars in 1286 bytes} [Wed Aug 24 11:26:21 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:26:21.373907 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi [None req-2c70321a-b735-43e4-90fb-92aefa95ff55 admin admin] Calling method '>' {{(pid=106031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:26:21.381908 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: INFO nova.api.openstack.requestlog [None req-2c70321a-b735-43e4-90fb-92aefa95ff55 admin admin] 10.222.0.84 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011997 Aug 24 11:26:21.382443 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: [pid: 106031|app: 0|req: 35/68] 10.222.0.84 () {60 vars in 1283 bytes} [Wed Aug 24 11:26:21 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:27.855153 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi [None req-65a112b0-41d4-4f4c-b475-54d5c8c7dad9 admin admin] Calling method '>' {{(pid=106032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:27.856370 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: INFO nova.api.openstack.requestlog [None req-65a112b0-41d4-4f4c-b475-54d5c8c7dad9 admin admin] 10.222.0.84 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001702 Aug 24 11:29:27.856772 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: [pid: 106032|app: 0|req: 34/69] 10.222.0.84 () {56 vars in 1074 bytes} [Wed Aug 24 11:29:27 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:29:28.006906 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG dbcounter [-] [106031] Writing DB stats nova_api:SELECT=6 {{(pid=106031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:29:28.229690 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi [None req-4ea42e88-c5bf-41c6-a60d-f49c0f3dcc25 admin admin] Calling method '>' {{(pid=106031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:28.233458 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 11:29:28.233458 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: warnings.warn(msg) Aug 24 11:29:28.235477 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG oslo_concurrency.lockutils [None req-4ea42e88-c5bf-41c6-a60d-f49c0f3dcc25 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:28.236265 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG oslo_concurrency.lockutils [None req-4ea42e88-c5bf-41c6-a60d-f49c0f3dcc25 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:28.237046 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG oslo_concurrency.lockutils [None req-4ea42e88-c5bf-41c6-a60d-f49c0f3dcc25 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:28.238252 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG oslo_concurrency.lockutils [None req-4ea42e88-c5bf-41c6-a60d-f49c0f3dcc25 admin admin] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:28.238984 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG oslo_concurrency.lockutils [None req-4ea42e88-c5bf-41c6-a60d-f49c0f3dcc25 admin admin] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:28.239676 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG oslo_concurrency.lockutils [None req-4ea42e88-c5bf-41c6-a60d-f49c0f3dcc25 admin admin] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:28.297334 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: INFO nova.api.openstack.requestlog [None req-4ea42e88-c5bf-41c6-a60d-f49c0f3dcc25 admin admin] 10.222.0.84 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.291649 Aug 24 11:29:28.298272 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: [pid: 106031|app: 0|req: 36/70] 10.222.0.84 () {60 vars in 1193 bytes} [Wed Aug 24 11:29:28 2022] GET /compute/v2.1/os-services => generated 791 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 11:29:29.210067 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi [None req-65a112b0-41d4-4f4c-b475-54d5c8c7dad9 admin admin] Calling method '>' {{(pid=106032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:29.211069 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: INFO nova.api.openstack.requestlog [None req-65a112b0-41d4-4f4c-b475-54d5c8c7dad9 admin admin] 10.222.0.84 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 Aug 24 11:29:29.211469 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: [pid: 106032|app: 0|req: 35/71] 10.222.0.84 () {56 vars in 1074 bytes} [Wed Aug 24 11:29:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:29:29.413146 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi [None req-a58ab6f7-559c-4ec5-aab2-c960029c4363 admin admin] Calling method '>' {{(pid=106031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:29.415661 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 11:29:29.415661 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: warnings.warn(msg) Aug 24 11:29:29.416879 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG oslo_concurrency.lockutils [None req-a58ab6f7-559c-4ec5-aab2-c960029c4363 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:29.417356 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG oslo_concurrency.lockutils [None req-a58ab6f7-559c-4ec5-aab2-c960029c4363 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:29.417837 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG oslo_concurrency.lockutils [None req-a58ab6f7-559c-4ec5-aab2-c960029c4363 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:29.418567 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG oslo_concurrency.lockutils [None req-a58ab6f7-559c-4ec5-aab2-c960029c4363 admin admin] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:29.419064 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG oslo_concurrency.lockutils [None req-a58ab6f7-559c-4ec5-aab2-c960029c4363 admin admin] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:29.419478 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG oslo_concurrency.lockutils [None req-a58ab6f7-559c-4ec5-aab2-c960029c4363 admin admin] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:29.441036 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: INFO nova.api.openstack.requestlog [None req-a58ab6f7-559c-4ec5-aab2-c960029c4363 admin admin] 10.222.0.84 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.088818 Aug 24 11:29:29.441623 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: [pid: 106031|app: 0|req: 37/72] 10.222.0.84 () {60 vars in 1193 bytes} [Wed Aug 24 11:29:29 2022] GET /compute/v2.1/os-services => generated 791 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 11:29:40.718956 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi [None req-65a112b0-41d4-4f4c-b475-54d5c8c7dad9 admin admin] Calling method '>' {{(pid=106032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:40.719980 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: INFO nova.api.openstack.requestlog [None req-65a112b0-41d4-4f4c-b475-54d5c8c7dad9 admin admin] 10.222.0.84 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Aug 24 11:29:40.720349 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: [pid: 106032|app: 0|req: 36/73] 10.222.0.84 () {56 vars in 1074 bytes} [Wed Aug 24 11:29:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:29:40.871269 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG dbcounter [-] [106031] Writing DB stats nova_cell0:SELECT=4 {{(pid=106031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:29:40.871644 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG dbcounter [-] [106031] Writing DB stats nova_cell1:SELECT=4 {{(pid=106031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:29:40.872088 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG dbcounter [-] [106031] Writing DB stats nova_api:SELECT=8 {{(pid=106031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:29:40.920298 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi [None req-d5b4f658-e612-42dc-a8af-07dab864c005 admin admin] Calling method '>' {{(pid=106031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:40.922963 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 11:29:40.922963 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: warnings.warn(msg) Aug 24 11:29:40.924075 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG oslo_concurrency.lockutils [None req-d5b4f658-e612-42dc-a8af-07dab864c005 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:40.924547 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG oslo_concurrency.lockutils [None req-d5b4f658-e612-42dc-a8af-07dab864c005 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:40.925710 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG oslo_concurrency.lockutils [None req-d5b4f658-e612-42dc-a8af-07dab864c005 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:40.926548 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG oslo_concurrency.lockutils [None req-d5b4f658-e612-42dc-a8af-07dab864c005 admin admin] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:40.926992 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG oslo_concurrency.lockutils [None req-d5b4f658-e612-42dc-a8af-07dab864c005 admin admin] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:40.927436 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG oslo_concurrency.lockutils [None req-d5b4f658-e612-42dc-a8af-07dab864c005 admin admin] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:40.952275 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: INFO nova.api.openstack.requestlog [None req-d5b4f658-e612-42dc-a8af-07dab864c005 admin admin] 10.222.0.84 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.086285 Aug 24 11:29:40.952863 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: [pid: 106031|app: 0|req: 38/74] 10.222.0.84 () {60 vars in 1193 bytes} [Wed Aug 24 11:29:40 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:29:41.781912 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi [None req-65a112b0-41d4-4f4c-b475-54d5c8c7dad9 admin admin] Calling method '>' {{(pid=106032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:41.782904 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: INFO nova.api.openstack.requestlog [None req-65a112b0-41d4-4f4c-b475-54d5c8c7dad9 admin admin] 10.222.0.84 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001421 Aug 24 11:29:41.783300 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: [pid: 106032|app: 0|req: 37/75] 10.222.0.84 () {56 vars in 1074 bytes} [Wed Aug 24 11:29:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:29:41.979439 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi [None req-001693df-b318-496c-a95b-dcf514a1473e admin admin] Calling method '>' {{(pid=106031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:41.981813 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 11:29:41.981813 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: warnings.warn(msg) Aug 24 11:29:41.982953 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG oslo_concurrency.lockutils [None req-001693df-b318-496c-a95b-dcf514a1473e admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:41.983416 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG oslo_concurrency.lockutils [None req-001693df-b318-496c-a95b-dcf514a1473e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:41.983834 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG oslo_concurrency.lockutils [None req-001693df-b318-496c-a95b-dcf514a1473e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:41.984550 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG oslo_concurrency.lockutils [None req-001693df-b318-496c-a95b-dcf514a1473e admin admin] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:41.985210 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG oslo_concurrency.lockutils [None req-001693df-b318-496c-a95b-dcf514a1473e admin admin] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:41.985426 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: DEBUG oslo_concurrency.lockutils [None req-001693df-b318-496c-a95b-dcf514a1473e admin admin] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:42.008707 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: INFO nova.api.openstack.requestlog [None req-001693df-b318-496c-a95b-dcf514a1473e admin admin] 10.222.0.84 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.083789 Aug 24 11:29:42.009286 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: [pid: 106031|app: 0|req: 39/76] 10.222.0.84 () {60 vars in 1193 bytes} [Wed Aug 24 11:29:41 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:30:41.567688 dv-cinder-854274-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 24 11:30:41.568845 dv-cinder-854274-2-iscsi devstack@n-api.service[106030]: Wed Aug 24 11:30:41 2022 - graceful shutdown triggered... Aug 24 11:30:41.569284 dv-cinder-854274-2-iscsi devstack@n-api.service[106031]: Gracefully killing worker 1 (pid: 106031)... Aug 24 11:30:41.569645 dv-cinder-854274-2-iscsi devstack@n-api.service[106032]: Gracefully killing worker 2 (pid: 106032)... Aug 24 11:30:42.568947 dv-cinder-854274-2-iscsi devstack@n-api.service[106030]: worker 1 buried after 1 seconds Aug 24 11:30:42.569561 dv-cinder-854274-2-iscsi devstack@n-api.service[106030]: worker 2 buried after 1 seconds Aug 24 11:30:42.569561 dv-cinder-854274-2-iscsi devstack@n-api.service[106030]: goodbye to uWSGI. Aug 24 11:30:42.570466 dv-cinder-854274-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 24 11:30:42.571009 dv-cinder-854274-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 24 11:30:42.573706 dv-cinder-854274-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 24 11:30:42.585067 dv-cinder-854274-2-iscsi devstack@n-api.service[124731]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 24 11:30:42.588404 dv-cinder-854274-2-iscsi devstack@n-api.service[124731]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 24 11:30:42 2022] *** Aug 24 11:30:42.588404 dv-cinder-854274-2-iscsi devstack@n-api.service[124731]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 24 11:30:42.588404 dv-cinder-854274-2-iscsi devstack@n-api.service[124731]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 24 11:30:42.588404 dv-cinder-854274-2-iscsi devstack@n-api.service[124731]: nodename: dv-cinder-854274-2-iscsi Aug 24 11:30:42.588404 dv-cinder-854274-2-iscsi devstack@n-api.service[124731]: machine: x86_64 Aug 24 11:30:42.588404 dv-cinder-854274-2-iscsi devstack@n-api.service[124731]: clock source: unix Aug 24 11:30:42.588404 dv-cinder-854274-2-iscsi devstack@n-api.service[124731]: pcre jit disabled Aug 24 11:30:42.588404 dv-cinder-854274-2-iscsi devstack@n-api.service[124731]: detected number of CPU cores: 4 Aug 24 11:30:42.588404 dv-cinder-854274-2-iscsi devstack@n-api.service[124731]: current working directory: / Aug 24 11:30:42.589137 dv-cinder-854274-2-iscsi devstack@n-api.service[124731]: detected binary path: /usr/bin/uwsgi-core Aug 24 11:30:42.589137 dv-cinder-854274-2-iscsi devstack@n-api.service[124731]: your processes number limit is 47680 Aug 24 11:30:42.589137 dv-cinder-854274-2-iscsi devstack@n-api.service[124731]: your memory page size is 4096 bytes Aug 24 11:30:42.589137 dv-cinder-854274-2-iscsi devstack@n-api.service[124731]: detected max file descriptor number: 2048 Aug 24 11:30:42.589137 dv-cinder-854274-2-iscsi devstack@n-api.service[124731]: lock engine: pthread robust mutexes Aug 24 11:30:42.589137 dv-cinder-854274-2-iscsi devstack@n-api.service[124731]: thunder lock: enabled Aug 24 11:30:42.589137 dv-cinder-854274-2-iscsi devstack@n-api.service[124731]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 24 11:30:42.589137 dv-cinder-854274-2-iscsi devstack@n-api.service[124731]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 24 11:30:42.633362 dv-cinder-854274-2-iscsi devstack@n-api.service[124731]: Python main interpreter initialized at 0x55fa0aca99c0 Aug 24 11:30:42.633362 dv-cinder-854274-2-iscsi devstack@n-api.service[124731]: python threads support enabled Aug 24 11:30:42.633362 dv-cinder-854274-2-iscsi devstack@n-api.service[124731]: your server socket listen backlog is limited to 100 connections Aug 24 11:30:42.633362 dv-cinder-854274-2-iscsi devstack@n-api.service[124731]: your mercy for graceful operations on workers is 90 seconds Aug 24 11:30:42.633788 dv-cinder-854274-2-iscsi devstack@n-api.service[124731]: mapped 403077 bytes (393 KB) for 2 cores Aug 24 11:30:42.633788 dv-cinder-854274-2-iscsi devstack@n-api.service[124731]: *** Operational MODE: preforking *** Aug 24 11:30:42.634025 dv-cinder-854274-2-iscsi devstack@n-api.service[124731]: *** uWSGI is running in multiple interpreter mode *** Aug 24 11:30:42.634025 dv-cinder-854274-2-iscsi devstack@n-api.service[124731]: spawned uWSGI master process (pid: 124731) Aug 24 11:30:42.634224 dv-cinder-854274-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 24 11:30:42.636883 dv-cinder-854274-2-iscsi devstack@n-api.service[124731]: spawned uWSGI worker 1 (pid: 124769, cores: 1) Aug 24 11:30:42.637967 dv-cinder-854274-2-iscsi devstack@n-api.service[124731]: spawned uWSGI worker 2 (pid: 124770, cores: 1) Aug 24 11:30:42.637967 dv-cinder-854274-2-iscsi devstack@n-api.service[124731]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 24 11:30:43.330448 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 11:30:43.337630 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 11:30:44.520658 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 11:30:44.520658 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: from cryptography.utils import int_from_bytes Aug 24 11:30:44.521777 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 11:30:44.521777 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: from cryptography.utils import int_from_bytes Aug 24 11:30:44.572111 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 11:30:44.572111 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: from cryptography.utils import int_from_bytes Aug 24 11:30:44.573079 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 11:30:44.573079 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: from cryptography.utils import int_from_bytes Aug 24 11:30:47.111654 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 11:30:47.112224 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 11:30:47.112560 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 11:30:47.116073 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 11:30:47.116073 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 11:30:47.116073 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.116073 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.116073 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.116073 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.116073 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.116073 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.116682 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.116682 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.116682 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.116682 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.117002 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.117559 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854274-2-iscsi {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.117742 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.118058 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.118382 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.118698 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.119007 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.119338 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.119650 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.120161 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.121681 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.122010 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.122335 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.122686 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.123012 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.123330 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.123660 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.123977 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.124313 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.124628 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.125131 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854274-2-iscsi {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.125458 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.125781 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.126096 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.126521 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.126839 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.127153 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.127702 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.128212 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.128389 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.132818 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.132818 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.132818 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.132818 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.132818 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.132818 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.132818 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.132818 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.134019 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.134019 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.134306 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 11:30:47.134773 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.134931 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 11:30:47.135088 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.135237 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 11:30:47.135389 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.135531 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 11:30:47.135682 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.135843 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 11:30:47.135994 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.136151 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.136293 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.136293 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.136585 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.136735 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.136912 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.137062 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.137208 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.137363 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.137512 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.137670 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.137820 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.137969 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.138120 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.138271 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.138489 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.138641 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.138783 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.139416 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.139577 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.139731 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.139881 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.140036 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.140186 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854274-2-iscsi {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.140330 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.140480 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.140636 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.140779 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.140946 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.141102 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.141252 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.141404 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.141553 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.141703 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.141845 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.84 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.142003 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.142156 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.84 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.142312 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.142456 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.142645 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.142818 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.142818 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.142818 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.142818 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.142818 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.142818 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.155213 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.155394 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.155566 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.155725 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.155881 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.156029 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.156222 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.156374 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.156532 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.156684 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.156848 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.156996 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.157151 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.157311 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.157311 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.157311 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.157311 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.157939 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.158094 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.158237 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.158388 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.158540 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.158691 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.158691 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.158988 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854274-2-iscsi {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.159246 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.159978 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.160991 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.161111 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.161199 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.161289 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.161364 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.161447 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.161532 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.161532 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.161658 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.161740 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.161819 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.161889 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.161968 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.162045 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.162121 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.162121 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.162121 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.162121 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.162121 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.162121 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.162121 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.162121 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.162643 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.162643 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.162777 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.162847 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.162927 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.163004 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.163074 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.163155 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.163226 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.163294 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.163370 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.163456 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.163524 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.163524 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.163524 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.163711 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.163779 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.163856 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.163933 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.164013 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.164083 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.164153 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.164231 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.164313 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.164394 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.164466 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.164542 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.164612 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.164686 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.164765 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.165295 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.165431 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.165557 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.165676 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.165786 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.165786 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.166018 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.166128 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.166237 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.166356 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.166478 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.166597 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.166717 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.166828 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.166958 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.167078 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.167078 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.167078 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.167078 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.84 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.167078 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.84 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.167078 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.167078 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.167078 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.168099 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.168099 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.168099 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.168099 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.168099 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.168099 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.168099 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.168099 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.169255 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.169255 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.169255 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.169255 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.169255 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.169255 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.169255 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.169255 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.170386 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.170386 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.170386 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.170386 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.170386 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.170386 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.170386 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.171349 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.171349 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.171349 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.171802 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.171802 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.172825 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.172825 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.173164 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.176828 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.177042 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.177042 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.177357 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.177512 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.177677 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.177842 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.178009 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.178165 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.178312 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.178464 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.178610 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.178768 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.178914 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.179067 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.179215 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.179366 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.179518 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.179677 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.179840 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.179986 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.180131 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.180275 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.180275 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.180275 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.180275 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.180275 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.180275 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.180275 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.181330 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.181330 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.181330 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.181768 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.181913 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.182141 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.182477 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.182792 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.182903 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.183111 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.183427 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.183757 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:30:47.184059 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.184160 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.184435 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.184789 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.185185 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.185457 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.185808 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.186141 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.186252 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.186476 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.186801 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.187129 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.187399 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.187501 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.187779 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.188100 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.188423 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.188727 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.188951 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.189430 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.189693 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.189807 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.190092 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.190475 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.190778 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.190880 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.191121 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.191448 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.191787 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.192041 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.192151 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.192426 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.192779 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.193146 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.193472 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.193803 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.194092 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.194192 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.194464 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.194786 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.195107 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.195343 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.195449 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.195742 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.196079 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.196373 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.196483 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.196709 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.197260 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.197600 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.197929 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.198203 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.198317 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.198562 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.198884 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.199232 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.199478 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.199586 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.199866 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.200186 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.200512 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.200698 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.200883 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.201158 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.201478 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.201793 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.202019 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.202552 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.203088 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.203628 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.203747 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.204024 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.204362 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.204689 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.204884 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.205042 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.205393 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.205715 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.205980 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.206761 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.207130 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.207464 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.207781 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.207890 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.208110 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.208432 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.208757 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.209081 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.209197 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.209841 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.209957 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.210218 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.210552 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.210871 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.211098 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.211206 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.211512 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.211827 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.212137 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.212261 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.212459 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.212782 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.213246 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.213777 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.214300 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.214667 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.215057 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.215751 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.216299 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.216857 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.217403 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.217946 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.218479 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.219012 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.219534 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.220055 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.220625 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.221228 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.221520 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.221659 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.222714 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.222828 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.223165 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.223530 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.223753 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.223923 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.224213 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.224561 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.224889 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.225005 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.225258 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.225580 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.225905 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.226137 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.226255 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.226530 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.226845 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.227174 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.227276 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.227486 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.227803 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.228117 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.228385 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.228494 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.228733 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.229132 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.229592 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.229769 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.230075 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.230321 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.230429 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.230729 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.231048 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.231361 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.231462 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.231741 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.232070 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.232382 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.232484 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.232718 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.233067 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.233389 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.233715 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.233824 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.234033 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.234355 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.234686 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.234923 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.235043 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.235321 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.235644 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.235981 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.236165 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.236320 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.236624 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.237099 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.237662 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.238400 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.238926 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.239464 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.240009 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.240555 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.241137 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.241678 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.242632 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.243163 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.243794 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.244329 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.244899 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.245072 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.245452 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.245819 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.245932 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.246194 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.246543 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.246877 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.246979 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.247219 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.247554 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.247881 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.248098 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.248212 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.248520 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.248983 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.249514 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.250230 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.250756 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.251302 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.251841 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.252378 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.252992 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.253606 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.254305 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.254916 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.255478 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.258164 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.258164 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.258164 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.258164 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.258561 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.258644 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.258984 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.259329 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.259657 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.259925 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.260027 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.260326 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.260677 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.261057 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.261302 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.261641 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.261983 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.262217 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.262316 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.262621 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.262949 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.263254 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.263372 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.263576 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.263900 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.264230 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.264465 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.264573 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.264890 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.265216 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.265543 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.265728 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.265884 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.266173 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.266487 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.266810 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.266990 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.267147 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.267672 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.268100 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.273042 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.273042 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.273042 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.273042 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.273372 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.273469 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.273560 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.273644 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.273724 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.273805 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.273886 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.273976 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.274073 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.274164 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.274251 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.274347 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.274438 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.274529 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.274613 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.274613 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.274613 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.274613 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.274613 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.274613 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.275056 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.275056 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.280821 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.280970 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.281083 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.281174 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.281267 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.281267 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.281430 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.281519 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.281617 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.281708 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.281792 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.281874 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.281956 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.282038 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.282439 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.282538 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.282638 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.282729 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.282729 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.282899 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.282899 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.283060 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.283060 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.283216 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.283307 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.283417 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.283503 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.283594 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.283677 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.283759 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.283841 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.283932 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.284017 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.284099 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.284775 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.284775 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.284972 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.285070 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.285070 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.285230 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.285313 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.285313 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.285313 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.285313 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.285619 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.285816 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.285816 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.285816 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.286392 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.286477 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.286569 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.286652 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.288858 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.288988 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.289087 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.289175 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.289256 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.289330 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.289415 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.289415 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.289555 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.289626 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.289695 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.289771 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.289771 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.289771 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.289771 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.290036 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.290359 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.290568 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.290667 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.290904 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.291223 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.291535 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.291797 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.292350 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.292926 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.293466 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.294016 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.294557 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.295102 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.295715 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.295820 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.296132 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.296513 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.296830 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.296934 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.297251 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.297609 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.297869 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.297990 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.298291 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.298619 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.298946 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.299057 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.299276 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.299735 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.300284 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.300398 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.300941 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.301209 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.301483 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.301936 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.302040 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.302460 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.302782 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.302884 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.303153 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.303485 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.303805 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.304027 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.304126 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.304437 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.304767 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.305058 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.305179 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.305439 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.305754 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.306075 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.306320 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.306420 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.306693 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.307014 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.307327 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.307520 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.307691 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.307960 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.308274 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.308585 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.308845 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.308947 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.309240 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.309589 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.309927 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.310185 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.310295 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.310546 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.310861 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.311185 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.311477 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.311579 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.311796 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.312115 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.312445 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.312762 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.312898 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.313159 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.313427 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.313739 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.314052 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.314328 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.314437 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.314667 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.314977 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.315286 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.315760 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.316001 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.316109 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.316475 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.316912 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.317170 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.317401 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.317510 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.317903 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.318090 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.318454 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.318767 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.319077 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.319215 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.319438 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.319763 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.320089 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.320377 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.320489 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.320713 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.321064 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.321382 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.321712 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.321867 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.322060 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.322341 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.322653 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.322965 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.325062 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.325062 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.325062 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.325062 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.325062 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.325062 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.325460 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.325460 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.325971 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.326073 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.326303 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.326642 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.327080 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.327264 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.327785 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.328014 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.328343 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.328766 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.328960 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.329488 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.329709 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.330053 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.330480 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.330652 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.331666 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.331985 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.332217 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.333425 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.333425 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.333695 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.334001 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.334245 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.334358 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.334618 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.335146 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.335253 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.335521 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.335993 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.336319 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.336647 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.336870 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.336984 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.337303 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.337625 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.337954 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.338155 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.338323 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.338593 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.339028 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.339274 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.339424 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.339650 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.339969 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.340283 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.340586 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.340699 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.340929 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.341265 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.341578 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.341901 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.342104 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.342215 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.342533 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.342846 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.343182 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.343299 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.343606 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.343928 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.344241 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.344474 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.344668 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.345011 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.345330 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.345664 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.345866 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.345974 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.346312 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.346665 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.347499 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.347677 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.347979 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.348401 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.348762 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.349808 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.349808 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.350106 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.350226 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.350317 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.350317 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.350478 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.350573 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.350674 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.350876 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.351280 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.351403 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.351620 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.351780 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.351961 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.352228 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.352490 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.352751 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.352982 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.353351 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.353451 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.353685 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.353907 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.354007 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.354349 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.354455 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.354668 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.354960 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.355095 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.355293 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.355536 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.355629 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.355909 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.356167 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.356401 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.356601 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.356748 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.357051 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.357371 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.357576 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.357788 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.358102 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.358197 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.358551 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.358666 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.358885 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.359193 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.359300 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.359523 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.359794 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.359886 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.360158 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.360384 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.360485 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.360787 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.361047 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.361353 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.361577 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.361680 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.361972 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.362199 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.362342 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.362733 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.363078 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.363274 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.363374 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.363688 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.363893 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.364004 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.364280 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.364577 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.364717 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.364922 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.365112 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.365264 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.365555 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.365696 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.365895 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.366035 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.366293 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.366484 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.366683 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.366928 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.367075 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.367294 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.367691 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.367863 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.368086 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.368230 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.368498 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.368741 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.369052 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.369193 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.369330 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.369465 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.369592 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.369741 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.369928 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.370107 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.370359 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.370493 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.370773 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.370959 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.371214 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.371433 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.371649 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.371826 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.371955 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.372217 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.372359 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.372686 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.372868 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.373042 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.373177 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.373350 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.373660 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.373809 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.373982 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.374843 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.374992 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.375150 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.375150 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.376996 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.377079 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.377161 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.377243 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.377321 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.377393 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.377468 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.377546 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.377617 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.377700 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.377779 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.377858 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.377965 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.378038 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.378106 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.378189 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.378189 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.378324 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.378625 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.378988 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.379587 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.379781 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.379937 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.380093 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.380250 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.380400 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.380560 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.380716 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.381826 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.382009 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.382009 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.382294 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.382587 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.383037 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.383198 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.383426 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.383584 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.383737 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.383894 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.383894 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.384180 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.384327 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.384471 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.384471 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.384770 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.385006 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.385174 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.385328 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.385474 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.385474 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.385774 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.385928 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.386080 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.386234 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.386379 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.386533 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.386687 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.386834 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.386996 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.387142 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.387287 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.387454 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.387614 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.387761 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.387913 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.388121 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.388269 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.388414 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.388560 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.388820 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.389101 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.389264 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.389418 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.389574 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.389782 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.390361 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.390535 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.390692 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.390692 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.390979 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.391134 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.391790 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.392239 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.392412 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.392560 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.392560 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.392935 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.393172 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.393333 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.394028 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.394201 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.394383 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.394383 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.394681 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.394830 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.394830 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.395118 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.395264 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.395410 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.395569 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.395717 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.395862 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.396013 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.396160 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.396160 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.396449 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.396596 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.396748 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.396928 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.397089 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.397237 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.397399 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.397547 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.397702 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.397849 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.397994 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.398148 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.398295 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.398448 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.398594 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.398747 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.399003 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.399271 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.399426 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.399579 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.399732 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.399879 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.400031 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.400188 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.400335 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.400489 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.400642 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.400820 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.400972 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.401145 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.401299 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.401454 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.401607 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.401761 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.401921 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.402075 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.402075 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.402460 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.402612 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.402767 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.402923 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.403078 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.403325 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.403478 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.403633 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.403633 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.403919 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.404066 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.404211 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.404362 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.404517 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.404670 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.404670 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.405072 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.405072 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.405072 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.405502 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.405662 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.405662 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.405947 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.406092 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.406278 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.406440 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.406596 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.406749 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.406897 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.407041 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.407905 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.408074 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.408232 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.408389 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.408550 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.408550 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.408550 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.409005 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.409808 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.414692 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.414891 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.415076 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.415268 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.415464 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.415726 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.415989 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.416262 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.416959 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.417079 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.417079 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.417079 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.417079 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.417079 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.417490 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.417579 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.417677 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.417773 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.417866 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.417959 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.418045 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.418138 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.418138 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.418310 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.418310 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.418463 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.418555 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.418555 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.418729 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.418821 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.418914 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.418999 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.419089 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.419184 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.419279 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.419358 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.419437 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.419529 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.419620 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.419714 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.419800 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.419891 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.419983 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.420068 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.420068 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.420068 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.420068 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.420068 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.420068 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.420068 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.420591 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.420591 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.420753 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.420885 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.421150 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.421493 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.421707 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.422119 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.422336 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.422446 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.422793 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.423034 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.423155 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.423584 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.423754 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.423910 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.424230 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.424526 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.425081 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.425081 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.425297 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.425591 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.425925 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.426047 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.426241 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.426557 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.426832 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.426953 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.427172 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.427651 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.427870 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.427979 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.428284 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.428588 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.428700 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.429015 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.429341 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.429452 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.429664 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.429986 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.430314 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.430479 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.430608 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.430931 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.431212 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.431674 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.431834 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.432031 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.432343 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.432697 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.433074 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.433252 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.433441 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.433565 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.433841 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.433951 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.434037 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.434277 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.434374 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.434649 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.434870 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.435027 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.435178 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.435346 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.435508 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.435657 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.435781 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.435859 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.436505 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.436688 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.436916 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.437080 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.437241 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.437393 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.437545 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.437711 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.437874 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.438027 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.438188 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.438390 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.438670 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.438924 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.439193 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.439408 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.439986 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.440252 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.441239 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.441531 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.441887 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.442380 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.442558 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.442714 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.442878 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.443053 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.443206 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.443206 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.443206 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.443206 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.443801 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.444226 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.444388 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.444388 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.444388 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.444388 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.445007 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.445186 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.445353 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.445353 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.445353 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.445353 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.445934 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.445934 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.446334 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.446714 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.446891 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.447193 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.447515 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.447676 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.447853 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.448010 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.448163 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.448353 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.448521 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.448675 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.448934 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.449108 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.449271 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.449425 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.449577 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.449740 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.449902 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.450067 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.450235 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.450396 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.450556 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.450717 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.450877 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.451030 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.451315 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.451477 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.451630 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.451790 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.452085 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.452368 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.452547 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.452702 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.452881 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.453051 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.453206 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.453206 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.453525 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.455722 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.455881 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.456127 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.457181 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.457458 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.457458 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.457877 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.458043 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.458203 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.458355 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.458527 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.458691 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.458844 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.458997 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.459156 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.459318 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.459631 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.459802 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.459978 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.460146 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.460307 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.460471 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.460471 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.460977 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.461215 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.461215 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.461215 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.462104 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.462661 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.462661 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.462661 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.462661 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.462661 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.462661 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.462661 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.462661 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.464488 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.464488 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.465080 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.465326 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.465576 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.465814 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.466055 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.466328 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.466580 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.466820 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.467338 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.467595 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.467944 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.468176 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.468550 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.468867 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.468867 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.469184 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.469355 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.469508 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.469640 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.469762 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.469876 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.469988 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.470108 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.470108 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.470329 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.470441 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.470559 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.470680 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.470801 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.470924 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.471038 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.471158 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.471293 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.471415 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.471557 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.471844 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.471978 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.472101 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.472264 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.472492 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.476490 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.476676 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.476909 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.477073 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.477457 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.477626 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.477812 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.478008 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.478166 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.478329 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.478495 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.478659 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.478814 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.478979 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.479145 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.479306 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.479460 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.479626 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.479780 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.479933 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.479933 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.479933 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.480379 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.480547 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.480547 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.480865 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.481048 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.481302 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.481680 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.482132 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.482445 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.482713 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.483239 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.483452 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.483650 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.483902 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 11:30:47.484171 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.484171 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.484171 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.484171 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.484171 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.484171 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.484171 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.484171 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.485981 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.485981 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.485981 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.485981 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.485981 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.485981 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.485981 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.485981 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.487152 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.487152 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.487152 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.487152 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.487152 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.487152 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.487152 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.487152 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.488922 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.488922 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.488922 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.488922 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.488922 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.488922 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.488922 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.488922 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.490192 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.490192 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.490518 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.491818 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.494843 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.494843 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.494843 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.495391 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.497695 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.497695 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.497695 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.497695 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.497695 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.497695 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.498868 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.499027 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.499472 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.500352 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.501127 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.501788 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.502122 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.502491 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.503390 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.503888 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.504337 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.504981 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.505645 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.506234 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.506737 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.507229 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.507819 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.508064 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.508429 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.509645 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.509645 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.510132 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.510483 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.510957 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.511343 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.511698 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.512020 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.512336 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.512659 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.513037 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.513361 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.513695 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.513996 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.514339 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.514631 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.515123 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.515273 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.517057 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.517381 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.517709 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.518025 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.518342 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.519287 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.519598 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.519926 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.520294 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.520618 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.520973 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.521301 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.521626 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.521944 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.522310 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.522633 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.522943 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.523263 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.523602 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.523922 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.524239 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.524706 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.525018 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.525342 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.525666 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.525980 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.526308 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.526631 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.526970 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.527296 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.527610 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.527943 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.528277 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.528613 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.528970 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.529363 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.529675 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.529989 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.530268 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.530583 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.530898 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.531206 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.531518 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.531896 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.532207 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.532484 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.532924 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.538842 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.538842 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.538842 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.538842 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.538842 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.538842 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.538842 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.538842 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.540693 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.540693 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.540693 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.540693 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.540693 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.540693 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.540693 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.540693 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.541973 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.541973 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.541973 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.541973 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.541973 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.541973 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.541973 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.541973 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.543463 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.543463 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.544704 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.545162 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.546340 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.546687 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.547027 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.547361 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.548931 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO dbcounter [None req-4256db57-9332-4179-8273-9374d51c603c None None] Registered counter for database nova_api Aug 24 11:30:47.549167 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.549425 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.549687 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.550222 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.550728 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.551100 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.551600 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.551933 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.552284 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.552614 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.553017 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.553307 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.553632 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.553951 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.554276 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.554596 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.554925 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.556520 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.556946 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.557308 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.558902 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.559853 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.559853 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.560781 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.561219 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.561551 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.561913 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.562258 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.562589 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.562912 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.563230 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:30:47.563483 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 11:30:47.571485 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_db.sqlalchemy.engines [None req-4256db57-9332-4179-8273-9374d51c603c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124769) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 11:30:47.578686 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG dbcounter [-] [124769] Writer thread running {{(pid=124769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 11:30:47.640638 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.context [None req-4256db57-9332-4179-8273-9374d51c603c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),65f11403-e029-4cba-8205-60fa018f7cd7(cell1) {{(pid=124769) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 11:30:47.645602 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-4256db57-9332-4179-8273-9374d51c603c None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:47.646171 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-4256db57-9332-4179-8273-9374d51c603c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:47.647503 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO dbcounter [None req-871442e7-6921-4506-b54f-e4f55b8a6b6e None None] Registered counter for database nova_api Aug 24 11:30:47.647998 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-4256db57-9332-4179-8273-9374d51c603c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:47.648833 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-4256db57-9332-4179-8273-9374d51c603c None None] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:47.653492 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-4256db57-9332-4179-8273-9374d51c603c None None] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:47.653492 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-4256db57-9332-4179-8273-9374d51c603c None None] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:47.654260 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO dbcounter [None req-4256db57-9332-4179-8273-9374d51c603c None None] Registered counter for database nova_cell0 Aug 24 11:30:47.658875 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO dbcounter [None req-4256db57-9332-4179-8273-9374d51c603c None None] Registered counter for database nova_cell1 Aug 24 11:30:47.667666 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_db.sqlalchemy.engines [None req-4256db57-9332-4179-8273-9374d51c603c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124769) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 11:30:47.669034 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_db.sqlalchemy.engines [None req-4256db57-9332-4179-8273-9374d51c603c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124769) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 11:30:47.674532 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_db.sqlalchemy.engines [None req-871442e7-6921-4506-b54f-e4f55b8a6b6e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124770) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 11:30:47.685980 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG dbcounter [-] [124769] Writer thread running {{(pid=124769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 11:30:47.686325 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG dbcounter [-] [124769] Writer thread running {{(pid=124769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 11:30:47.689854 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writer thread running {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 11:30:47.765750 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.context [None req-871442e7-6921-4506-b54f-e4f55b8a6b6e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),65f11403-e029-4cba-8205-60fa018f7cd7(cell1) {{(pid=124770) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 11:30:47.770900 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-871442e7-6921-4506-b54f-e4f55b8a6b6e None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:47.771385 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-871442e7-6921-4506-b54f-e4f55b8a6b6e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:47.773026 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-871442e7-6921-4506-b54f-e4f55b8a6b6e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:47.773778 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-871442e7-6921-4506-b54f-e4f55b8a6b6e None None] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:47.774231 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-871442e7-6921-4506-b54f-e4f55b8a6b6e None None] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:47.776230 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-871442e7-6921-4506-b54f-e4f55b8a6b6e None None] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:47.778270 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO dbcounter [None req-871442e7-6921-4506-b54f-e4f55b8a6b6e None None] Registered counter for database nova_cell0 Aug 24 11:30:47.784779 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO dbcounter [None req-871442e7-6921-4506-b54f-e4f55b8a6b6e None None] Registered counter for database nova_cell1 Aug 24 11:30:47.795963 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_db.sqlalchemy.engines [None req-871442e7-6921-4506-b54f-e4f55b8a6b6e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124770) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 11:30:47.798230 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_db.sqlalchemy.engines [None req-871442e7-6921-4506-b54f-e4f55b8a6b6e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124770) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 11:30:47.822137 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writer thread running {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 11:30:47.824460 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writer thread running {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 11:30:47.883386 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO dbcounter [None req-4256db57-9332-4179-8273-9374d51c603c None None] Registered counter for database nova_cell0 Aug 24 11:30:47.893497 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_db.sqlalchemy.engines [None req-4256db57-9332-4179-8273-9374d51c603c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124769) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 11:30:47.899454 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG dbcounter [-] [124769] Writer thread running {{(pid=124769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 11:30:48.036210 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO dbcounter [None req-871442e7-6921-4506-b54f-e4f55b8a6b6e None None] Registered counter for database nova_cell0 Aug 24 11:30:48.044169 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_db.sqlalchemy.engines [None req-871442e7-6921-4506-b54f-e4f55b8a6b6e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124770) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 11:30:48.050111 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writer thread running {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 11:30:48.330112 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: WARNING keystonemiddleware.auth_token [None req-4256db57-9332-4179-8273-9374d51c603c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 11:30:48.342678 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: WARNING keystonemiddleware.auth_token [None req-4256db57-9332-4179-8273-9374d51c603c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 11:30:48.440292 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: WARNING keystonemiddleware.auth_token [None req-871442e7-6921-4506-b54f-e4f55b8a6b6e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 11:30:48.449049 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: WARNING keystonemiddleware.auth_token [None req-871442e7-6921-4506-b54f-e4f55b8a6b6e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 11:30:48.734280 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: WARNING keystonemiddleware.auth_token [None req-4256db57-9332-4179-8273-9374d51c603c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 11:30:48.741894 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: WARNING keystonemiddleware.auth_token [None req-4256db57-9332-4179-8273-9374d51c603c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 11:30:48.749113 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55fa0aca99c0 pid: 124769 (default app) Aug 24 11:30:48.858398 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: WARNING keystonemiddleware.auth_token [None req-871442e7-6921-4506-b54f-e4f55b8a6b6e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 11:30:48.865398 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: WARNING keystonemiddleware.auth_token [None req-871442e7-6921-4506-b54f-e4f55b8a6b6e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 11:30:48.871407 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55fa0aca99c0 pid: 124770 (default app) Aug 24 11:31:24.861976 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG dbcounter [-] [124769] Writing DB stats nova_api:SELECT=3 {{(pid=124769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:31:24.861976 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG dbcounter [-] [124769] Writing DB stats nova_cell1:SELECT=3 {{(pid=124769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:31:24.861976 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG dbcounter [-] [124769] Writing DB stats nova_cell0:SELECT=3 {{(pid=124769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:31:24.862660 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG dbcounter [-] [124769] Writing DB stats nova_cell0:SELECT=3 {{(pid=124769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:31:26.259867 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-bcf2b094-26c1-4ee1-8f9f-c6237f8c2e68 tempest-VolumesNegativeTest-1253569011 tempest-VolumesNegativeTest-1253569011-project] Action: 'create', calling method: .version_select at 0x7f0e2c4eb5e0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1745917908", "metadata": {"Type": "work"}}} {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:31:26.266229 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-bcf2b094-26c1-4ee1-8f9f-c6237f8c2e68 tempest-VolumesNegativeTest-1253569011 tempest-VolumesNegativeTest-1253569011-project] Request method failure captured: Aug 24 11:31:26.266229 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 24 11:31:26.266229 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Accept: application/json Aug 24 11:31:26.266229 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Accept-Encoding: identity Aug 24 11:31:26.266229 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Connection: close Aug 24 11:31:26.266229 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Content-Length: 122 Aug 24 11:31:26.266229 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Content-Type: application/json Aug 24 11:31:26.266229 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Host: 10.222.0.84 Aug 24 11:31:26.266229 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Openstack-System-Scope: None Aug 24 11:31:26.266229 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: User-Agent: python-urllib3/1.26.11 Aug 24 11:31:26.266229 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Auth-Token: gAAAAABjBgwMXJgpj85QlPM1PYuBoKQZHwXqaqept_XKfIuRBhMQShDLDqjeu5yFp8Tsv_es9aoMufHPhjRIuMnQ3tZLp2fWlBZaboiqu92eF9Sjg7vrL7nSFZBCg_q1im2FpLLEHXPmhxRF9TzGFMhwDhJJr3KSPJDPqcK_WW_B-1--aHdFWw4 Aug 24 11:31:26.266229 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Domain-Id: None Aug 24 11:31:26.266229 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Domain-Name: None Aug 24 11:31:26.266229 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Identity-Status: Confirmed Aug 24 11:31:26.266229 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Is-Admin-Project: True Aug 24 11:31:26.266229 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Project-Domain-Id: default Aug 24 11:31:26.266229 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Project-Domain-Name: Default Aug 24 11:31:26.266229 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Project-Id: 099fe6c7868e4c2990813036624f4cd8 Aug 24 11:31:26.266229 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Project-Name: tempest-VolumesNegativeTest-1253569011 Aug 24 11:31:26.266229 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Role: reader,member Aug 24 11:31:26.266229 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Roles: reader,member Aug 24 11:31:26.267958 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/volume/v3/099fe6c7868e4c2990813036624f4cd8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/volume/v3/099fe6c7868e4c2990813036624f4cd8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/compute/v2/099fe6c7868e4c2990813036624f4cd8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84:8080/v1/AUTH_099fe6c7868e4c2990813036624f4cd8", "adminURL": "http://10.222.0.84:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/placement"}]}] Aug 24 11:31:26.267958 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Tenant: tempest-VolumesNegativeTest-1253569011 Aug 24 11:31:26.267958 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Tenant-Id: 099fe6c7868e4c2990813036624f4cd8 Aug 24 11:31:26.267958 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Tenant-Name: tempest-VolumesNegativeTest-1253569011 Aug 24 11:31:26.267958 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-User: tempest-VolumesNegativeTest-1253569011-project Aug 24 11:31:26.267958 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-User-Domain-Id: default Aug 24 11:31:26.267958 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-User-Domain-Name: Default Aug 24 11:31:26.267958 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-User-Id: 3dd192e05b7b42209a28ee1419827a6d Aug 24 11:31:26.267958 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-User-Name: tempest-VolumesNegativeTest-1253569011-project Aug 24 11:31:26.267958 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Aug 24 11:31:26.267958 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1745917908", "metadata": {"Type": "work"}}} Aug 24 11:31:26.267958 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: method: Aug 24 11:31:26.267958 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 24 11:31:26.268946 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1745917908', 'metadata': {'Type': 'work'}}}} Aug 24 11:31:26.268946 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:31:26.268946 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:31:26.268946 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 11:31:26.268946 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 11:31:26.268946 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 11:31:26.268946 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi raise error Aug 24 11:31:26.268946 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 24 11:31:26.268946 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Aug 24 11:31:26.268946 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 24 11:31:26.268946 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 24 11:31:26.268946 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Aug 24 11:31:26.268946 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 24 11:31:26.268946 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi '#$%' Aug 24 11:31:26.268946 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Aug 24 11:31:26.268946 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:31:26.268946 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Aug 24 11:31:26.268946 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:31:26.268946 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:31:26.268946 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:31:26.268946 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:31:26.268946 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:31:26.270652 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 11:31:26.270652 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 11:31:26.270652 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:31:26.270652 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:31:26.270652 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 11:31:26.270652 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 11:31:26.270652 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 11:31:26.270652 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 11:31:26.270652 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 11:31:26.270652 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 11:31:26.270652 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 24 11:31:26.270652 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Aug 24 11:31:26.270652 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:31:26.270652 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Aug 24 11:31:26.270652 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:31:26.270652 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:31:26.270652 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:31:26.270652 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 11:31:26.270652 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 11:31:26.272013 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 24 11:31:26.272013 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Aug 24 11:31:26.277165 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-bcf2b094-26c1-4ee1-8f9f-c6237f8c2e68 tempest-VolumesNegativeTest-1253569011 tempest-VolumesNegativeTest-1253569011-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=124769) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:31:26.280447 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-bcf2b094-26c1-4ee1-8f9f-c6237f8c2e68 tempest-VolumesNegativeTest-1253569011 tempest-VolumesNegativeTest-1253569011-project] 10.222.0.84 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.431511 Aug 24 11:31:26.284023 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 1/1] 10.222.0.84 () {60 vars in 1156 bytes} [Wed Aug 24 11:31:24 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1436 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 11:31:26.849876 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-33093758-bfaf-4736-aa49-ee15b482b703 tempest-VolumesNegativeTest-1253569011 tempest-VolumesNegativeTest-1253569011-project] Action: 'create', calling method: .version_select at 0x7f0e2c619160>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1803713025", "metadata": {"Type": "work"}}} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:31:26.887300 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-33093758-bfaf-4736-aa49-ee15b482b703 tempest-VolumesNegativeTest-1253569011 tempest-VolumesNegativeTest-1253569011-project] Request method failure captured: Aug 24 11:31:26.887300 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 24 11:31:26.887300 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Accept: application/json Aug 24 11:31:26.887300 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Accept-Encoding: identity Aug 24 11:31:26.887300 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Connection: close Aug 24 11:31:26.887300 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Content-Length: 120 Aug 24 11:31:26.887300 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Content-Type: application/json Aug 24 11:31:26.887300 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Host: 10.222.0.84 Aug 24 11:31:26.887300 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Openstack-System-Scope: None Aug 24 11:31:26.887300 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: User-Agent: python-urllib3/1.26.11 Aug 24 11:31:26.887300 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Auth-Token: gAAAAABjBgwMXJgpj85QlPM1PYuBoKQZHwXqaqept_XKfIuRBhMQShDLDqjeu5yFp8Tsv_es9aoMufHPhjRIuMnQ3tZLp2fWlBZaboiqu92eF9Sjg7vrL7nSFZBCg_q1im2FpLLEHXPmhxRF9TzGFMhwDhJJr3KSPJDPqcK_WW_B-1--aHdFWw4 Aug 24 11:31:26.887300 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Domain-Id: None Aug 24 11:31:26.887300 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Domain-Name: None Aug 24 11:31:26.887300 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Identity-Status: Confirmed Aug 24 11:31:26.887300 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Is-Admin-Project: True Aug 24 11:31:26.887300 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Project-Domain-Id: default Aug 24 11:31:26.887300 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Project-Domain-Name: Default Aug 24 11:31:26.887300 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Project-Id: 099fe6c7868e4c2990813036624f4cd8 Aug 24 11:31:26.887300 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Project-Name: tempest-VolumesNegativeTest-1253569011 Aug 24 11:31:26.887300 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Role: reader,member Aug 24 11:31:26.887300 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Roles: reader,member Aug 24 11:31:26.890054 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/volume/v3/099fe6c7868e4c2990813036624f4cd8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/volume/v3/099fe6c7868e4c2990813036624f4cd8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/compute/v2/099fe6c7868e4c2990813036624f4cd8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84:8080/v1/AUTH_099fe6c7868e4c2990813036624f4cd8", "adminURL": "http://10.222.0.84:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/placement"}]}] Aug 24 11:31:26.890054 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Tenant: tempest-VolumesNegativeTest-1253569011 Aug 24 11:31:26.890054 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Tenant-Id: 099fe6c7868e4c2990813036624f4cd8 Aug 24 11:31:26.890054 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Tenant-Name: tempest-VolumesNegativeTest-1253569011 Aug 24 11:31:26.890054 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User: tempest-VolumesNegativeTest-1253569011-project Aug 24 11:31:26.890054 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User-Domain-Id: default Aug 24 11:31:26.890054 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User-Domain-Name: Default Aug 24 11:31:26.890054 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User-Id: 3dd192e05b7b42209a28ee1419827a6d Aug 24 11:31:26.890054 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User-Name: tempest-VolumesNegativeTest-1253569011-project Aug 24 11:31:26.890054 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Aug 24 11:31:26.890054 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1803713025", "metadata": {"Type": "work"}}} Aug 24 11:31:26.890054 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: method: Aug 24 11:31:26.890054 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 24 11:31:26.891713 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1803713025', 'metadata': {'Type': 'work'}}}} Aug 24 11:31:26.891713 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:31:26.891713 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:31:26.891713 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 11:31:26.891713 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 11:31:26.891713 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 11:31:26.891713 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise error Aug 24 11:31:26.891713 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 24 11:31:26.891713 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:31:26.891713 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 24 11:31:26.891713 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 24 11:31:26.891713 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:31:26.891713 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 24 11:31:26.891713 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi '0' Aug 24 11:31:26.891713 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:31:26.891713 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:31:26.891713 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:31:26.891713 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:31:26.891713 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:31:26.891713 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:31:26.891713 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:31:26.891713 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:31:26.894651 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 11:31:26.894651 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 11:31:26.894651 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:31:26.894651 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:31:26.894651 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 11:31:26.894651 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 11:31:26.894651 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 11:31:26.894651 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 11:31:26.894651 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 11:31:26.894651 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 11:31:26.894651 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 24 11:31:26.894651 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:31:26.894651 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:31:26.894651 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:31:26.894651 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:31:26.894651 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:31:26.894651 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:31:26.894651 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 11:31:26.894651 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 11:31:26.897316 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 24 11:31:26.897316 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:31:26.901826 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-33093758-bfaf-4736-aa49-ee15b482b703 tempest-VolumesNegativeTest-1253569011 tempest-VolumesNegativeTest-1253569011-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=124770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:31:26.903723 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-33093758-bfaf-4736-aa49-ee15b482b703 tempest-VolumesNegativeTest-1253569011 tempest-VolumesNegativeTest-1253569011-project] 10.222.0.84 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.605852 Aug 24 11:31:26.905388 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 1/2] 10.222.0.84 () {60 vars in 1156 bytes} [Wed Aug 24 11:31:26 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 615 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 11:31:26.922278 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-5d63d8a9-5de3-460e-92a5-64b52a589d0a tempest-VolumesNegativeTest-1253569011 tempest-VolumesNegativeTest-1253569011-project] Action: 'create', calling method: .version_select at 0x7f0e2c4eb670>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1061385244", "metadata": {"Type": "work"}}} {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:31:26.960048 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-5d63d8a9-5de3-460e-92a5-64b52a589d0a tempest-VolumesNegativeTest-1253569011 tempest-VolumesNegativeTest-1253569011-project] Request method failure captured: Aug 24 11:31:26.960048 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 24 11:31:26.960048 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Accept: application/json Aug 24 11:31:26.960048 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Accept-Encoding: identity Aug 24 11:31:26.960048 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Connection: close Aug 24 11:31:26.960048 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Content-Length: 119 Aug 24 11:31:26.960048 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Content-Type: application/json Aug 24 11:31:26.960048 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Host: 10.222.0.84 Aug 24 11:31:26.960048 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Openstack-System-Scope: None Aug 24 11:31:26.960048 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: User-Agent: python-urllib3/1.26.11 Aug 24 11:31:26.960048 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Auth-Token: gAAAAABjBgwMXJgpj85QlPM1PYuBoKQZHwXqaqept_XKfIuRBhMQShDLDqjeu5yFp8Tsv_es9aoMufHPhjRIuMnQ3tZLp2fWlBZaboiqu92eF9Sjg7vrL7nSFZBCg_q1im2FpLLEHXPmhxRF9TzGFMhwDhJJr3KSPJDPqcK_WW_B-1--aHdFWw4 Aug 24 11:31:26.960048 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Domain-Id: None Aug 24 11:31:26.960048 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Domain-Name: None Aug 24 11:31:26.960048 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Identity-Status: Confirmed Aug 24 11:31:26.960048 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Is-Admin-Project: True Aug 24 11:31:26.960048 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Project-Domain-Id: default Aug 24 11:31:26.960048 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Project-Domain-Name: Default Aug 24 11:31:26.960048 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Project-Id: 099fe6c7868e4c2990813036624f4cd8 Aug 24 11:31:26.960048 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Project-Name: tempest-VolumesNegativeTest-1253569011 Aug 24 11:31:26.960048 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Role: reader,member Aug 24 11:31:26.960048 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Roles: reader,member Aug 24 11:31:26.963018 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/volume/v3/099fe6c7868e4c2990813036624f4cd8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/volume/v3/099fe6c7868e4c2990813036624f4cd8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/compute/v2/099fe6c7868e4c2990813036624f4cd8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84:8080/v1/AUTH_099fe6c7868e4c2990813036624f4cd8", "adminURL": "http://10.222.0.84:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/placement"}]}] Aug 24 11:31:26.963018 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Tenant: tempest-VolumesNegativeTest-1253569011 Aug 24 11:31:26.963018 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Tenant-Id: 099fe6c7868e4c2990813036624f4cd8 Aug 24 11:31:26.963018 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Tenant-Name: tempest-VolumesNegativeTest-1253569011 Aug 24 11:31:26.963018 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-User: tempest-VolumesNegativeTest-1253569011-project Aug 24 11:31:26.963018 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-User-Domain-Id: default Aug 24 11:31:26.963018 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-User-Domain-Name: Default Aug 24 11:31:26.963018 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-User-Id: 3dd192e05b7b42209a28ee1419827a6d Aug 24 11:31:26.963018 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-User-Name: tempest-VolumesNegativeTest-1253569011-project Aug 24 11:31:26.963018 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Aug 24 11:31:26.963018 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1061385244", "metadata": {"Type": "work"}}} Aug 24 11:31:26.963018 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: method: Aug 24 11:31:26.963018 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 24 11:31:26.964855 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1061385244', 'metadata': {'Type': 'work'}}}} Aug 24 11:31:26.964855 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:31:26.964855 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:31:26.964855 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 11:31:26.964855 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 11:31:26.964855 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 11:31:26.964855 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi raise error Aug 24 11:31:26.964855 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 24 11:31:26.964855 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Aug 24 11:31:26.964855 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 24 11:31:26.964855 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 24 11:31:26.964855 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Aug 24 11:31:26.964855 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 24 11:31:26.964855 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi '' Aug 24 11:31:26.964855 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Aug 24 11:31:26.964855 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:31:26.964855 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Aug 24 11:31:26.964855 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:31:26.964855 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:31:26.964855 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:31:26.964855 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:31:26.964855 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:31:26.967474 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 11:31:26.967474 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 11:31:26.967474 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:31:26.967474 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:31:26.967474 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 11:31:26.967474 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 11:31:26.967474 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 11:31:26.967474 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 11:31:26.967474 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 11:31:26.967474 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 11:31:26.967474 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 24 11:31:26.967474 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Aug 24 11:31:26.967474 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:31:26.967474 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Aug 24 11:31:26.967474 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:31:26.967474 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:31:26.967474 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:31:26.967474 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 11:31:26.967474 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 11:31:26.971500 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 24 11:31:26.971500 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Aug 24 11:31:26.971500 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-5d63d8a9-5de3-460e-92a5-64b52a589d0a tempest-VolumesNegativeTest-1253569011 tempest-VolumesNegativeTest-1253569011-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=124769) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:31:26.971500 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-5d63d8a9-5de3-460e-92a5-64b52a589d0a tempest-VolumesNegativeTest-1253569011 tempest-VolumesNegativeTest-1253569011-project] 10.222.0.84 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.048748 Aug 24 11:31:26.971500 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 2/3] 10.222.0.84 () {60 vars in 1156 bytes} [Wed Aug 24 11:31:26 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 57 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 11:31:26.985022 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-b05da80f-ba6c-4b3d-9988-7342173ec441 tempest-VolumesNegativeTest-1253569011 tempest-VolumesNegativeTest-1253569011-project] Calling method '.version_select at 0x7f0e2c619b80>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:27.106155 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_api:SELECT=3 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:31:27.109828 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_cell0:SELECT=3 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:31:27.110686 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_cell1:SELECT=3 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:31:27.113712 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_cell0:SELECT=3 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:31:27.915326 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.wsgi [None req-b05da80f-ba6c-4b3d-9988-7342173ec441 tempest-VolumesNegativeTest-1253569011 tempest-VolumesNegativeTest-1253569011-project] HTTP exception thrown: Volume tempest-invalid-619538990 could not be found. Aug 24 11:31:27.922181 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-b05da80f-ba6c-4b3d-9988-7342173ec441 tempest-VolumesNegativeTest-1253569011 tempest-VolumesNegativeTest-1253569011-project] Request method failure captured: Aug 24 11:31:27.922181 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-619538990 HTTP/1.1 Aug 24 11:31:27.922181 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Accept: application/json Aug 24 11:31:27.922181 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Accept-Encoding: identity Aug 24 11:31:27.922181 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Connection: close Aug 24 11:31:27.922181 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Content-Length: 0 Aug 24 11:31:27.922181 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Content-Type: application/json Aug 24 11:31:27.922181 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Host: 10.222.0.84 Aug 24 11:31:27.922181 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Openstack-System-Scope: None Aug 24 11:31:27.922181 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: User-Agent: python-urllib3/1.26.11 Aug 24 11:31:27.922181 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Auth-Token: gAAAAABjBgwMXJgpj85QlPM1PYuBoKQZHwXqaqept_XKfIuRBhMQShDLDqjeu5yFp8Tsv_es9aoMufHPhjRIuMnQ3tZLp2fWlBZaboiqu92eF9Sjg7vrL7nSFZBCg_q1im2FpLLEHXPmhxRF9TzGFMhwDhJJr3KSPJDPqcK_WW_B-1--aHdFWw4 Aug 24 11:31:27.922181 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Domain-Id: None Aug 24 11:31:27.922181 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Domain-Name: None Aug 24 11:31:27.922181 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Identity-Status: Confirmed Aug 24 11:31:27.922181 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Is-Admin-Project: True Aug 24 11:31:27.922181 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Project-Domain-Id: default Aug 24 11:31:27.922181 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Project-Domain-Name: Default Aug 24 11:31:27.922181 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Project-Id: 099fe6c7868e4c2990813036624f4cd8 Aug 24 11:31:27.922181 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Project-Name: tempest-VolumesNegativeTest-1253569011 Aug 24 11:31:27.922181 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Role: reader,member Aug 24 11:31:27.922181 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Roles: reader,member Aug 24 11:31:27.923471 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/volume/v3/099fe6c7868e4c2990813036624f4cd8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/volume/v3/099fe6c7868e4c2990813036624f4cd8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/compute/v2/099fe6c7868e4c2990813036624f4cd8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84:8080/v1/AUTH_099fe6c7868e4c2990813036624f4cd8", "adminURL": "http://10.222.0.84:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/placement"}]}] Aug 24 11:31:27.923471 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Tenant: tempest-VolumesNegativeTest-1253569011 Aug 24 11:31:27.923471 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Tenant-Id: 099fe6c7868e4c2990813036624f4cd8 Aug 24 11:31:27.923471 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Tenant-Name: tempest-VolumesNegativeTest-1253569011 Aug 24 11:31:27.923471 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User: tempest-VolumesNegativeTest-1253569011-project Aug 24 11:31:27.923471 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User-Domain-Id: default Aug 24 11:31:27.923471 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User-Domain-Name: Default Aug 24 11:31:27.923471 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User-Id: 3dd192e05b7b42209a28ee1419827a6d Aug 24 11:31:27.923471 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User-Name: tempest-VolumesNegativeTest-1253569011-project Aug 24 11:31:27.923471 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: method: Aug 24 11:31:27.923471 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: exception: Volume tempest-invalid-619538990 could not be found. Aug 24 11:31:27.923471 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: action_args: {'id': 'tempest-invalid-619538990'} Aug 24 11:31:27.923471 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:31:27.924839 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:31:27.924839 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 11:31:27.924839 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 11:31:27.924839 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 11:31:27.924839 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 11:31:27.924839 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 11:31:27.924839 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 11:31:27.924839 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 11:31:27.924839 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 11:31:27.924839 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 11:31:27.924839 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 11:31:27.924839 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 11:31:27.924839 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 11:31:27.924839 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 11:31:27.924839 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 11:31:27.924839 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-619538990 could not be found. (HTTP 404) (Request-ID: req-d0831097-3761-4312-b3f1-2e9eb19b7faa) Aug 24 11:31:27.924839 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:31:27.924839 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:31:27.924839 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:31:27.928922 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:31:27.928922 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 24 11:31:27.928922 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 24 11:31:27.928922 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 11:31:27.928922 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 11:31:27.928922 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 11:31:27.928922 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 11:31:27.928922 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 11:31:27.928922 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 11:31:27.928922 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 11:31:27.928922 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 11:31:27.928922 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 11:31:27.928922 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 11:31:27.928922 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 11:31:27.928922 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 11:31:27.928922 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 11:31:27.928922 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 11:31:27.928922 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 11:31:27.928922 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 11:31:27.930636 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 11:31:27.930636 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 11:31:27.930636 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 11:31:27.930636 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 11:31:27.930636 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-619538990 could not be found. Aug 24 11:31:27.930636 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:31:27.930636 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:31:27.930636 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:31:27.930636 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:31:27.930636 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:31:27.930636 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:31:27.930636 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:31:27.930636 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:31:27.930636 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 11:31:27.930636 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 11:31:27.930636 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:31:27.930636 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:31:27.930636 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 24 11:31:27.930636 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:31:27.930636 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-619538990 could not be found. Aug 24 11:31:27.932113 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:31:27.932113 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:31:27.932113 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:31:27.932113 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:31:27.932113 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:31:27.932113 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:31:27.932113 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:31:27.932113 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:31:27.932113 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-619538990 could not be found. Aug 24 11:31:27.932113 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:31:27.934628 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-b05da80f-ba6c-4b3d-9988-7342173ec441 tempest-VolumesNegativeTest-1253569011 tempest-VolumesNegativeTest-1253569011-project] Returning 404 to user: Volume tempest-invalid-619538990 could not be found. {{(pid=124770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:31:27.935876 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-b05da80f-ba6c-4b3d-9988-7342173ec441 tempest-VolumesNegativeTest-1253569011 tempest-VolumesNegativeTest-1253569011-project] 10.222.0.84 "DELETE /compute/v2.1/os-volumes/tempest-invalid-619538990" status: 404 len: 98 microversion: 2.1 time: 0.964322 Aug 24 11:31:27.940001 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 2/4] 10.222.0.84 () {58 vars in 1215 bytes} [Wed Aug 24 11:31:26 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-619538990 => generated 98 bytes in 967 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 24 11:31:27.949189 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-016178e6-c4dd-4de2-9c3c-a92e763ef2d9 tempest-VolumesNegativeTest-1253569011 tempest-VolumesNegativeTest-1253569011-project] 10.222.0.84 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003676 Aug 24 11:31:27.949971 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 3/5] 10.222.0.84 () {58 vars in 1140 bytes} [Wed Aug 24 11:31:27 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 24 11:31:27.963155 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-f2e36290-4152-4558-bc44-eec5bb0318da tempest-VolumesNegativeTest-1253569011 tempest-VolumesNegativeTest-1253569011-project] 10.222.0.84 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004096 Aug 24 11:31:27.968636 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 3/6] 10.222.0.84 () {58 vars in 1137 bytes} [Wed Aug 24 11:31:27 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 24 11:31:27.981893 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-86527029-5958-4eac-8ad1-0571a949cb37 tempest-VolumesNegativeTest-1253569011 tempest-VolumesNegativeTest-1253569011-project] Calling method '.version_select at 0x7f0e2c425430>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:28.307223 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.wsgi [None req-86527029-5958-4eac-8ad1-0571a949cb37 tempest-VolumesNegativeTest-1253569011 tempest-VolumesNegativeTest-1253569011-project] HTTP exception thrown: Volume 9164f141-ee55-4d73-b106-b2e9bc37de3d could not be found. Aug 24 11:31:28.312343 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-86527029-5958-4eac-8ad1-0571a949cb37 tempest-VolumesNegativeTest-1253569011 tempest-VolumesNegativeTest-1253569011-project] Request method failure captured: Aug 24 11:31:28.312343 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: request: DELETE /compute/v2.1/os-volumes/9164f141-ee55-4d73-b106-b2e9bc37de3d HTTP/1.1 Aug 24 11:31:28.312343 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Accept: application/json Aug 24 11:31:28.312343 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Accept-Encoding: identity Aug 24 11:31:28.312343 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Connection: close Aug 24 11:31:28.312343 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Content-Length: 0 Aug 24 11:31:28.312343 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Content-Type: application/json Aug 24 11:31:28.312343 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Host: 10.222.0.84 Aug 24 11:31:28.312343 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Openstack-System-Scope: None Aug 24 11:31:28.312343 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: User-Agent: python-urllib3/1.26.11 Aug 24 11:31:28.312343 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Auth-Token: gAAAAABjBgwMXJgpj85QlPM1PYuBoKQZHwXqaqept_XKfIuRBhMQShDLDqjeu5yFp8Tsv_es9aoMufHPhjRIuMnQ3tZLp2fWlBZaboiqu92eF9Sjg7vrL7nSFZBCg_q1im2FpLLEHXPmhxRF9TzGFMhwDhJJr3KSPJDPqcK_WW_B-1--aHdFWw4 Aug 24 11:31:28.312343 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Domain-Id: None Aug 24 11:31:28.312343 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Domain-Name: None Aug 24 11:31:28.312343 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Identity-Status: Confirmed Aug 24 11:31:28.312343 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Is-Admin-Project: True Aug 24 11:31:28.312343 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Project-Domain-Id: default Aug 24 11:31:28.312343 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Project-Domain-Name: Default Aug 24 11:31:28.312343 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Project-Id: 099fe6c7868e4c2990813036624f4cd8 Aug 24 11:31:28.312343 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Project-Name: tempest-VolumesNegativeTest-1253569011 Aug 24 11:31:28.312343 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Role: reader,member Aug 24 11:31:28.312343 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Roles: reader,member Aug 24 11:31:28.315096 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/volume/v3/099fe6c7868e4c2990813036624f4cd8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/volume/v3/099fe6c7868e4c2990813036624f4cd8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/compute/v2/099fe6c7868e4c2990813036624f4cd8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84:8080/v1/AUTH_099fe6c7868e4c2990813036624f4cd8", "adminURL": "http://10.222.0.84:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/placement"}]}] Aug 24 11:31:28.315096 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Tenant: tempest-VolumesNegativeTest-1253569011 Aug 24 11:31:28.315096 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Tenant-Id: 099fe6c7868e4c2990813036624f4cd8 Aug 24 11:31:28.315096 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Tenant-Name: tempest-VolumesNegativeTest-1253569011 Aug 24 11:31:28.315096 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-User: tempest-VolumesNegativeTest-1253569011-project Aug 24 11:31:28.315096 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-User-Domain-Id: default Aug 24 11:31:28.315096 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-User-Domain-Name: Default Aug 24 11:31:28.315096 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-User-Id: 3dd192e05b7b42209a28ee1419827a6d Aug 24 11:31:28.315096 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-User-Name: tempest-VolumesNegativeTest-1253569011-project Aug 24 11:31:28.315096 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: method: Aug 24 11:31:28.315096 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: exception: Volume 9164f141-ee55-4d73-b106-b2e9bc37de3d could not be found. Aug 24 11:31:28.315096 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: action_args: {'id': '9164f141-ee55-4d73-b106-b2e9bc37de3d'} Aug 24 11:31:28.315096 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:31:28.315943 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:31:28.315943 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 11:31:28.315943 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 11:31:28.315943 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 11:31:28.315943 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 11:31:28.315943 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 11:31:28.315943 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 11:31:28.315943 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 11:31:28.315943 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 11:31:28.315943 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 11:31:28.315943 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 11:31:28.315943 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 11:31:28.315943 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 11:31:28.315943 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 11:31:28.315943 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 11:31:28.315943 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9164f141-ee55-4d73-b106-b2e9bc37de3d could not be found. (HTTP 404) (Request-ID: req-4788670b-42f1-4411-8f75-ff63572612fd) Aug 24 11:31:28.315943 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Aug 24 11:31:28.315943 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:31:28.315943 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Aug 24 11:31:28.317277 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:31:28.317277 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 24 11:31:28.317277 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 24 11:31:28.317277 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 11:31:28.317277 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 11:31:28.317277 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 11:31:28.317277 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 11:31:28.317277 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 11:31:28.317277 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 11:31:28.317277 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 11:31:28.317277 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 11:31:28.317277 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 11:31:28.317277 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 11:31:28.317277 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 11:31:28.317277 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 11:31:28.317277 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 11:31:28.317277 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 11:31:28.317277 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 11:31:28.317277 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 11:31:28.318641 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 11:31:28.318641 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 11:31:28.318641 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 11:31:28.318641 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 11:31:28.318641 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9164f141-ee55-4d73-b106-b2e9bc37de3d could not be found. Aug 24 11:31:28.318641 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Aug 24 11:31:28.318641 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:31:28.318641 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Aug 24 11:31:28.318641 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:31:28.318641 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:31:28.318641 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:31:28.318641 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:31:28.318641 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:31:28.318641 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 11:31:28.318641 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 11:31:28.318641 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:31:28.318641 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:31:28.318641 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 24 11:31:28.318641 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:31:28.321431 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9164f141-ee55-4d73-b106-b2e9bc37de3d could not be found. Aug 24 11:31:28.321431 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Aug 24 11:31:28.321431 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:31:28.321431 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Aug 24 11:31:28.321431 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:31:28.321431 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:31:28.321431 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:31:28.321431 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:31:28.321431 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:31:28.321431 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9164f141-ee55-4d73-b106-b2e9bc37de3d could not be found. Aug 24 11:31:28.321431 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Aug 24 11:31:28.321431 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-86527029-5958-4eac-8ad1-0571a949cb37 tempest-VolumesNegativeTest-1253569011 tempest-VolumesNegativeTest-1253569011-project] Returning 404 to user: Volume 9164f141-ee55-4d73-b106-b2e9bc37de3d could not be found. {{(pid=124769) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:31:28.321431 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-86527029-5958-4eac-8ad1-0571a949cb37 tempest-VolumesNegativeTest-1253569011 tempest-VolumesNegativeTest-1253569011-project] 10.222.0.84 "DELETE /compute/v2.1/os-volumes/9164f141-ee55-4d73-b106-b2e9bc37de3d" status: 404 len: 109 microversion: 2.1 time: 0.343683 Aug 24 11:31:28.327749 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 4/7] 10.222.0.84 () {58 vars in 1248 bytes} [Wed Aug 24 11:31:27 2022] DELETE /compute/v2.1/os-volumes/9164f141-ee55-4d73-b106-b2e9bc37de3d => generated 109 bytes in 353 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:31:28.334926 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-1ac2bae6-eb54-4861-89ee-0d7c3adb8384 tempest-VolumesNegativeTest-1253569011 tempest-VolumesNegativeTest-1253569011-project] Calling method '.version_select at 0x7f0e2c353310>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:28.381566 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.wsgi [None req-1ac2bae6-eb54-4861-89ee-0d7c3adb8384 tempest-VolumesNegativeTest-1253569011 tempest-VolumesNegativeTest-1253569011-project] HTTP exception thrown: Volume 6234031d-0299-48a1-a1ba-c3f5a8a076bf could not be found. Aug 24 11:31:28.383689 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-1ac2bae6-eb54-4861-89ee-0d7c3adb8384 tempest-VolumesNegativeTest-1253569011 tempest-VolumesNegativeTest-1253569011-project] Request method failure captured: Aug 24 11:31:28.383689 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: request: GET /compute/v2.1/os-volumes/6234031d-0299-48a1-a1ba-c3f5a8a076bf HTTP/1.1 Aug 24 11:31:28.383689 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Accept: application/json Aug 24 11:31:28.383689 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Accept-Encoding: identity Aug 24 11:31:28.383689 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Connection: close Aug 24 11:31:28.383689 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Content-Length: 0 Aug 24 11:31:28.383689 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Content-Type: application/json Aug 24 11:31:28.383689 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Host: 10.222.0.84 Aug 24 11:31:28.383689 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Openstack-System-Scope: None Aug 24 11:31:28.383689 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: User-Agent: python-urllib3/1.26.11 Aug 24 11:31:28.383689 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Auth-Token: gAAAAABjBgwMXJgpj85QlPM1PYuBoKQZHwXqaqept_XKfIuRBhMQShDLDqjeu5yFp8Tsv_es9aoMufHPhjRIuMnQ3tZLp2fWlBZaboiqu92eF9Sjg7vrL7nSFZBCg_q1im2FpLLEHXPmhxRF9TzGFMhwDhJJr3KSPJDPqcK_WW_B-1--aHdFWw4 Aug 24 11:31:28.383689 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Domain-Id: None Aug 24 11:31:28.383689 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Domain-Name: None Aug 24 11:31:28.383689 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Identity-Status: Confirmed Aug 24 11:31:28.383689 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Is-Admin-Project: True Aug 24 11:31:28.383689 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Project-Domain-Id: default Aug 24 11:31:28.383689 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Project-Domain-Name: Default Aug 24 11:31:28.383689 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Project-Id: 099fe6c7868e4c2990813036624f4cd8 Aug 24 11:31:28.383689 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Project-Name: tempest-VolumesNegativeTest-1253569011 Aug 24 11:31:28.383689 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Role: reader,member Aug 24 11:31:28.383689 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Roles: reader,member Aug 24 11:31:28.385080 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/volume/v3/099fe6c7868e4c2990813036624f4cd8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/volume/v3/099fe6c7868e4c2990813036624f4cd8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/compute/v2/099fe6c7868e4c2990813036624f4cd8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84:8080/v1/AUTH_099fe6c7868e4c2990813036624f4cd8", "adminURL": "http://10.222.0.84:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/placement"}]}] Aug 24 11:31:28.385080 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Tenant: tempest-VolumesNegativeTest-1253569011 Aug 24 11:31:28.385080 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Tenant-Id: 099fe6c7868e4c2990813036624f4cd8 Aug 24 11:31:28.385080 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Tenant-Name: tempest-VolumesNegativeTest-1253569011 Aug 24 11:31:28.385080 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User: tempest-VolumesNegativeTest-1253569011-project Aug 24 11:31:28.385080 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User-Domain-Id: default Aug 24 11:31:28.385080 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User-Domain-Name: Default Aug 24 11:31:28.385080 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User-Id: 3dd192e05b7b42209a28ee1419827a6d Aug 24 11:31:28.385080 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User-Name: tempest-VolumesNegativeTest-1253569011-project Aug 24 11:31:28.385080 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: method: Aug 24 11:31:28.385080 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: exception: Volume 6234031d-0299-48a1-a1ba-c3f5a8a076bf could not be found. Aug 24 11:31:28.385080 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: action_args: {'id': '6234031d-0299-48a1-a1ba-c3f5a8a076bf'} Aug 24 11:31:28.385080 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:31:28.385915 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:31:28.385915 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 11:31:28.385915 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 11:31:28.385915 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 11:31:28.385915 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 11:31:28.385915 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 11:31:28.385915 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 11:31:28.385915 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 11:31:28.385915 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 11:31:28.385915 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 11:31:28.385915 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 11:31:28.385915 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 11:31:28.385915 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 11:31:28.385915 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 11:31:28.385915 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 11:31:28.385915 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6234031d-0299-48a1-a1ba-c3f5a8a076bf could not be found. (HTTP 404) (Request-ID: req-a67bac17-a2b6-4c1c-8697-21d3418c02b2) Aug 24 11:31:28.385915 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:31:28.385915 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:31:28.385915 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:31:28.387138 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:31:28.387138 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 11:31:28.387138 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 11:31:28.387138 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 11:31:28.387138 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 11:31:28.387138 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 11:31:28.387138 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 11:31:28.387138 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 11:31:28.387138 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 11:31:28.387138 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 11:31:28.387138 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 11:31:28.387138 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 11:31:28.387138 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 11:31:28.387138 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 11:31:28.387138 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 11:31:28.387138 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 11:31:28.387138 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 11:31:28.387138 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 11:31:28.387138 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 11:31:28.388202 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 11:31:28.388202 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 11:31:28.388202 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 11:31:28.388202 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 11:31:28.388202 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6234031d-0299-48a1-a1ba-c3f5a8a076bf could not be found. Aug 24 11:31:28.388202 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:31:28.388202 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:31:28.388202 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:31:28.388202 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:31:28.388202 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:31:28.388202 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:31:28.388202 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:31:28.388202 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:31:28.388202 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 11:31:28.388202 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 11:31:28.388202 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:31:28.388202 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:31:28.388202 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 11:31:28.388202 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:31:28.389072 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6234031d-0299-48a1-a1ba-c3f5a8a076bf could not be found. Aug 24 11:31:28.389072 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:31:28.389072 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:31:28.389072 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:31:28.389072 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:31:28.389072 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:31:28.389072 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:31:28.389072 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:31:28.389072 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:31:28.389072 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6234031d-0299-48a1-a1ba-c3f5a8a076bf could not be found. Aug 24 11:31:28.389072 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:31:28.390481 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-1ac2bae6-eb54-4861-89ee-0d7c3adb8384 tempest-VolumesNegativeTest-1253569011 tempest-VolumesNegativeTest-1253569011-project] Returning 404 to user: Volume 6234031d-0299-48a1-a1ba-c3f5a8a076bf could not be found. {{(pid=124770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:31:28.391326 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-1ac2bae6-eb54-4861-89ee-0d7c3adb8384 tempest-VolumesNegativeTest-1253569011 tempest-VolumesNegativeTest-1253569011-project] 10.222.0.84 "GET /compute/v2.1/os-volumes/6234031d-0299-48a1-a1ba-c3f5a8a076bf" status: 404 len: 109 microversion: 2.1 time: 0.061335 Aug 24 11:31:28.392246 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 4/8] 10.222.0.84 () {58 vars in 1245 bytes} [Wed Aug 24 11:31:28 2022] GET /compute/v2.1/os-volumes/6234031d-0299-48a1-a1ba-c3f5a8a076bf => generated 109 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:31:30.252070 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-6af1bf5d-78f5-49ab-bbfd-d4262aa8dca4 tempest-VolumesTestJSON-664408922 tempest-VolumesTestJSON-664408922-project] Calling method '.version_select at 0x7f0e2c351040>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:30.334072 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-6af1bf5d-78f5-49ab-bbfd-d4262aa8dca4 tempest-VolumesTestJSON-664408922 tempest-VolumesTestJSON-664408922-project] 10.222.0.84 "GET /compute/v2.1/os-volumes/29faf261-8fb5-4ed6-bbfc-160f95ef0f04" status: 200 len: 351 microversion: 2.1 time: 0.086395 Aug 24 11:31:30.335543 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 5/9] 10.222.0.84 () {58 vars in 1245 bytes} [Wed Aug 24 11:31:30 2022] GET /compute/v2.1/os-volumes/29faf261-8fb5-4ed6-bbfc-160f95ef0f04 => generated 351 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:31:33.791787 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-1ef809a8-f504-461c-a42f-ad2754bc15d5 tempest-VolumesTestJSON-664408922 tempest-VolumesTestJSON-664408922-project] Calling method '.version_select at 0x7f0e2c3a6c10>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:34.161065 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-1ef809a8-f504-461c-a42f-ad2754bc15d5 tempest-VolumesTestJSON-664408922 tempest-VolumesTestJSON-664408922-project] 10.222.0.84 "GET /compute/v2.1/os-volumes/130b1dc5-faa9-44e0-bcb8-5b32549c24df" status: 200 len: 350 microversion: 2.1 time: 0.384340 Aug 24 11:31:34.161746 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 5/10] 10.222.0.84 () {58 vars in 1245 bytes} [Wed Aug 24 11:31:33 2022] GET /compute/v2.1/os-volumes/130b1dc5-faa9-44e0-bcb8-5b32549c24df => generated 350 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:31:38.060973 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-2b08e419-e0cd-4441-b219-c6a95ba6d6bf tempest-VolumesTestJSON-664408922 tempest-VolumesTestJSON-664408922-project] Calling method '.version_select at 0x7f0e2c351790>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:38.191725 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-2b08e419-e0cd-4441-b219-c6a95ba6d6bf tempest-VolumesTestJSON-664408922 tempest-VolumesTestJSON-664408922-project] 10.222.0.84 "GET /compute/v2.1/os-volumes/17424033-50a5-4224-b942-d67a410e8688" status: 200 len: 351 microversion: 2.1 time: 0.135003 Aug 24 11:31:38.192517 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 6/11] 10.222.0.84 () {58 vars in 1245 bytes} [Wed Aug 24 11:31:38 2022] GET /compute/v2.1/os-volumes/17424033-50a5-4224-b942-d67a410e8688 => generated 351 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:31:38.218719 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-e9f746cb-2645-4b99-b7fc-6961f4ae1cfa tempest-VolumesTestJSON-664408922 tempest-VolumesTestJSON-664408922-project] Calling method '.version_select at 0x7f0e2c353790>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:38.420880 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-e9f746cb-2645-4b99-b7fc-6961f4ae1cfa tempest-VolumesTestJSON-664408922 tempest-VolumesTestJSON-664408922-project] 10.222.0.84 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.211010 Aug 24 11:31:38.421976 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 6/12] 10.222.0.84 () {58 vars in 1134 bytes} [Wed Aug 24 11:31:38 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:31:38.452644 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-9305ddb7-7de3-4d9b-8354-a3e5fe030920 tempest-VolumesTestJSON-664408922 tempest-VolumesTestJSON-664408922-project] Calling method '.version_select at 0x7f0e2c351b80>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:38.750822 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-9305ddb7-7de3-4d9b-8354-a3e5fe030920 tempest-VolumesTestJSON-664408922 tempest-VolumesTestJSON-664408922-project] 10.222.0.84 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.307795 Aug 24 11:31:38.752357 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 7/13] 10.222.0.84 () {58 vars in 1149 bytes} [Wed Aug 24 11:31:38 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:31:38.767348 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-3114e8ab-8031-4fbb-b9c3-1ce132e9a74d tempest-VolumesTestJSON-664408922 tempest-VolumesTestJSON-664408922-project] Calling method '.version_select at 0x7f0e2c3813a0>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:38.945072 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-3114e8ab-8031-4fbb-b9c3-1ce132e9a74d tempest-VolumesTestJSON-664408922 tempest-VolumesTestJSON-664408922-project] 10.222.0.84 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.182647 Aug 24 11:31:38.946195 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 7/14] 10.222.0.84 () {58 vars in 1134 bytes} [Wed Aug 24 11:31:38 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:31:38.959645 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-146c4398-7331-4635-aa6a-8637e9f23540 tempest-VolumesTestJSON-664408922 tempest-VolumesTestJSON-664408922-project] Calling method '.version_select at 0x7f0e2c3671f0>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:39.128202 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-146c4398-7331-4635-aa6a-8637e9f23540 tempest-VolumesTestJSON-664408922 tempest-VolumesTestJSON-664408922-project] 10.222.0.84 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.172617 Aug 24 11:31:39.129148 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 8/15] 10.222.0.84 () {58 vars in 1167 bytes} [Wed Aug 24 11:31:38 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:31:39.146089 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-1c7fd302-d529-4894-8538-914555424b96 tempest-VolumesTestJSON-664408922 tempest-VolumesTestJSON-664408922-project] Calling method '.version_select at 0x7f0e2c3555e0>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:39.346749 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-1c7fd302-d529-4894-8538-914555424b96 tempest-VolumesTestJSON-664408922 tempest-VolumesTestJSON-664408922-project] 10.222.0.84 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.206119 Aug 24 11:31:39.350048 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 8/16] 10.222.0.84 () {58 vars in 1170 bytes} [Wed Aug 24 11:31:39 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:31:39.362888 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-81fed827-7612-423c-8e8c-b4ac8783733c tempest-VolumesTestJSON-664408922 tempest-VolumesTestJSON-664408922-project] Calling method '.version_select at 0x7f0e2c367b80>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:39.575155 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-81fed827-7612-423c-8e8c-b4ac8783733c tempest-VolumesTestJSON-664408922 tempest-VolumesTestJSON-664408922-project] 10.222.0.84 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.216037 Aug 24 11:31:39.575977 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 9/17] 10.222.0.84 () {58 vars in 1155 bytes} [Wed Aug 24 11:31:39 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:31:39.592363 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-63045ab3-c91c-468e-ab15-83f0c7a9b096 tempest-VolumesTestJSON-664408922 tempest-VolumesTestJSON-664408922-project] Calling method '.version_select at 0x7f0e2c3811f0>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:39.764383 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-63045ab3-c91c-468e-ab15-83f0c7a9b096 tempest-VolumesTestJSON-664408922 tempest-VolumesTestJSON-664408922-project] 10.222.0.84 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.176956 Aug 24 11:31:39.765039 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 9/18] 10.222.0.84 () {58 vars in 1188 bytes} [Wed Aug 24 11:31:39 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:31:39.778789 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-563879e9-dabb-4131-8e96-b24168a9dc71 tempest-VolumesTestJSON-664408922 tempest-VolumesTestJSON-664408922-project] Calling method '.version_select at 0x7f0e2c3513a0>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:39.961832 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-563879e9-dabb-4131-8e96-b24168a9dc71 tempest-VolumesTestJSON-664408922 tempest-VolumesTestJSON-664408922-project] 10.222.0.84 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.187030 Aug 24 11:31:39.962652 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 10/19] 10.222.0.84 () {58 vars in 1155 bytes} [Wed Aug 24 11:31:39 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:31:41.205227 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-d8bccdd8-3f43-48af-b82c-b3e512f44864 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1414050893", "imageRef": "028cad80-8f50-4139-b345-dfdca694dc6b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:31:41.452766 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.network.neutron [None req-d8bccdd8-3f43-48af-b82c-b3e512f44864 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] validate_networks() for [('34c53048-be0c-4bb3-ac17-ec4672543fdd', None, None, None, None, None)] {{(pid=124770) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 11:31:43.221387 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-ac994826-a7f9-4240-8770-373ce8705907 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Action: 'create', calling method: .version_select at 0x7f0e2c2ec4c0>, body: {"keypair": {"name": "tempest-keypair-1268508440", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA1Gwc4SLQCKk6SAcxTJ7lJCQ6+XskaUt8KwZDe2xncZMf6a2unFfkzIKCEZMrG7g6hJU0SEBdhy9RA/30bFX0ZaqmUDVsoMSOwVBifgBtFmFI/Cd+474Kb79wQMxKnxXA=="}} {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:31:43.384195 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.quota [None req-ac994826-a7f9-4240-8770-373ce8705907 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Getting quotas for project 4a4159dc366f41bc9e4057a079f6fb5a. Resources: {'key_pairs'} {{(pid=124769) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:31:43.411393 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.quota [None req-ac994826-a7f9-4240-8770-373ce8705907 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Getting quotas for user 2715cf2a5129439c83a5347bb963f1a9 and project 4a4159dc366f41bc9e4057a079f6fb5a. Resources: {'key_pairs'} {{(pid=124769) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:31:43.664700 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-ac994826-a7f9-4240-8770-373ce8705907 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.713949 Aug 24 11:31:43.665722 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 11/20] 10.222.0.84 () {60 vars in 1159 bytes} [Wed Aug 24 11:31:42 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:31:44.629209 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.virt.hardware [None req-d8bccdd8-3f43-48af-b82c-b3e512f44864 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Flavor limits 0:0:0 {{(pid=124770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 11:31:44.630345 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.virt.hardware [None req-d8bccdd8-3f43-48af-b82c-b3e512f44864 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Image limits 0:0:0 {{(pid=124770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 11:31:44.630965 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.virt.hardware [None req-d8bccdd8-3f43-48af-b82c-b3e512f44864 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Flavor pref 0:0:0 {{(pid=124770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 11:31:44.631511 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.virt.hardware [None req-d8bccdd8-3f43-48af-b82c-b3e512f44864 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Image pref 0:0:0 {{(pid=124770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 11:31:44.651875 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.virt.hardware [None req-d8bccdd8-3f43-48af-b82c-b3e512f44864 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 11:31:44.713431 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d8bccdd8-3f43-48af-b82c-b3e512f44864 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:44.713431 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d8bccdd8-3f43-48af-b82c-b3e512f44864 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:44.713431 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d8bccdd8-3f43-48af-b82c-b3e512f44864 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:44.713834 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d8bccdd8-3f43-48af-b82c-b3e512f44864 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:44.714084 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d8bccdd8-3f43-48af-b82c-b3e512f44864 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:44.716698 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d8bccdd8-3f43-48af-b82c-b3e512f44864 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:44.796783 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.quota [None req-d8bccdd8-3f43-48af-b82c-b3e512f44864 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Getting quotas for project 048c7f026f304084960d77bf46f367d8. Resources: {'ram', 'cores', 'instances'} {{(pid=124770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:31:44.831346 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.quota [None req-d8bccdd8-3f43-48af-b82c-b3e512f44864 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Getting quotas for user 2d5bfffc316f481183093e386a326946 and project 048c7f026f304084960d77bf46f367d8. Resources: {'ram', 'cores', 'instances'} {{(pid=124770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:31:44.887596 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-d8bccdd8-3f43-48af-b82c-b3e512f44864 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Going to run 1 instances... {{(pid=124770) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 11:31:44.897241 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-d8bccdd8-3f43-48af-b82c-b3e512f44864 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: 3a7e223c-57dd-4ecc-a81f-9f4802472f4f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='028cad80-8f50-4139-b345-dfdca694dc6b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124770) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 11:31:45.154343 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-d8bccdd8-3f43-48af-b82c-b3e512f44864 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.240991 Aug 24 11:31:45.156763 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 10/21] 10.222.0.84 () {60 vars in 1147 bytes} [Wed Aug 24 11:31:40 2022] POST /compute/v2.1/servers => generated 383 bytes in 4246 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 11:31:45.174041 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-478f92f7-45e4-41b6-b5aa-3159eaad9164 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:45.175721 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-478f92f7-45e4-41b6-b5aa-3159eaad9164 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: 3a7e223c-57dd-4ecc-a81f-9f4802472f4f] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:45.955776 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-867fe64e-e9f7-41f4-b1b2-6a5d1c36a8b5 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-118353770", "imageRef": "028cad80-8f50-4139-b345-dfdca694dc6b", "flavorRef": "452", "networks": [{"uuid": "fb22403a-a514-4808-8d76-e9ebf13a5098"}]}} {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:31:46.019378 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-478f92f7-45e4-41b6-b5aa-3159eaad9164 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:46.061282 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-478f92f7-45e4-41b6-b5aa-3159eaad9164 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/3a7e223c-57dd-4ecc-a81f-9f4802472f4f" status: 200 len: 1222 microversion: 2.1 time: 0.891981 Aug 24 11:31:46.069186 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 11/22] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:31:45 2022] GET /compute/v2.1/servers/3a7e223c-57dd-4ecc-a81f-9f4802472f4f => generated 1222 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:31:46.184735 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.network.neutron [None req-867fe64e-e9f7-41f4-b1b2-6a5d1c36a8b5 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] validate_networks() for [('fb22403a-a514-4808-8d76-e9ebf13a5098', None, None, None, None, None)] {{(pid=124769) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 11:31:46.394048 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-7302fea0-cfa0-415b-9595-ed99f4bffeb1 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Action: 'create', calling method: .version_select at 0x7f0e2b1e7160>, body: {"keypair": {"name": "tempest-keypair-327347914", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIuu055MLJT5VQIYvIt/Ra+uL4w+Gqu1QtcN77EJVAN9ee6LubI/Yiz/Qu33KUfMcPqO7gTd8GhzZ5IiNPCAgHuAgGg6Gd/OMEkyBGqE1124SxX/pb3goiHFgodU4pbOTw=="}} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:31:46.495214 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.quota [None req-7302fea0-cfa0-415b-9595-ed99f4bffeb1 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Getting quotas for project ecec6d0c155f4d658197c4779ab9ffce. Resources: {'key_pairs'} {{(pid=124770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:31:46.512749 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.quota [None req-7302fea0-cfa0-415b-9595-ed99f4bffeb1 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Getting quotas for user 0031939e16194f63b99e6f27f700fa8c and project ecec6d0c155f4d658197c4779ab9ffce. Resources: {'key_pairs'} {{(pid=124770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:31:46.748092 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-7302fea0-cfa0-415b-9595-ed99f4bffeb1 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] 10.222.0.84 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.680673 Aug 24 11:31:46.749092 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 12/23] 10.222.0.84 () {60 vars in 1159 bytes} [Wed Aug 24 11:31:46 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:31:46.762204 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-a548f058-775a-4a56-a47e-39b710105dcb tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1458563459", "imageRef": "028cad80-8f50-4139-b345-dfdca694dc6b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:31:46.843767 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.network.neutron [None req-a548f058-775a-4a56-a47e-39b710105dcb tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] validate_networks() for [('34c53048-be0c-4bb3-ac17-ec4672543fdd', None, None, None, None, None)] {{(pid=124770) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 11:31:48.290076 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.virt.hardware [None req-a548f058-775a-4a56-a47e-39b710105dcb tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Flavor limits 0:0:0 {{(pid=124770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 11:31:48.290694 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.virt.hardware [None req-a548f058-775a-4a56-a47e-39b710105dcb tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Image limits 0:0:0 {{(pid=124770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 11:31:48.291076 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.virt.hardware [None req-a548f058-775a-4a56-a47e-39b710105dcb tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Flavor pref 0:0:0 {{(pid=124770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 11:31:48.291599 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.virt.hardware [None req-a548f058-775a-4a56-a47e-39b710105dcb tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Image pref 0:0:0 {{(pid=124770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 11:31:48.292014 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.virt.hardware [None req-a548f058-775a-4a56-a47e-39b710105dcb tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 11:31:48.303326 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a548f058-775a-4a56-a47e-39b710105dcb tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:48.303810 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a548f058-775a-4a56-a47e-39b710105dcb tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:48.304305 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a548f058-775a-4a56-a47e-39b710105dcb tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:48.305054 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a548f058-775a-4a56-a47e-39b710105dcb tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:48.305504 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a548f058-775a-4a56-a47e-39b710105dcb tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:48.305921 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a548f058-775a-4a56-a47e-39b710105dcb tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:48.377630 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.quota [None req-a548f058-775a-4a56-a47e-39b710105dcb tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Getting quotas for project 048c7f026f304084960d77bf46f367d8. Resources: {'ram', 'cores', 'instances'} {{(pid=124770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:31:48.388965 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.quota [None req-a548f058-775a-4a56-a47e-39b710105dcb tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Getting quotas for user 2d5bfffc316f481183093e386a326946 and project 048c7f026f304084960d77bf46f367d8. Resources: {'ram', 'cores', 'instances'} {{(pid=124770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:31:48.427920 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-a548f058-775a-4a56-a47e-39b710105dcb tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Going to run 1 instances... {{(pid=124770) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 11:31:48.430165 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-a548f058-775a-4a56-a47e-39b710105dcb tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: 2d4527c9-c18c-4028-a452-d23423d9c4ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='028cad80-8f50-4139-b345-dfdca694dc6b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124770) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 11:31:48.629998 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-a548f058-775a-4a56-a47e-39b710105dcb tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.879600 Aug 24 11:31:48.631555 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 13/24] 10.222.0.84 () {60 vars in 1147 bytes} [Wed Aug 24 11:31:46 2022] POST /compute/v2.1/servers => generated 383 bytes in 1882 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 11:31:48.910359 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.virt.hardware [None req-867fe64e-e9f7-41f4-b1b2-6a5d1c36a8b5 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Flavor limits 0:0:0 {{(pid=124769) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 11:31:48.911607 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.virt.hardware [None req-867fe64e-e9f7-41f4-b1b2-6a5d1c36a8b5 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Image limits 0:0:0 {{(pid=124769) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 11:31:48.912290 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.virt.hardware [None req-867fe64e-e9f7-41f4-b1b2-6a5d1c36a8b5 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Flavor pref 0:0:0 {{(pid=124769) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 11:31:48.913115 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.virt.hardware [None req-867fe64e-e9f7-41f4-b1b2-6a5d1c36a8b5 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Image pref 0:0:0 {{(pid=124769) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 11:31:48.918035 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.virt.hardware [None req-867fe64e-e9f7-41f4-b1b2-6a5d1c36a8b5 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124769) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 11:31:48.937258 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-867fe64e-e9f7-41f4-b1b2-6a5d1c36a8b5 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:48.941066 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-867fe64e-e9f7-41f4-b1b2-6a5d1c36a8b5 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:48.941978 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-867fe64e-e9f7-41f4-b1b2-6a5d1c36a8b5 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:48.942989 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-867fe64e-e9f7-41f4-b1b2-6a5d1c36a8b5 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:48.946580 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-867fe64e-e9f7-41f4-b1b2-6a5d1c36a8b5 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:48.947801 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-867fe64e-e9f7-41f4-b1b2-6a5d1c36a8b5 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:49.139846 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.quota [None req-867fe64e-e9f7-41f4-b1b2-6a5d1c36a8b5 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Getting quotas for project 901780013b03485a83261796f69e1b01. Resources: {'ram', 'cores', 'instances'} {{(pid=124769) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:31:49.162882 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.quota [None req-867fe64e-e9f7-41f4-b1b2-6a5d1c36a8b5 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Getting quotas for user 77cef1a9e6a241ac8401b88f4a0f69fe and project 901780013b03485a83261796f69e1b01. Resources: {'ram', 'cores', 'instances'} {{(pid=124769) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:31:49.209628 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-867fe64e-e9f7-41f4-b1b2-6a5d1c36a8b5 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Going to run 1 instances... {{(pid=124769) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 11:31:49.223586 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-867fe64e-e9f7-41f4-b1b2-6a5d1c36a8b5 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] [instance: 07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='028cad80-8f50-4139-b345-dfdca694dc6b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124769) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 11:31:49.402644 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-fdffb5de-af29-4828-9c80-4b06957d1127 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Action: 'create', calling method: .version_select at 0x7f0e2a9ab040>, body: {"keypair": {"name": "tempest-keypair-1374868740", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJFjEXqSzYEL+tHD83jzFO70QT9kIvsKgst3+h+/B0YYH5xliX2zHQOUIiPmcJD8FZMxscA5Lxx6KObWRGAiJKLJ+y/df9HBPdOHomaDwnMkbzKSt/jDlBFatB7E3xrbSg=="}} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:31:49.435969 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.quota [None req-fdffb5de-af29-4828-9c80-4b06957d1127 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Getting quotas for project 177e00cee82c44a196eaf5d0dc07b7f2. Resources: {'key_pairs'} {{(pid=124770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:31:49.451176 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.quota [None req-fdffb5de-af29-4828-9c80-4b06957d1127 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Getting quotas for user 4a80d0127ee349d69f0ed949bcb4c919 and project 177e00cee82c44a196eaf5d0dc07b7f2. Resources: {'key_pairs'} {{(pid=124770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:31:49.527591 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-867fe64e-e9f7-41f4-b1b2-6a5d1c36a8b5 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] 10.222.0.84 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.415195 Aug 24 11:31:49.539619 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 12/25] 10.222.0.84 () {60 vars in 1147 bytes} [Wed Aug 24 11:31:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 4429 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 11:31:49.557281 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-b9c46af3-9595-4c19-9990-373adb1fec66 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:49.572279 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-b9c46af3-9595-4c19-9990-373adb1fec66 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: 2d4527c9-c18c-4028-a452-d23423d9c4ee] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:49.742466 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-fdffb5de-af29-4828-9c80-4b06957d1127 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 1.109402 Aug 24 11:31:49.744724 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 14/26] 10.222.0.84 () {62 vars in 1200 bytes} [Wed Aug 24 11:31:48 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 1112 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 24 11:31:49.758596 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-d95fc8e3-364f-4253-a0a9-cac2770aa7c7 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:49.764335 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-d95fc8e3-364f-4253-a0a9-cac2770aa7c7 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] [instance: 07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:49.831797 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-b9c46af3-9595-4c19-9990-373adb1fec66 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:49.859407 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-b9c46af3-9595-4c19-9990-373adb1fec66 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee" status: 200 len: 1222 microversion: 2.1 time: 0.317150 Aug 24 11:31:49.860900 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 13/27] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:31:49 2022] GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee => generated 1222 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:31:49.955144 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-d95fc8e3-364f-4253-a0a9-cac2770aa7c7 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cef1a9e6a241ac8401b88f4a0f69fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901780013b03485a83261796f69e1b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:49.978097 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-d95fc8e3-364f-4253-a0a9-cac2770aa7c7 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] 10.222.0.84 "GET /compute/v2.1/servers/07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0" status: 200 len: 1214 microversion: 2.1 time: 0.218281 Aug 24 11:31:49.978983 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 15/28] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:31:49 2022] GET /compute/v2.1/servers/07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0 => generated 1214 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:31:50.887834 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-0551bc4e-871f-4c5f-b02e-ee6699b77da8 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:50.888439 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-0551bc4e-871f-4c5f-b02e-ee6699b77da8 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: 2d4527c9-c18c-4028-a452-d23423d9c4ee] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:51.009844 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-68de7678-9566-418e-bbc9-07599c601543 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:51.010554 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-68de7678-9566-418e-bbc9-07599c601543 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] [instance: 07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:51.086240 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-0551bc4e-871f-4c5f-b02e-ee6699b77da8 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:51.109956 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-0551bc4e-871f-4c5f-b02e-ee6699b77da8 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee" status: 200 len: 1222 microversion: 2.1 time: 0.224507 Aug 24 11:31:51.112050 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 14/29] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:31:50 2022] GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee => generated 1222 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:31:51.143100 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-68de7678-9566-418e-bbc9-07599c601543 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cef1a9e6a241ac8401b88f4a0f69fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901780013b03485a83261796f69e1b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:51.153424 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-68de7678-9566-418e-bbc9-07599c601543 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] 10.222.0.84 "GET /compute/v2.1/servers/07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0" status: 200 len: 1214 microversion: 2.1 time: 0.147916 Aug 24 11:31:51.166078 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 16/30] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:31:51 2022] GET /compute/v2.1/servers/07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0 => generated 1214 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:31:52.021136 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-fd9b583b-6aef-45b2-8610-d21e1ffbe2ae tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1716375295", "imageRef": "028cad80-8f50-4139-b345-dfdca694dc6b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1a520e2a-cec7-4c07-8304-e0a7f6eeb34e"}], "security_groups": [{"name": "tempest-securitygroup--829157367"}], "key_name": "tempest-keypair-1268508440", "user_data": "}} {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:31:52.133970 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-533c41c6-76dc-47c0-96d8-9193ee7bc73a tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:52.135155 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-533c41c6-76dc-47c0-96d8-9193ee7bc73a tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: 2d4527c9-c18c-4028-a452-d23423d9c4ee] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:52.153716 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-533c41c6-76dc-47c0-96d8-9193ee7bc73a tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:52.154233 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-533c41c6-76dc-47c0-96d8-9193ee7bc73a tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:52.154683 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-533c41c6-76dc-47c0-96d8-9193ee7bc73a tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:52.160441 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-533c41c6-76dc-47c0-96d8-9193ee7bc73a tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:52.161069 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-533c41c6-76dc-47c0-96d8-9193ee7bc73a tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:52.161528 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-533c41c6-76dc-47c0-96d8-9193ee7bc73a tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:52.365474 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.network.neutron [None req-fd9b583b-6aef-45b2-8610-d21e1ffbe2ae tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] validate_networks() for [('1a520e2a-cec7-4c07-8304-e0a7f6eeb34e', None, None, None, None, None)] {{(pid=124769) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 11:31:52.605546 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-533c41c6-76dc-47c0-96d8-9193ee7bc73a tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:52.652305 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-533c41c6-76dc-47c0-96d8-9193ee7bc73a tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee" status: 200 len: 1218 microversion: 2.1 time: 0.521526 Aug 24 11:31:52.673613 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 17/31] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:31:52 2022] GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee => generated 1218 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:31:52.694536 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-6c0ca100-df7c-4300-a1b9-6faab7cafa35 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:52.698455 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-6c0ca100-df7c-4300-a1b9-6faab7cafa35 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] [instance: 07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:52.739117 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6c0ca100-df7c-4300-a1b9-6faab7cafa35 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:52.741187 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6c0ca100-df7c-4300-a1b9-6faab7cafa35 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:52.741864 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6c0ca100-df7c-4300-a1b9-6faab7cafa35 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:52.744211 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6c0ca100-df7c-4300-a1b9-6faab7cafa35 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:52.745497 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6c0ca100-df7c-4300-a1b9-6faab7cafa35 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:52.747690 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6c0ca100-df7c-4300-a1b9-6faab7cafa35 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:52.998237 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-6c0ca100-df7c-4300-a1b9-6faab7cafa35 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cef1a9e6a241ac8401b88f4a0f69fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901780013b03485a83261796f69e1b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:53.017900 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-6c0ca100-df7c-4300-a1b9-6faab7cafa35 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] 10.222.0.84 "GET /compute/v2.1/servers/07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0" status: 200 len: 1266 microversion: 2.1 time: 0.341184 Aug 24 11:31:53.018984 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 18/32] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:31:52 2022] GET /compute/v2.1/servers/07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0 => generated 1266 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:31:53.041144 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-fd615888-5659-459b-a465-5d0028d3bc81 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1244724634", "imageRef": "028cad80-8f50-4139-b345-dfdca694dc6b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "061f8dd3-1b71-47bb-aa3c-d02369f28b7d"}], "security_groups": [{"name": "tempest-securitygroup--1371577167"}], "key_name": "tempest-keypair-327347914", "user_data": "}} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:31:53.671759 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.virt.hardware [None req-fd9b583b-6aef-45b2-8610-d21e1ffbe2ae tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Flavor limits 0:0:0 {{(pid=124769) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 11:31:53.672323 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.virt.hardware [None req-fd9b583b-6aef-45b2-8610-d21e1ffbe2ae tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Image limits 0:0:0 {{(pid=124769) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 11:31:53.674317 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.virt.hardware [None req-fd9b583b-6aef-45b2-8610-d21e1ffbe2ae tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Flavor pref 0:0:0 {{(pid=124769) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 11:31:53.674745 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.virt.hardware [None req-fd9b583b-6aef-45b2-8610-d21e1ffbe2ae tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Image pref 0:0:0 {{(pid=124769) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 11:31:53.677867 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.virt.hardware [None req-fd9b583b-6aef-45b2-8610-d21e1ffbe2ae tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124769) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 11:31:53.706209 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.network.neutron [None req-fd615888-5659-459b-a465-5d0028d3bc81 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] validate_networks() for [('061f8dd3-1b71-47bb-aa3c-d02369f28b7d', None, None, None, None, None)] {{(pid=124770) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 11:31:53.734525 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-fd9b583b-6aef-45b2-8610-d21e1ffbe2ae tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:53.737691 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-fd9b583b-6aef-45b2-8610-d21e1ffbe2ae tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:53.738431 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-fd9b583b-6aef-45b2-8610-d21e1ffbe2ae tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:53.740646 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-fd9b583b-6aef-45b2-8610-d21e1ffbe2ae tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:53.744007 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-fd9b583b-6aef-45b2-8610-d21e1ffbe2ae tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:53.745119 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-fd9b583b-6aef-45b2-8610-d21e1ffbe2ae tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:53.768441 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.quota [None req-fd9b583b-6aef-45b2-8610-d21e1ffbe2ae tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Getting quotas for project 4a4159dc366f41bc9e4057a079f6fb5a. Resources: {'ram', 'cores', 'instances'} {{(pid=124769) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:31:53.773711 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.quota [None req-fd9b583b-6aef-45b2-8610-d21e1ffbe2ae tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Getting quotas for user 2715cf2a5129439c83a5347bb963f1a9 and project 4a4159dc366f41bc9e4057a079f6fb5a. Resources: {'ram', 'cores', 'instances'} {{(pid=124769) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:31:53.793260 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-fd9b583b-6aef-45b2-8610-d21e1ffbe2ae tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Going to run 1 instances... {{(pid=124769) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 11:31:53.795864 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-fd9b583b-6aef-45b2-8610-d21e1ffbe2ae tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='028cad80-8f50-4139-b345-dfdca694dc6b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124769) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 11:31:54.020332 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-fd9b583b-6aef-45b2-8610-d21e1ffbe2ae tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.005157 Aug 24 11:31:54.022451 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 15/33] 10.222.0.84 () {60 vars in 1147 bytes} [Wed Aug 24 11:31:52 2022] POST /compute/v2.1/servers => generated 401 bytes in 2008 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 11:31:54.028733 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-06b9517f-ed30-4686-8dd7-466a71314b5b tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:54.029758 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-06b9517f-ed30-4686-8dd7-466a71314b5b tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: 2d4527c9-c18c-4028-a452-d23423d9c4ee] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:54.039237 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-06b9517f-ed30-4686-8dd7-466a71314b5b tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:54.040253 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-06b9517f-ed30-4686-8dd7-466a71314b5b tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:54.040981 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-06b9517f-ed30-4686-8dd7-466a71314b5b tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:54.041951 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-06b9517f-ed30-4686-8dd7-466a71314b5b tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:54.042600 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-06b9517f-ed30-4686-8dd7-466a71314b5b tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:54.043292 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-06b9517f-ed30-4686-8dd7-466a71314b5b tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:54.625233 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-06b9517f-ed30-4686-8dd7-466a71314b5b tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:54.672260 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-06b9517f-ed30-4686-8dd7-466a71314b5b tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee" status: 200 len: 1282 microversion: 2.1 time: 0.648039 Aug 24 11:31:54.689457 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 16/34] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:31:54 2022] GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee => generated 1282 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:31:54.712153 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-df24c197-f63f-46bb-ba7d-79d4dd5cf5d0 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:54.714568 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-df24c197-f63f-46bb-ba7d-79d4dd5cf5d0 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:55.189619 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-df24c197-f63f-46bb-ba7d-79d4dd5cf5d0 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2715cf2a5129439c83a5347bb963f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4159dc366f41bc9e4057a079f6fb5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:55.206670 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-df24c197-f63f-46bb-ba7d-79d4dd5cf5d0 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "GET /compute/v2.1/servers/e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311" status: 200 len: 1242 microversion: 2.1 time: 0.517273 Aug 24 11:31:55.207361 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 17/35] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:31:54 2022] GET /compute/v2.1/servers/e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311 => generated 1242 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:31:55.212090 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-efde132d-f431-4226-9813-f4d7c207a838 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:55.212711 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-efde132d-f431-4226-9813-f4d7c207a838 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] [instance: 07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:55.258090 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-efde132d-f431-4226-9813-f4d7c207a838 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:55.258609 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-efde132d-f431-4226-9813-f4d7c207a838 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:55.259130 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-efde132d-f431-4226-9813-f4d7c207a838 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:55.259951 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-efde132d-f431-4226-9813-f4d7c207a838 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:55.260371 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-efde132d-f431-4226-9813-f4d7c207a838 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:55.260864 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-efde132d-f431-4226-9813-f4d7c207a838 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:55.675223 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-efde132d-f431-4226-9813-f4d7c207a838 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cef1a9e6a241ac8401b88f4a0f69fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901780013b03485a83261796f69e1b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:55.686727 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-efde132d-f431-4226-9813-f4d7c207a838 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] 10.222.0.84 "GET /compute/v2.1/servers/07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0" status: 200 len: 1272 microversion: 2.1 time: 0.478197 Aug 24 11:31:55.691111 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 18/36] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:31:55 2022] GET /compute/v2.1/servers/07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0 => generated 1272 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:31:55.711955 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-c4158bd2-696f-4e85-9d3e-45f12649e23b tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:55.713270 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-c4158bd2-696f-4e85-9d3e-45f12649e23b tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: 2d4527c9-c18c-4028-a452-d23423d9c4ee] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:55.724033 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-c4158bd2-696f-4e85-9d3e-45f12649e23b tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:55.724896 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-c4158bd2-696f-4e85-9d3e-45f12649e23b tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:55.726247 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-c4158bd2-696f-4e85-9d3e-45f12649e23b tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:55.727392 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-c4158bd2-696f-4e85-9d3e-45f12649e23b tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:55.728131 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-c4158bd2-696f-4e85-9d3e-45f12649e23b tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:55.764031 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-c4158bd2-696f-4e85-9d3e-45f12649e23b tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.036s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:56.374901 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.virt.hardware [None req-fd615888-5659-459b-a465-5d0028d3bc81 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Flavor limits 0:0:0 {{(pid=124770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 11:31:56.375493 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.virt.hardware [None req-fd615888-5659-459b-a465-5d0028d3bc81 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Image limits 0:0:0 {{(pid=124770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 11:31:56.376399 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.virt.hardware [None req-fd615888-5659-459b-a465-5d0028d3bc81 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Flavor pref 0:0:0 {{(pid=124770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 11:31:56.377106 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.virt.hardware [None req-fd615888-5659-459b-a465-5d0028d3bc81 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Image pref 0:0:0 {{(pid=124770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 11:31:56.377448 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.virt.hardware [None req-fd615888-5659-459b-a465-5d0028d3bc81 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 11:31:56.398386 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-fd615888-5659-459b-a465-5d0028d3bc81 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:56.402302 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-fd615888-5659-459b-a465-5d0028d3bc81 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:56.402302 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-fd615888-5659-459b-a465-5d0028d3bc81 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:56.402302 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-fd615888-5659-459b-a465-5d0028d3bc81 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:56.402302 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-fd615888-5659-459b-a465-5d0028d3bc81 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:56.414491 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-fd615888-5659-459b-a465-5d0028d3bc81 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:56.442678 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-c4158bd2-696f-4e85-9d3e-45f12649e23b tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:56.470523 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.quota [None req-fd615888-5659-459b-a465-5d0028d3bc81 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Getting quotas for project ecec6d0c155f4d658197c4779ab9ffce. Resources: {'ram', 'cores', 'instances'} {{(pid=124770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:31:56.476998 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-c4158bd2-696f-4e85-9d3e-45f12649e23b tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee" status: 200 len: 1280 microversion: 2.1 time: 0.767905 Aug 24 11:31:56.481668 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 19/37] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:31:55 2022] GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee => generated 1280 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:31:56.504529 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-c3a86cc2-d5b7-4321-8eb5-b797707f4c67 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:56.505701 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-c3a86cc2-d5b7-4321-8eb5-b797707f4c67 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:56.512942 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.quota [None req-fd615888-5659-459b-a465-5d0028d3bc81 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Getting quotas for user 0031939e16194f63b99e6f27f700fa8c and project ecec6d0c155f4d658197c4779ab9ffce. Resources: {'ram', 'cores', 'instances'} {{(pid=124770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:31:56.606471 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-fd615888-5659-459b-a465-5d0028d3bc81 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Going to run 1 instances... {{(pid=124770) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 11:31:56.616061 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-fd615888-5659-459b-a465-5d0028d3bc81 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] [instance: 15d4a46e-9504-4897-918d-39aafc20d22a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='028cad80-8f50-4139-b345-dfdca694dc6b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124770) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 11:31:56.709293 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-c3a86cc2-d5b7-4321-8eb5-b797707f4c67 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2715cf2a5129439c83a5347bb963f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4159dc366f41bc9e4057a079f6fb5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:56.715939 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-c3a86cc2-d5b7-4321-8eb5-b797707f4c67 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "GET /compute/v2.1/servers/e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311" status: 200 len: 1242 microversion: 2.1 time: 0.231873 Aug 24 11:31:56.717464 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 20/38] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:31:56 2022] GET /compute/v2.1/servers/e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311 => generated 1242 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:31:56.736966 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-c944aab1-aa69-4be3-955e-3de38db46382 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:56.739558 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-c944aab1-aa69-4be3-955e-3de38db46382 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] [instance: 07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:56.757966 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-c944aab1-aa69-4be3-955e-3de38db46382 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:56.760689 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-c944aab1-aa69-4be3-955e-3de38db46382 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:56.761331 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-c944aab1-aa69-4be3-955e-3de38db46382 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:56.762151 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-c944aab1-aa69-4be3-955e-3de38db46382 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:56.764846 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-c944aab1-aa69-4be3-955e-3de38db46382 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:56.765801 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-c944aab1-aa69-4be3-955e-3de38db46382 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:56.961207 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-fd615888-5659-459b-a465-5d0028d3bc81 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] 10.222.0.84 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.925588 Aug 24 11:31:56.962242 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 19/39] 10.222.0.84 () {60 vars in 1147 bytes} [Wed Aug 24 11:31:53 2022] POST /compute/v2.1/servers => generated 402 bytes in 3928 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 11:31:56.974658 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-c6f1f724-2dd8-4bae-879b-dca79b49d0c9 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:56.979219 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-c6f1f724-2dd8-4bae-879b-dca79b49d0c9 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] [instance: 15d4a46e-9504-4897-918d-39aafc20d22a] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:57.037485 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-c944aab1-aa69-4be3-955e-3de38db46382 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cef1a9e6a241ac8401b88f4a0f69fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901780013b03485a83261796f69e1b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:57.064885 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-c944aab1-aa69-4be3-955e-3de38db46382 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] 10.222.0.84 "GET /compute/v2.1/servers/07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0" status: 200 len: 1272 microversion: 2.1 time: 0.343887 Aug 24 11:31:57.064885 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 21/40] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:31:56 2022] GET /compute/v2.1/servers/07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0 => generated 1272 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:31:57.335213 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-c6f1f724-2dd8-4bae-879b-dca79b49d0c9 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031939e16194f63b99e6f27f700fa8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecec6d0c155f4d658197c4779ab9ffce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:57.381530 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-c6f1f724-2dd8-4bae-879b-dca79b49d0c9 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] 10.222.0.84 "GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a" status: 200 len: 1237 microversion: 2.1 time: 0.398401 Aug 24 11:31:57.402425 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 20/41] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:31:56 2022] GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a => generated 1237 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:31:57.514492 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-ec9d7f25-6c06-4589-aefd-0a3658dd914c tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:57.515921 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-ec9d7f25-6c06-4589-aefd-0a3658dd914c tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: 2d4527c9-c18c-4028-a452-d23423d9c4ee] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:57.547169 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-ec9d7f25-6c06-4589-aefd-0a3658dd914c tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:57.549239 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-ec9d7f25-6c06-4589-aefd-0a3658dd914c tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:57.550751 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-ec9d7f25-6c06-4589-aefd-0a3658dd914c tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:57.551537 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-ec9d7f25-6c06-4589-aefd-0a3658dd914c tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:57.552017 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-ec9d7f25-6c06-4589-aefd-0a3658dd914c tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:57.552453 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-ec9d7f25-6c06-4589-aefd-0a3658dd914c tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:57.740949 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-71a6cf17-7019-4b3b-8455-8a9906b69996 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:57.747466 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-71a6cf17-7019-4b3b-8455-8a9906b69996 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:57.757644 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-71a6cf17-7019-4b3b-8455-8a9906b69996 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:57.758515 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-71a6cf17-7019-4b3b-8455-8a9906b69996 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:57.759189 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-71a6cf17-7019-4b3b-8455-8a9906b69996 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:57.760201 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-71a6cf17-7019-4b3b-8455-8a9906b69996 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:57.761256 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-71a6cf17-7019-4b3b-8455-8a9906b69996 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:57.762028 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-71a6cf17-7019-4b3b-8455-8a9906b69996 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:57.796894 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-ec9d7f25-6c06-4589-aefd-0a3658dd914c tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:57.810078 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-ec9d7f25-6c06-4589-aefd-0a3658dd914c tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee" status: 200 len: 1280 microversion: 2.1 time: 0.307292 Aug 24 11:31:57.829819 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 22/42] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:31:57 2022] GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee => generated 1280 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:31:57.997890 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-71a6cf17-7019-4b3b-8455-8a9906b69996 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2715cf2a5129439c83a5347bb963f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4159dc366f41bc9e4057a079f6fb5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:58.006867 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-71a6cf17-7019-4b3b-8455-8a9906b69996 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "GET /compute/v2.1/servers/e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311" status: 200 len: 1238 microversion: 2.1 time: 0.270438 Aug 24 11:31:58.010105 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 21/43] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:31:57 2022] GET /compute/v2.1/servers/e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311 => generated 1238 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:31:58.086024 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-9df29ed7-b94a-41d0-9998-9507c29bd897 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:58.086790 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-9df29ed7-b94a-41d0-9998-9507c29bd897 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] [instance: 07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:58.124113 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-9df29ed7-b94a-41d0-9998-9507c29bd897 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:58.124639 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-9df29ed7-b94a-41d0-9998-9507c29bd897 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:58.125517 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-9df29ed7-b94a-41d0-9998-9507c29bd897 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:58.126049 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-9df29ed7-b94a-41d0-9998-9507c29bd897 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:58.126518 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-9df29ed7-b94a-41d0-9998-9507c29bd897 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:58.131797 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-9df29ed7-b94a-41d0-9998-9507c29bd897 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:58.423941 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-56685fd6-787f-4c4e-882e-f0eedf306c0e tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:58.424710 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-56685fd6-787f-4c4e-882e-f0eedf306c0e tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] [instance: 15d4a46e-9504-4897-918d-39aafc20d22a] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:58.435201 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-9df29ed7-b94a-41d0-9998-9507c29bd897 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cef1a9e6a241ac8401b88f4a0f69fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901780013b03485a83261796f69e1b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:58.448758 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-9df29ed7-b94a-41d0-9998-9507c29bd897 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] 10.222.0.84 "GET /compute/v2.1/servers/07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0" status: 200 len: 1272 microversion: 2.1 time: 0.367060 Aug 24 11:31:58.456317 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 23/44] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:31:58 2022] GET /compute/v2.1/servers/07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0 => generated 1272 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:31:58.460974 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=11 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:31:58.841994 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-9bf108ff-feff-4c43-b8bc-fd2e26a56c14 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:58.844210 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-9bf108ff-feff-4c43-b8bc-fd2e26a56c14 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: 2d4527c9-c18c-4028-a452-d23423d9c4ee] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:58.854003 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-56685fd6-787f-4c4e-882e-f0eedf306c0e tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031939e16194f63b99e6f27f700fa8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecec6d0c155f4d658197c4779ab9ffce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:58.872417 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-56685fd6-787f-4c4e-882e-f0eedf306c0e tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] 10.222.0.84 "GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a" status: 200 len: 1237 microversion: 2.1 time: 0.452055 Aug 24 11:31:58.875293 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 22/45] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:31:58 2022] GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a => generated 1237 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:31:58.890795 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-9bf108ff-feff-4c43-b8bc-fd2e26a56c14 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:58.892425 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-9bf108ff-feff-4c43-b8bc-fd2e26a56c14 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:58.893226 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-9bf108ff-feff-4c43-b8bc-fd2e26a56c14 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:58.895128 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-9bf108ff-feff-4c43-b8bc-fd2e26a56c14 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:58.895827 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-9bf108ff-feff-4c43-b8bc-fd2e26a56c14 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:58.896502 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-9bf108ff-feff-4c43-b8bc-fd2e26a56c14 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:59.035282 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-80be5a3a-2d49-4dd6-b80a-6b4d5e420dbb tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:59.035911 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-80be5a3a-2d49-4dd6-b80a-6b4d5e420dbb tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:59.065263 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-80be5a3a-2d49-4dd6-b80a-6b4d5e420dbb tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:59.067177 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-80be5a3a-2d49-4dd6-b80a-6b4d5e420dbb tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:59.067659 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-80be5a3a-2d49-4dd6-b80a-6b4d5e420dbb tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:59.075599 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-80be5a3a-2d49-4dd6-b80a-6b4d5e420dbb tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:59.082228 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-80be5a3a-2d49-4dd6-b80a-6b4d5e420dbb tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:59.082835 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-80be5a3a-2d49-4dd6-b80a-6b4d5e420dbb tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:59.332787 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-80be5a3a-2d49-4dd6-b80a-6b4d5e420dbb tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2715cf2a5129439c83a5347bb963f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4159dc366f41bc9e4057a079f6fb5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:59.351384 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-80be5a3a-2d49-4dd6-b80a-6b4d5e420dbb tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "GET /compute/v2.1/servers/e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311" status: 200 len: 1294 microversion: 2.1 time: 0.323117 Aug 24 11:31:59.361211 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 23/46] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:31:59 2022] GET /compute/v2.1/servers/e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311 => generated 1294 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:31:59.375011 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-85485328-4dcc-48b4-b286-1e34e470e52c tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1931801521", "imageRef": "028cad80-8f50-4139-b345-dfdca694dc6b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b03e9a32-741f-4714-819a-fcb9edc6218f"}], "security_groups": [{"name": "tempest-securitygroup--1295589461"}], "key_name": "tempest-keypair-1374868740", "user_data": "}} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:31:59.448029 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-9bf108ff-feff-4c43-b8bc-fd2e26a56c14 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:59.460477 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-9bf108ff-feff-4c43-b8bc-fd2e26a56c14 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee" status: 200 len: 1280 microversion: 2.1 time: 0.626506 Aug 24 11:31:59.485795 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 24/47] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:31:58 2022] GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee => generated 1280 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:31:59.485795 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-42955c75-cd21-495e-abde-7fa5536ce74c tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:59.485795 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-42955c75-cd21-495e-abde-7fa5536ce74c tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] [instance: 07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:59.513097 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-42955c75-cd21-495e-abde-7fa5536ce74c tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:59.516831 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-42955c75-cd21-495e-abde-7fa5536ce74c tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:59.518221 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-42955c75-cd21-495e-abde-7fa5536ce74c tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:59.523933 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-42955c75-cd21-495e-abde-7fa5536ce74c tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:59.525840 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-42955c75-cd21-495e-abde-7fa5536ce74c tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:59.527048 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-42955c75-cd21-495e-abde-7fa5536ce74c tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:00.123804 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.network.neutron [None req-85485328-4dcc-48b4-b286-1e34e470e52c tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] validate_networks() for [('b03e9a32-741f-4714-819a-fcb9edc6218f', None, None, None, None, None)] {{(pid=124770) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 11:32:00.294540 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-42955c75-cd21-495e-abde-7fa5536ce74c tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cef1a9e6a241ac8401b88f4a0f69fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901780013b03485a83261796f69e1b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:00.305751 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-42955c75-cd21-495e-abde-7fa5536ce74c tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] 10.222.0.84 "GET /compute/v2.1/servers/07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0" status: 200 len: 1314 microversion: 2.1 time: 0.833591 Aug 24 11:32:00.310336 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 25/48] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:31:59 2022] GET /compute/v2.1/servers/07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0 => generated 1314 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:00.330044 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-867e789f-c1b6-4c85-9616-91c993201ff6 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:00.330675 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-867e789f-c1b6-4c85-9616-91c993201ff6 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] [instance: 15d4a46e-9504-4897-918d-39aafc20d22a] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:00.360620 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-867e789f-c1b6-4c85-9616-91c993201ff6 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:00.366621 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-867e789f-c1b6-4c85-9616-91c993201ff6 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:00.367543 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-867e789f-c1b6-4c85-9616-91c993201ff6 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:00.372413 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-867e789f-c1b6-4c85-9616-91c993201ff6 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:00.379510 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-867e789f-c1b6-4c85-9616-91c993201ff6 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:00.390470 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-867e789f-c1b6-4c85-9616-91c993201ff6 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:00.728975 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-867e789f-c1b6-4c85-9616-91c993201ff6 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031939e16194f63b99e6f27f700fa8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecec6d0c155f4d658197c4779ab9ffce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:00.746451 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-867e789f-c1b6-4c85-9616-91c993201ff6 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] 10.222.0.84 "GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a" status: 200 len: 1233 microversion: 2.1 time: 0.433632 Aug 24 11:32:00.755730 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 26/49] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:00 2022] GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a => generated 1233 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:00.775118 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-135cef35-cfeb-46ea-8278-38925befa57e tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:00.786682 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-135cef35-cfeb-46ea-8278-38925befa57e tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:00.806588 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-135cef35-cfeb-46ea-8278-38925befa57e tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:00.815990 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-135cef35-cfeb-46ea-8278-38925befa57e tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:00.816762 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-135cef35-cfeb-46ea-8278-38925befa57e tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:00.818168 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-135cef35-cfeb-46ea-8278-38925befa57e tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:00.820967 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-135cef35-cfeb-46ea-8278-38925befa57e tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:00.821526 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-135cef35-cfeb-46ea-8278-38925befa57e tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:01.025770 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-135cef35-cfeb-46ea-8278-38925befa57e tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2715cf2a5129439c83a5347bb963f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4159dc366f41bc9e4057a079f6fb5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:01.036775 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-135cef35-cfeb-46ea-8278-38925befa57e tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "GET /compute/v2.1/servers/e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311" status: 200 len: 1300 microversion: 2.1 time: 0.265532 Aug 24 11:32:01.037410 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 27/50] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:00 2022] GET /compute/v2.1/servers/e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311 => generated 1300 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:01.058245 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-38afb81f-91fc-477d-bf44-e85f9e82fbab tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:01.062540 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-38afb81f-91fc-477d-bf44-e85f9e82fbab tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: 2d4527c9-c18c-4028-a452-d23423d9c4ee] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:01.098051 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-38afb81f-91fc-477d-bf44-e85f9e82fbab tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:01.099393 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-38afb81f-91fc-477d-bf44-e85f9e82fbab tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:01.100860 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-38afb81f-91fc-477d-bf44-e85f9e82fbab tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:01.106574 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-38afb81f-91fc-477d-bf44-e85f9e82fbab tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:01.109168 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-38afb81f-91fc-477d-bf44-e85f9e82fbab tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:01.116122 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-38afb81f-91fc-477d-bf44-e85f9e82fbab tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:02.318770 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-38afb81f-91fc-477d-bf44-e85f9e82fbab tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:02.335888 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-38afb81f-91fc-477d-bf44-e85f9e82fbab tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee" status: 200 len: 1322 microversion: 2.1 time: 1.293059 Aug 24 11:32:02.341230 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 28/51] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:01 2022] GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee => generated 1322 bytes in 1300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:02.347275 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-dde255db-abea-417d-be24-31c969003f82 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:02.347886 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-dde255db-abea-417d-be24-31c969003f82 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] [instance: 07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:02.392061 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-dde255db-abea-417d-be24-31c969003f82 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:02.392061 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-dde255db-abea-417d-be24-31c969003f82 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:02.392061 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-dde255db-abea-417d-be24-31c969003f82 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:02.392061 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-dde255db-abea-417d-be24-31c969003f82 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:02.392601 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-dde255db-abea-417d-be24-31c969003f82 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:02.392601 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-dde255db-abea-417d-be24-31c969003f82 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:02.645274 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.virt.hardware [None req-85485328-4dcc-48b4-b286-1e34e470e52c tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Flavor limits 0:0:0 {{(pid=124770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 11:32:02.645274 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.virt.hardware [None req-85485328-4dcc-48b4-b286-1e34e470e52c tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Image limits 0:0:0 {{(pid=124770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 11:32:02.645274 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.virt.hardware [None req-85485328-4dcc-48b4-b286-1e34e470e52c tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Flavor pref 0:0:0 {{(pid=124770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 11:32:02.646455 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.virt.hardware [None req-85485328-4dcc-48b4-b286-1e34e470e52c tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Image pref 0:0:0 {{(pid=124770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 11:32:02.652959 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.virt.hardware [None req-85485328-4dcc-48b4-b286-1e34e470e52c tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 11:32:02.675594 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-85485328-4dcc-48b4-b286-1e34e470e52c tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:02.676267 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-85485328-4dcc-48b4-b286-1e34e470e52c tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:02.677285 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-85485328-4dcc-48b4-b286-1e34e470e52c tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:02.678368 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-85485328-4dcc-48b4-b286-1e34e470e52c tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:02.679135 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-85485328-4dcc-48b4-b286-1e34e470e52c tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:02.679760 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-85485328-4dcc-48b4-b286-1e34e470e52c tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:02.706959 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.quota [None req-85485328-4dcc-48b4-b286-1e34e470e52c tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Getting quotas for project 177e00cee82c44a196eaf5d0dc07b7f2. Resources: {'ram', 'cores', 'instances'} {{(pid=124770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:32:02.713709 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.quota [None req-85485328-4dcc-48b4-b286-1e34e470e52c tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Getting quotas for user 4a80d0127ee349d69f0ed949bcb4c919 and project 177e00cee82c44a196eaf5d0dc07b7f2. Resources: {'ram', 'cores', 'instances'} {{(pid=124770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:32:02.750664 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-85485328-4dcc-48b4-b286-1e34e470e52c tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Going to run 1 instances... {{(pid=124770) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 11:32:02.754949 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-85485328-4dcc-48b4-b286-1e34e470e52c tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: 2e661217-fb1a-48ad-9f1b-47985a4074de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='028cad80-8f50-4139-b345-dfdca694dc6b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124770) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 11:32:03.013119 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-85485328-4dcc-48b4-b286-1e34e470e52c tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 3.658483 Aug 24 11:32:03.016874 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 24/52] 10.222.0.84 () {62 vars in 1188 bytes} [Wed Aug 24 11:31:59 2022] POST /compute/v2.1/servers => generated 402 bytes in 3662 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 24 11:32:03.032384 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-16f0b5a9-e5fd-42e4-9618-9c7c6366bc25 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:03.033507 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-16f0b5a9-e5fd-42e4-9618-9c7c6366bc25 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] [instance: 15d4a46e-9504-4897-918d-39aafc20d22a] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:03.053830 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-16f0b5a9-e5fd-42e4-9618-9c7c6366bc25 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:03.054814 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-16f0b5a9-e5fd-42e4-9618-9c7c6366bc25 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:03.055575 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-16f0b5a9-e5fd-42e4-9618-9c7c6366bc25 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:03.057294 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-16f0b5a9-e5fd-42e4-9618-9c7c6366bc25 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:03.058913 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-16f0b5a9-e5fd-42e4-9618-9c7c6366bc25 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:03.059701 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-16f0b5a9-e5fd-42e4-9618-9c7c6366bc25 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:03.487171 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-dde255db-abea-417d-be24-31c969003f82 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cef1a9e6a241ac8401b88f4a0f69fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901780013b03485a83261796f69e1b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:03.507030 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-dde255db-abea-417d-be24-31c969003f82 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] 10.222.0.84 "GET /compute/v2.1/servers/07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0" status: 200 len: 1314 microversion: 2.1 time: 1.164486 Aug 24 11:32:03.511356 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 29/53] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:02 2022] GET /compute/v2.1/servers/07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0 => generated 1314 bytes in 1168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:03.539972 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-07f5fa76-3e70-40c5-9e58-6ed52eb22bcb tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:03.552223 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-07f5fa76-3e70-40c5-9e58-6ed52eb22bcb tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:03.575820 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-07f5fa76-3e70-40c5-9e58-6ed52eb22bcb tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:03.577357 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-07f5fa76-3e70-40c5-9e58-6ed52eb22bcb tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:03.580055 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-07f5fa76-3e70-40c5-9e58-6ed52eb22bcb tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:03.588784 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-07f5fa76-3e70-40c5-9e58-6ed52eb22bcb tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:03.597767 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-07f5fa76-3e70-40c5-9e58-6ed52eb22bcb tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:03.602669 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-07f5fa76-3e70-40c5-9e58-6ed52eb22bcb tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:03.754872 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG dbcounter [-] [124769] Writing DB stats nova_cell0:SELECT=4 {{(pid=124769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:03.876920 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-16f0b5a9-e5fd-42e4-9618-9c7c6366bc25 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031939e16194f63b99e6f27f700fa8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecec6d0c155f4d658197c4779ab9ffce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:03.890323 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-16f0b5a9-e5fd-42e4-9618-9c7c6366bc25 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] 10.222.0.84 "GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a" status: 200 len: 1297 microversion: 2.1 time: 0.868292 Aug 24 11:32:03.891421 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 25/54] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:03 2022] GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a => generated 1297 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:03.916242 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-270d3b2b-204b-498a-bc65-3bb086571252 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:03.938703 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-07f5fa76-3e70-40c5-9e58-6ed52eb22bcb tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2715cf2a5129439c83a5347bb963f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4159dc366f41bc9e4057a079f6fb5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:03.939549 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-270d3b2b-204b-498a-bc65-3bb086571252 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: 2e661217-fb1a-48ad-9f1b-47985a4074de] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:03.949855 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-07f5fa76-3e70-40c5-9e58-6ed52eb22bcb tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "GET /compute/v2.1/servers/e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311" status: 200 len: 1300 microversion: 2.1 time: 0.436494 Aug 24 11:32:03.963879 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 30/55] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:03 2022] GET /compute/v2.1/servers/e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311 => generated 1300 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:03.982852 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-8bef68a0-c1aa-4f55-a004-e2a74e9a3a21 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:03.984323 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-8bef68a0-c1aa-4f55-a004-e2a74e9a3a21 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: 2d4527c9-c18c-4028-a452-d23423d9c4ee] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:04.004840 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-8bef68a0-c1aa-4f55-a004-e2a74e9a3a21 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:04.005668 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-8bef68a0-c1aa-4f55-a004-e2a74e9a3a21 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:04.006656 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-8bef68a0-c1aa-4f55-a004-e2a74e9a3a21 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:04.008569 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-8bef68a0-c1aa-4f55-a004-e2a74e9a3a21 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:04.011559 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-8bef68a0-c1aa-4f55-a004-e2a74e9a3a21 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:04.012939 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-8bef68a0-c1aa-4f55-a004-e2a74e9a3a21 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:04.502953 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-270d3b2b-204b-498a-bc65-3bb086571252 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:04.520733 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-270d3b2b-204b-498a-bc65-3bb086571252 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:04.526698 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-270d3b2b-204b-498a-bc65-3bb086571252 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:04.530097 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-270d3b2b-204b-498a-bc65-3bb086571252 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de" status: 200 len: 1282 microversion: 2.20 time: 0.635533 Aug 24 11:32:04.538972 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 26/56] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:32:03 2022] GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de => generated 1282 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:32:04.683059 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-8bef68a0-c1aa-4f55-a004-e2a74e9a3a21 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:04.697693 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-8bef68a0-c1aa-4f55-a004-e2a74e9a3a21 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee" status: 200 len: 1322 microversion: 2.1 time: 0.732123 Aug 24 11:32:04.700984 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 31/57] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:03 2022] GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee => generated 1322 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:04.708041 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-487cc7f3-c049-49ed-9bb7-28225872cdf4 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:04.713719 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-487cc7f3-c049-49ed-9bb7-28225872cdf4 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] [instance: 07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:04.726656 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-487cc7f3-c049-49ed-9bb7-28225872cdf4 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:04.727573 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-487cc7f3-c049-49ed-9bb7-28225872cdf4 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:04.728160 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-487cc7f3-c049-49ed-9bb7-28225872cdf4 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:04.729170 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-487cc7f3-c049-49ed-9bb7-28225872cdf4 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:04.729845 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-487cc7f3-c049-49ed-9bb7-28225872cdf4 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:04.731061 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-487cc7f3-c049-49ed-9bb7-28225872cdf4 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:04.958908 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [req-9f7b7b27-b194-41ca-95c0-f7dda1e5ca37 req-07cbb58a-005a-44cd-9883-5d579e3a47ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a7e223c-57dd-4ecc-a81f-9f4802472f4f", "tag": "ec53573c-c069-4fd3-ba2f-e0ddb8ebc30f"}]} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:32:05.032494 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-9f7b7b27-b194-41ca-95c0-f7dda1e5ca37 req-07cbb58a-005a-44cd-9883-5d579e3a47ab service nova] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:05.033964 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-9f7b7b27-b194-41ca-95c0-f7dda1e5ca37 req-07cbb58a-005a-44cd-9883-5d579e3a47ab service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:05.034993 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-9f7b7b27-b194-41ca-95c0-f7dda1e5ca37 req-07cbb58a-005a-44cd-9883-5d579e3a47ab service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:05.131088 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.compute.server_external_events [req-9f7b7b27-b194-41ca-95c0-f7dda1e5ca37 req-07cbb58a-005a-44cd-9883-5d579e3a47ab service nova] Creating event network-changed:ec53573c-c069-4fd3-ba2f-e0ddb8ebc30f for instance 3a7e223c-57dd-4ecc-a81f-9f4802472f4f on hv-cinder-85427 Aug 24 11:32:05.131942 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-9f7b7b27-b194-41ca-95c0-f7dda1e5ca37 req-07cbb58a-005a-44cd-9883-5d579e3a47ab service nova] Acquiring lock "compute-rpcapi-router" {{(pid=124770) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 24 11:32:05.136083 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-9f7b7b27-b194-41ca-95c0-f7dda1e5ca37 req-07cbb58a-005a-44cd-9883-5d579e3a47ab service nova] Acquired lock "compute-rpcapi-router" {{(pid=124770) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 24 11:32:05.136083 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1d805fad-f288-4f0b-baac-4371f8a990a7 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:05.136083 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1d805fad-f288-4f0b-baac-4371f8a990a7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:05.136083 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1d805fad-f288-4f0b-baac-4371f8a990a7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:05.136466 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1d805fad-f288-4f0b-baac-4371f8a990a7 None None] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:05.136636 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1d805fad-f288-4f0b-baac-4371f8a990a7 None None] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:05.137350 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1d805fad-f288-4f0b-baac-4371f8a990a7 None None] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:05.159192 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.compute.rpcapi [None req-1d805fad-f288-4f0b-baac-4371f8a990a7 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 24 11:32:05.160464 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1d805fad-f288-4f0b-baac-4371f8a990a7 None None] Releasing lock "compute-rpcapi-router" {{(pid=124770) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 24 11:32:05.214668 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-1d805fad-f288-4f0b-baac-4371f8a990a7 None None] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.673140 Aug 24 11:32:05.217781 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 27/58] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Aug 24 11:32:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:32:05.245422 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-fc1529ec-ae33-4c30-b6be-68e5b362375a tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:05.246523 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-fc1529ec-ae33-4c30-b6be-68e5b362375a tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] [instance: 15d4a46e-9504-4897-918d-39aafc20d22a] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:05.257003 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-fc1529ec-ae33-4c30-b6be-68e5b362375a tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:05.259881 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-fc1529ec-ae33-4c30-b6be-68e5b362375a tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:05.260339 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-fc1529ec-ae33-4c30-b6be-68e5b362375a tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:05.261119 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-fc1529ec-ae33-4c30-b6be-68e5b362375a tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:05.261585 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-fc1529ec-ae33-4c30-b6be-68e5b362375a tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:05.262063 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-fc1529ec-ae33-4c30-b6be-68e5b362375a tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:05.406427 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-487cc7f3-c049-49ed-9bb7-28225872cdf4 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cef1a9e6a241ac8401b88f4a0f69fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901780013b03485a83261796f69e1b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:05.424353 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-487cc7f3-c049-49ed-9bb7-28225872cdf4 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] 10.222.0.84 "GET /compute/v2.1/servers/07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0" status: 200 len: 1314 microversion: 2.1 time: 0.721935 Aug 24 11:32:05.440277 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 32/59] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:04 2022] GET /compute/v2.1/servers/07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0 => generated 1314 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:05.541183 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-fc1529ec-ae33-4c30-b6be-68e5b362375a tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031939e16194f63b99e6f27f700fa8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecec6d0c155f4d658197c4779ab9ffce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:05.563860 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-fc1529ec-ae33-4c30-b6be-68e5b362375a tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] 10.222.0.84 "GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a" status: 200 len: 1295 microversion: 2.1 time: 0.342621 Aug 24 11:32:05.568710 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 28/60] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:05 2022] GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a => generated 1295 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:05.583128 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-2dbe6abb-86f4-4c9b-87a7-8e163d0c2327 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:05.583968 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-2dbe6abb-86f4-4c9b-87a7-8e163d0c2327 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:05.597491 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-2dbe6abb-86f4-4c9b-87a7-8e163d0c2327 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:05.597983 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-2dbe6abb-86f4-4c9b-87a7-8e163d0c2327 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:05.618456 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-2dbe6abb-86f4-4c9b-87a7-8e163d0c2327 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:05.620073 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-2dbe6abb-86f4-4c9b-87a7-8e163d0c2327 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:05.620958 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-2dbe6abb-86f4-4c9b-87a7-8e163d0c2327 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:05.621732 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-2dbe6abb-86f4-4c9b-87a7-8e163d0c2327 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:06.074708 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [req-65dff65f-591f-400b-b446-b6d69a974349 req-8ff84ac0-8841-4755-a25d-af57095ed67e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0", "tag": "6b1e0c30-55ba-4a63-afed-d5e130d41fb3"}]} {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:32:06.119280 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [req-65dff65f-591f-400b-b446-b6d69a974349 req-8ff84ac0-8841-4755-a25d-af57095ed67e service nova] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:06.120176 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [req-65dff65f-591f-400b-b446-b6d69a974349 req-8ff84ac0-8841-4755-a25d-af57095ed67e service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:06.120866 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [req-65dff65f-591f-400b-b446-b6d69a974349 req-8ff84ac0-8841-4755-a25d-af57095ed67e service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:06.189386 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.compute.server_external_events [req-65dff65f-591f-400b-b446-b6d69a974349 req-8ff84ac0-8841-4755-a25d-af57095ed67e service nova] Creating event network-changed:6b1e0c30-55ba-4a63-afed-d5e130d41fb3 for instance 07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0 on hv-cinder-85427 Aug 24 11:32:06.190973 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [req-65dff65f-591f-400b-b446-b6d69a974349 req-8ff84ac0-8841-4755-a25d-af57095ed67e service nova] Acquiring lock "compute-rpcapi-router" {{(pid=124769) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 24 11:32:06.192527 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [req-65dff65f-591f-400b-b446-b6d69a974349 req-8ff84ac0-8841-4755-a25d-af57095ed67e service nova] Acquired lock "compute-rpcapi-router" {{(pid=124769) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 24 11:32:06.194009 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-fff88180-a82d-4b37-ae27-28eaaf6eb996 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:06.197907 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-fff88180-a82d-4b37-ae27-28eaaf6eb996 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:06.199440 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-fff88180-a82d-4b37-ae27-28eaaf6eb996 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:06.204107 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-fff88180-a82d-4b37-ae27-28eaaf6eb996 None None] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:06.209316 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-fff88180-a82d-4b37-ae27-28eaaf6eb996 None None] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:06.212356 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-fff88180-a82d-4b37-ae27-28eaaf6eb996 None None] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:06.261104 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.compute.rpcapi [None req-fff88180-a82d-4b37-ae27-28eaaf6eb996 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 24 11:32:06.262345 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-fff88180-a82d-4b37-ae27-28eaaf6eb996 None None] Releasing lock "compute-rpcapi-router" {{(pid=124769) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 24 11:32:06.298699 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-fff88180-a82d-4b37-ae27-28eaaf6eb996 None None] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.856639 Aug 24 11:32:06.299848 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 33/61] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Aug 24 11:32:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:32:06.307434 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-91dce179-d37d-49a8-9d82-e486b320ace7 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:06.309876 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-91dce179-d37d-49a8-9d82-e486b320ace7 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: 2e661217-fb1a-48ad-9f1b-47985a4074de] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:06.327859 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-91dce179-d37d-49a8-9d82-e486b320ace7 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:06.328728 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-91dce179-d37d-49a8-9d82-e486b320ace7 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:06.329598 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-91dce179-d37d-49a8-9d82-e486b320ace7 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:06.332093 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-91dce179-d37d-49a8-9d82-e486b320ace7 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:06.334905 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-91dce179-d37d-49a8-9d82-e486b320ace7 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:06.335507 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-91dce179-d37d-49a8-9d82-e486b320ace7 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:06.349104 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG dbcounter [-] [124769] Writing DB stats nova_cell1:SELECT=100 {{(pid=124769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:06.623230 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-91dce179-d37d-49a8-9d82-e486b320ace7 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:06.634202 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-91dce179-d37d-49a8-9d82-e486b320ace7 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:06.636598 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-91dce179-d37d-49a8-9d82-e486b320ace7 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:06.649985 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-91dce179-d37d-49a8-9d82-e486b320ace7 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de" status: 200 len: 1334 microversion: 2.20 time: 0.348692 Aug 24 11:32:06.665265 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 34/62] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:32:06 2022] GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de => generated 1334 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:32:06.681590 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-929c29ae-a23b-4253-9b76-87df28bc7ba1 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:06.684315 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-929c29ae-a23b-4253-9b76-87df28bc7ba1 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: 2d4527c9-c18c-4028-a452-d23423d9c4ee] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:06.710327 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-929c29ae-a23b-4253-9b76-87df28bc7ba1 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:06.710694 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-929c29ae-a23b-4253-9b76-87df28bc7ba1 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:06.711137 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-929c29ae-a23b-4253-9b76-87df28bc7ba1 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:06.718949 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-929c29ae-a23b-4253-9b76-87df28bc7ba1 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:06.720312 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-929c29ae-a23b-4253-9b76-87df28bc7ba1 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:06.721072 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-929c29ae-a23b-4253-9b76-87df28bc7ba1 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:06.721971 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG dbcounter [-] [124769] Writing DB stats nova_cell0:SELECT=24 {{(pid=124769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:07.148679 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-2dbe6abb-86f4-4c9b-87a7-8e163d0c2327 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2715cf2a5129439c83a5347bb963f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4159dc366f41bc9e4057a079f6fb5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:07.169054 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-2dbe6abb-86f4-4c9b-87a7-8e163d0c2327 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "GET /compute/v2.1/servers/e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311" status: 200 len: 1367 microversion: 2.1 time: 1.603060 Aug 24 11:32:07.181879 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 29/63] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:05 2022] GET /compute/v2.1/servers/e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311 => generated 1367 bytes in 1616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:07.200711 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-ccaa60f1-f69a-4ad4-9ef1-ed6e29a708f3 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:07.206707 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-ccaa60f1-f69a-4ad4-9ef1-ed6e29a708f3 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] [instance: 07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:07.215809 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ccaa60f1-f69a-4ad4-9ef1-ed6e29a708f3 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:07.220437 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ccaa60f1-f69a-4ad4-9ef1-ed6e29a708f3 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:07.221273 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ccaa60f1-f69a-4ad4-9ef1-ed6e29a708f3 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:07.222407 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ccaa60f1-f69a-4ad4-9ef1-ed6e29a708f3 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:07.223068 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ccaa60f1-f69a-4ad4-9ef1-ed6e29a708f3 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:07.228021 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ccaa60f1-f69a-4ad4-9ef1-ed6e29a708f3 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:07.476849 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-929c29ae-a23b-4253-9b76-87df28bc7ba1 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:07.476849 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-929c29ae-a23b-4253-9b76-87df28bc7ba1 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee" status: 200 len: 1322 microversion: 2.1 time: 0.754343 Aug 24 11:32:07.476849 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 35/64] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:06 2022] GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee => generated 1322 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:07.476849 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-ddc5e675-79ad-4d13-8778-cf7d11f2a559 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:07.478397 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-ddc5e675-79ad-4d13-8778-cf7d11f2a559 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] [instance: 15d4a46e-9504-4897-918d-39aafc20d22a] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:07.478397 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG dbcounter [-] [124769] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=124769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:07.478397 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-ddc5e675-79ad-4d13-8778-cf7d11f2a559 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:07.478397 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-ddc5e675-79ad-4d13-8778-cf7d11f2a559 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:07.479457 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-ddc5e675-79ad-4d13-8778-cf7d11f2a559 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:07.479457 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-ddc5e675-79ad-4d13-8778-cf7d11f2a559 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:07.479457 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-ddc5e675-79ad-4d13-8778-cf7d11f2a559 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:07.479457 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-ddc5e675-79ad-4d13-8778-cf7d11f2a559 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:07.629977 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-ddc5e675-79ad-4d13-8778-cf7d11f2a559 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031939e16194f63b99e6f27f700fa8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecec6d0c155f4d658197c4779ab9ffce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:07.646973 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-ddc5e675-79ad-4d13-8778-cf7d11f2a559 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] 10.222.0.84 "GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a" status: 200 len: 1295 microversion: 2.1 time: 0.215231 Aug 24 11:32:07.649543 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 36/65] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:07 2022] GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a => generated 1295 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:07.707345 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-1bc17eba-f337-4d67-b32a-c93420d56893 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:07.707345 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-1bc17eba-f337-4d67-b32a-c93420d56893 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: 2e661217-fb1a-48ad-9f1b-47985a4074de] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:07.707345 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-1bc17eba-f337-4d67-b32a-c93420d56893 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:07.707345 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-1bc17eba-f337-4d67-b32a-c93420d56893 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:07.708040 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-1bc17eba-f337-4d67-b32a-c93420d56893 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:07.708040 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-1bc17eba-f337-4d67-b32a-c93420d56893 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:07.708040 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-1bc17eba-f337-4d67-b32a-c93420d56893 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:07.708040 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-1bc17eba-f337-4d67-b32a-c93420d56893 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:07.900765 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-1bc17eba-f337-4d67-b32a-c93420d56893 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:07.973234 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-ccaa60f1-f69a-4ad4-9ef1-ed6e29a708f3 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cef1a9e6a241ac8401b88f4a0f69fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901780013b03485a83261796f69e1b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:07.974365 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-1bc17eba-f337-4d67-b32a-c93420d56893 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:07.979664 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-1bc17eba-f337-4d67-b32a-c93420d56893 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:07.991850 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-1bc17eba-f337-4d67-b32a-c93420d56893 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de" status: 200 len: 1334 microversion: 2.20 time: 0.304729 Aug 24 11:32:07.994079 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 37/66] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:32:07 2022] GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de => generated 1334 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 11:32:08.002422 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-ccaa60f1-f69a-4ad4-9ef1-ed6e29a708f3 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] 10.222.0.84 "GET /compute/v2.1/servers/07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0" status: 200 len: 1314 microversion: 2.1 time: 0.818945 Aug 24 11:32:08.005036 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 30/67] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:07 2022] GET /compute/v2.1/servers/07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0 => generated 1314 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:08.198071 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-422ee58b-3c6e-404a-a140-5bc5e079f15f tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:08.198884 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-422ee58b-3c6e-404a-a140-5bc5e079f15f tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:08.211675 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-422ee58b-3c6e-404a-a140-5bc5e079f15f tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:08.212427 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-422ee58b-3c6e-404a-a140-5bc5e079f15f tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:08.213113 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-422ee58b-3c6e-404a-a140-5bc5e079f15f tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:08.213996 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-422ee58b-3c6e-404a-a140-5bc5e079f15f tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:08.214910 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-422ee58b-3c6e-404a-a140-5bc5e079f15f tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:08.215488 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-422ee58b-3c6e-404a-a140-5bc5e079f15f tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:08.401179 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [req-e8b84008-37ca-4f79-bffc-788595b36d6e req-667d6283-88b2-4430-a615-cd495f8161eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d4527c9-c18c-4028-a452-d23423d9c4ee", "tag": "e12ef962-191c-4cfc-8320-f430d725d0bb"}]} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:32:08.415715 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-e8b84008-37ca-4f79-bffc-788595b36d6e req-667d6283-88b2-4430-a615-cd495f8161eb service nova] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:08.416678 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-e8b84008-37ca-4f79-bffc-788595b36d6e req-667d6283-88b2-4430-a615-cd495f8161eb service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:08.417441 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-e8b84008-37ca-4f79-bffc-788595b36d6e req-667d6283-88b2-4430-a615-cd495f8161eb service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:08.427613 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_cell1:SELECT=61 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:08.440985 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.compute.server_external_events [req-e8b84008-37ca-4f79-bffc-788595b36d6e req-667d6283-88b2-4430-a615-cd495f8161eb service nova] Creating event network-changed:e12ef962-191c-4cfc-8320-f430d725d0bb for instance 2d4527c9-c18c-4028-a452-d23423d9c4ee on hv-cinder-85427 Aug 24 11:32:08.456548 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [req-e8b84008-37ca-4f79-bffc-788595b36d6e req-667d6283-88b2-4430-a615-cd495f8161eb service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060087 Aug 24 11:32:08.528634 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 31/68] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Aug 24 11:32:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:32:08.528634 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-75af248a-2498-4056-9e53-76f33ffa0af9 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:08.528634 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-75af248a-2498-4056-9e53-76f33ffa0af9 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: 2d4527c9-c18c-4028-a452-d23423d9c4ee] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:08.528634 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-75af248a-2498-4056-9e53-76f33ffa0af9 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:08.529345 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-75af248a-2498-4056-9e53-76f33ffa0af9 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:08.529345 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-75af248a-2498-4056-9e53-76f33ffa0af9 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:08.529345 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-75af248a-2498-4056-9e53-76f33ffa0af9 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:08.529345 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-75af248a-2498-4056-9e53-76f33ffa0af9 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:08.530113 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-75af248a-2498-4056-9e53-76f33ffa0af9 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:08.530288 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-422ee58b-3c6e-404a-a140-5bc5e079f15f tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2715cf2a5129439c83a5347bb963f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4159dc366f41bc9e4057a079f6fb5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:08.530288 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-422ee58b-3c6e-404a-a140-5bc5e079f15f tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "GET /compute/v2.1/servers/e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311" status: 200 len: 1367 microversion: 2.1 time: 0.328688 Aug 24 11:32:08.530288 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 38/69] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:08 2022] GET /compute/v2.1/servers/e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311 => generated 1367 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:08.670970 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-3136e616-8a8a-4241-8167-6af483368eb1 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:08.672651 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-3136e616-8a8a-4241-8167-6af483368eb1 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] [instance: 15d4a46e-9504-4897-918d-39aafc20d22a] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:08.684583 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-3136e616-8a8a-4241-8167-6af483368eb1 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:08.685457 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-3136e616-8a8a-4241-8167-6af483368eb1 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:08.686160 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-3136e616-8a8a-4241-8167-6af483368eb1 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:08.687091 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-3136e616-8a8a-4241-8167-6af483368eb1 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:08.687819 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-3136e616-8a8a-4241-8167-6af483368eb1 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:08.689047 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-3136e616-8a8a-4241-8167-6af483368eb1 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:08.790619 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-3136e616-8a8a-4241-8167-6af483368eb1 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031939e16194f63b99e6f27f700fa8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecec6d0c155f4d658197c4779ab9ffce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:08.804373 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-3136e616-8a8a-4241-8167-6af483368eb1 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] 10.222.0.84 "GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a" status: 200 len: 1295 microversion: 2.1 time: 0.137475 Aug 24 11:32:08.819915 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 39/70] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:08 2022] GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a => generated 1295 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:08.834775 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-75af248a-2498-4056-9e53-76f33ffa0af9 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:08.849156 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-75af248a-2498-4056-9e53-76f33ffa0af9 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee" status: 200 len: 1322 microversion: 2.1 time: 0.361461 Aug 24 11:32:08.849156 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 32/71] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:08 2022] GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee => generated 1322 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:09.023174 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-4a83e9d2-5eef-40b5-93a7-8626f8f974b1 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:09.023799 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-4a83e9d2-5eef-40b5-93a7-8626f8f974b1 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: 2e661217-fb1a-48ad-9f1b-47985a4074de] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:09.035185 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-3412acb7-7f2c-48e4-84b0-8267618b8623 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:09.035185 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-3412acb7-7f2c-48e4-84b0-8267618b8623 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] [instance: 07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:09.043174 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-4a83e9d2-5eef-40b5-93a7-8626f8f974b1 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:09.046387 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-4a83e9d2-5eef-40b5-93a7-8626f8f974b1 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:09.046874 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-4a83e9d2-5eef-40b5-93a7-8626f8f974b1 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:09.055741 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-4a83e9d2-5eef-40b5-93a7-8626f8f974b1 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:09.056278 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-4a83e9d2-5eef-40b5-93a7-8626f8f974b1 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:09.056732 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-4a83e9d2-5eef-40b5-93a7-8626f8f974b1 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:09.060126 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-3412acb7-7f2c-48e4-84b0-8267618b8623 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:09.060715 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-3412acb7-7f2c-48e4-84b0-8267618b8623 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:09.063095 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-3412acb7-7f2c-48e4-84b0-8267618b8623 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:09.064294 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-3412acb7-7f2c-48e4-84b0-8267618b8623 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:09.064818 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-3412acb7-7f2c-48e4-84b0-8267618b8623 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:09.065304 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-3412acb7-7f2c-48e4-84b0-8267618b8623 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:09.178959 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-4a83e9d2-5eef-40b5-93a7-8626f8f974b1 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:09.193146 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-4a83e9d2-5eef-40b5-93a7-8626f8f974b1 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:09.197087 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-4a83e9d2-5eef-40b5-93a7-8626f8f974b1 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:09.199187 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-4a83e9d2-5eef-40b5-93a7-8626f8f974b1 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de" status: 200 len: 1342 microversion: 2.20 time: 0.180542 Aug 24 11:32:09.200638 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 40/72] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:32:09 2022] GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de => generated 1342 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:32:09.554398 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-852e9158-137f-4553-90fc-808ba8a8f1d7 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:09.556402 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-852e9158-137f-4553-90fc-808ba8a8f1d7 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:09.579724 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-852e9158-137f-4553-90fc-808ba8a8f1d7 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:09.582003 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-852e9158-137f-4553-90fc-808ba8a8f1d7 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:09.586048 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-852e9158-137f-4553-90fc-808ba8a8f1d7 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:09.590130 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-852e9158-137f-4553-90fc-808ba8a8f1d7 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:09.596321 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-852e9158-137f-4553-90fc-808ba8a8f1d7 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:09.597953 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-852e9158-137f-4553-90fc-808ba8a8f1d7 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:09.758516 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-3412acb7-7f2c-48e4-84b0-8267618b8623 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cef1a9e6a241ac8401b88f4a0f69fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901780013b03485a83261796f69e1b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:09.777037 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-3412acb7-7f2c-48e4-84b0-8267618b8623 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] 10.222.0.84 "GET /compute/v2.1/servers/07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0" status: 200 len: 1314 microversion: 2.1 time: 0.749911 Aug 24 11:32:09.783707 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 33/73] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:09 2022] GET /compute/v2.1/servers/07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0 => generated 1314 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:09.827303 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-00b92d4a-3805-400b-b5ab-43ec309c2afd tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:09.828147 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-00b92d4a-3805-400b-b5ab-43ec309c2afd tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] [instance: 15d4a46e-9504-4897-918d-39aafc20d22a] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:09.845365 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-00b92d4a-3805-400b-b5ab-43ec309c2afd tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:09.850712 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-00b92d4a-3805-400b-b5ab-43ec309c2afd tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:09.850712 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-00b92d4a-3805-400b-b5ab-43ec309c2afd tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:09.850712 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-00b92d4a-3805-400b-b5ab-43ec309c2afd tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:09.850712 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-00b92d4a-3805-400b-b5ab-43ec309c2afd tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:09.851114 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-00b92d4a-3805-400b-b5ab-43ec309c2afd tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:10.072084 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-852e9158-137f-4553-90fc-808ba8a8f1d7 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2715cf2a5129439c83a5347bb963f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4159dc366f41bc9e4057a079f6fb5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:10.104442 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-852e9158-137f-4553-90fc-808ba8a8f1d7 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "GET /compute/v2.1/servers/e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311" status: 200 len: 1367 microversion: 2.1 time: 0.556275 Aug 24 11:32:10.105967 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 41/74] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:09 2022] GET /compute/v2.1/servers/e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311 => generated 1367 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:10.117645 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-ec777a06-b1f4-4ef7-9c99-a433f55553fa tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:10.121975 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-ec777a06-b1f4-4ef7-9c99-a433f55553fa tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: 2d4527c9-c18c-4028-a452-d23423d9c4ee] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:10.137357 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-ec777a06-b1f4-4ef7-9c99-a433f55553fa tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:10.138592 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-ec777a06-b1f4-4ef7-9c99-a433f55553fa tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:10.139650 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-ec777a06-b1f4-4ef7-9c99-a433f55553fa tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:10.142275 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-ec777a06-b1f4-4ef7-9c99-a433f55553fa tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:10.143510 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-ec777a06-b1f4-4ef7-9c99-a433f55553fa tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:10.144773 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-ec777a06-b1f4-4ef7-9c99-a433f55553fa tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:10.217418 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-00b92d4a-3805-400b-b5ab-43ec309c2afd tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031939e16194f63b99e6f27f700fa8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecec6d0c155f4d658197c4779ab9ffce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:10.231032 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-00b92d4a-3805-400b-b5ab-43ec309c2afd tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] 10.222.0.84 "GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a" status: 200 len: 1363 microversion: 2.1 time: 0.407203 Aug 24 11:32:10.231591 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 34/75] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:09 2022] GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a => generated 1363 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:10.239467 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [req-8f23446d-acf6-4a16-83d0-02bc9d9d338c req-72d8cd00-8558-45ca-a390-381916ff9a64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311", "tag": "d810e173-346a-4d91-84f8-11fc2af8528a"}]} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:32:10.252652 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-8f23446d-acf6-4a16-83d0-02bc9d9d338c req-72d8cd00-8558-45ca-a390-381916ff9a64 service nova] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:10.253198 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-8f23446d-acf6-4a16-83d0-02bc9d9d338c req-72d8cd00-8558-45ca-a390-381916ff9a64 service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:10.253788 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-8f23446d-acf6-4a16-83d0-02bc9d9d338c req-72d8cd00-8558-45ca-a390-381916ff9a64 service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:10.271256 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.compute.server_external_events [req-8f23446d-acf6-4a16-83d0-02bc9d9d338c req-72d8cd00-8558-45ca-a390-381916ff9a64 service nova] Creating event network-changed:d810e173-346a-4d91-84f8-11fc2af8528a for instance e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311 on hv-cinder-85427 Aug 24 11:32:10.277460 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [req-8f23446d-acf6-4a16-83d0-02bc9d9d338c req-72d8cd00-8558-45ca-a390-381916ff9a64 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043542 Aug 24 11:32:10.282657 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 35/76] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Aug 24 11:32:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:32:10.288406 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-fd5b92c4-9e55-4b96-b48d-e9af00599266 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:10.289158 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-fd5b92c4-9e55-4b96-b48d-e9af00599266 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: 2e661217-fb1a-48ad-9f1b-47985a4074de] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:10.296140 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-fd5b92c4-9e55-4b96-b48d-e9af00599266 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:10.296941 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-fd5b92c4-9e55-4b96-b48d-e9af00599266 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:10.301488 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-fd5b92c4-9e55-4b96-b48d-e9af00599266 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:10.302807 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-fd5b92c4-9e55-4b96-b48d-e9af00599266 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:10.303637 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-fd5b92c4-9e55-4b96-b48d-e9af00599266 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:10.304353 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-fd5b92c4-9e55-4b96-b48d-e9af00599266 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:10.398673 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-fd5b92c4-9e55-4b96-b48d-e9af00599266 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:10.416177 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-fd5b92c4-9e55-4b96-b48d-e9af00599266 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:10.419593 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-fd5b92c4-9e55-4b96-b48d-e9af00599266 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:10.426091 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-fd5b92c4-9e55-4b96-b48d-e9af00599266 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de" status: 200 len: 1352 microversion: 2.20 time: 0.142940 Aug 24 11:32:10.427865 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 36/77] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:32:10 2022] GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de => generated 1352 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:32:10.538115 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-ec777a06-b1f4-4ef7-9c99-a433f55553fa tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:10.538115 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-ec777a06-b1f4-4ef7-9c99-a433f55553fa tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee" status: 200 len: 1322 microversion: 2.1 time: 0.422100 Aug 24 11:32:10.538115 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 42/78] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:10 2022] GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee => generated 1322 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:10.804067 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-a57bedd2-cddc-436e-90e0-6e07f30602a1 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:10.804618 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-a57bedd2-cddc-436e-90e0-6e07f30602a1 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] [instance: 07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:10.811235 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a57bedd2-cddc-436e-90e0-6e07f30602a1 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:10.812001 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a57bedd2-cddc-436e-90e0-6e07f30602a1 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:10.812130 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a57bedd2-cddc-436e-90e0-6e07f30602a1 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:10.813044 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a57bedd2-cddc-436e-90e0-6e07f30602a1 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:10.813560 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a57bedd2-cddc-436e-90e0-6e07f30602a1 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:10.813980 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a57bedd2-cddc-436e-90e0-6e07f30602a1 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:10.955334 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-a57bedd2-cddc-436e-90e0-6e07f30602a1 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cef1a9e6a241ac8401b88f4a0f69fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901780013b03485a83261796f69e1b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:10.964920 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-a57bedd2-cddc-436e-90e0-6e07f30602a1 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] 10.222.0.84 "GET /compute/v2.1/servers/07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0" status: 200 len: 1314 microversion: 2.1 time: 0.164594 Aug 24 11:32:10.965913 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 37/79] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:10 2022] GET /compute/v2.1/servers/07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:11.126592 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-af7abd67-09e5-4abb-8309-c9ecb146652b tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:11.127236 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-af7abd67-09e5-4abb-8309-c9ecb146652b tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:11.133316 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-af7abd67-09e5-4abb-8309-c9ecb146652b tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:11.133797 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-af7abd67-09e5-4abb-8309-c9ecb146652b tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:11.134229 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-af7abd67-09e5-4abb-8309-c9ecb146652b tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:11.134911 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-af7abd67-09e5-4abb-8309-c9ecb146652b tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:11.135360 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-af7abd67-09e5-4abb-8309-c9ecb146652b tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:11.135780 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-af7abd67-09e5-4abb-8309-c9ecb146652b tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:11.253128 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-01c3bfa9-7c2f-431f-809f-790e56da4830 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:11.253888 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-01c3bfa9-7c2f-431f-809f-790e56da4830 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] [instance: 15d4a46e-9504-4897-918d-39aafc20d22a] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:11.261234 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-01c3bfa9-7c2f-431f-809f-790e56da4830 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:11.261721 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-01c3bfa9-7c2f-431f-809f-790e56da4830 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:11.262586 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-01c3bfa9-7c2f-431f-809f-790e56da4830 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:11.263594 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-01c3bfa9-7c2f-431f-809f-790e56da4830 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:11.264228 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-01c3bfa9-7c2f-431f-809f-790e56da4830 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:11.264650 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-01c3bfa9-7c2f-431f-809f-790e56da4830 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:11.278486 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-af7abd67-09e5-4abb-8309-c9ecb146652b tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2715cf2a5129439c83a5347bb963f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4159dc366f41bc9e4057a079f6fb5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:11.291906 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-af7abd67-09e5-4abb-8309-c9ecb146652b tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "GET /compute/v2.1/servers/e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311" status: 200 len: 1367 microversion: 2.1 time: 0.169622 Aug 24 11:32:11.292522 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 43/80] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:11 2022] GET /compute/v2.1/servers/e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311 => generated 1367 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:11.486092 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-215fe526-2bef-4a80-8335-59d68b2af1dc tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:11.487179 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-215fe526-2bef-4a80-8335-59d68b2af1dc tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: 2e661217-fb1a-48ad-9f1b-47985a4074de] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:11.493975 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-215fe526-2bef-4a80-8335-59d68b2af1dc tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:11.494760 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-215fe526-2bef-4a80-8335-59d68b2af1dc tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:11.495527 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-215fe526-2bef-4a80-8335-59d68b2af1dc tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:11.496630 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-215fe526-2bef-4a80-8335-59d68b2af1dc tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:11.497382 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-215fe526-2bef-4a80-8335-59d68b2af1dc tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:11.497986 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-215fe526-2bef-4a80-8335-59d68b2af1dc tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:11.570171 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-215fe526-2bef-4a80-8335-59d68b2af1dc tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:11.579008 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-215fe526-2bef-4a80-8335-59d68b2af1dc tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:11.581552 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-215fe526-2bef-4a80-8335-59d68b2af1dc tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:11.583617 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-215fe526-2bef-4a80-8335-59d68b2af1dc tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de" status: 200 len: 1352 microversion: 2.20 time: 0.102028 Aug 24 11:32:11.584250 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 44/81] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:32:11 2022] GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de => generated 1352 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:32:11.589744 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-274a245e-40b6-4190-bede-7c46cfaba0ff tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:11.590310 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-274a245e-40b6-4190-bede-7c46cfaba0ff tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: 2d4527c9-c18c-4028-a452-d23423d9c4ee] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:11.592286 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-01c3bfa9-7c2f-431f-809f-790e56da4830 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031939e16194f63b99e6f27f700fa8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecec6d0c155f4d658197c4779ab9ffce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:11.596896 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-274a245e-40b6-4190-bede-7c46cfaba0ff tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:11.597383 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-274a245e-40b6-4190-bede-7c46cfaba0ff tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:11.597819 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-274a245e-40b6-4190-bede-7c46cfaba0ff tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:11.598511 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-274a245e-40b6-4190-bede-7c46cfaba0ff tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:11.598994 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-274a245e-40b6-4190-bede-7c46cfaba0ff tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:11.599447 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-274a245e-40b6-4190-bede-7c46cfaba0ff tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:11.602265 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-01c3bfa9-7c2f-431f-809f-790e56da4830 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] 10.222.0.84 "GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a" status: 200 len: 1363 microversion: 2.1 time: 0.354570 Aug 24 11:32:11.603529 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 38/82] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:11 2022] GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a => generated 1363 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:32:11.836341 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-274a245e-40b6-4190-bede-7c46cfaba0ff tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:11.847264 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-274a245e-40b6-4190-bede-7c46cfaba0ff tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee" status: 200 len: 1322 microversion: 2.1 time: 0.261898 Aug 24 11:32:11.848070 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 45/83] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:11 2022] GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee => generated 1322 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:11.987068 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-45b90695-5ccf-4ec0-9420-68263465854c tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:11.987672 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-45b90695-5ccf-4ec0-9420-68263465854c tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] [instance: 07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:11.993602 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-45b90695-5ccf-4ec0-9420-68263465854c tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:11.994366 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-45b90695-5ccf-4ec0-9420-68263465854c tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:11.994799 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-45b90695-5ccf-4ec0-9420-68263465854c tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:11.995481 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-45b90695-5ccf-4ec0-9420-68263465854c tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:11.995931 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-45b90695-5ccf-4ec0-9420-68263465854c tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:11.996379 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-45b90695-5ccf-4ec0-9420-68263465854c tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:12.150467 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-45b90695-5ccf-4ec0-9420-68263465854c tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cef1a9e6a241ac8401b88f4a0f69fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901780013b03485a83261796f69e1b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:12.150467 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-45b90695-5ccf-4ec0-9420-68263465854c tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] 10.222.0.84 "GET /compute/v2.1/servers/07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0" status: 200 len: 1314 microversion: 2.1 time: 0.165744 Aug 24 11:32:12.150467 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 39/84] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:11 2022] GET /compute/v2.1/servers/07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:12.314383 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-899df72f-6ebb-4553-aedd-af5030ac98ca tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:12.315028 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-899df72f-6ebb-4553-aedd-af5030ac98ca tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:12.321436 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-899df72f-6ebb-4553-aedd-af5030ac98ca tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:12.329703 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-899df72f-6ebb-4553-aedd-af5030ac98ca tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:12.329703 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-899df72f-6ebb-4553-aedd-af5030ac98ca tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:12.329703 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-899df72f-6ebb-4553-aedd-af5030ac98ca tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:12.329703 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-899df72f-6ebb-4553-aedd-af5030ac98ca tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:12.330778 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-899df72f-6ebb-4553-aedd-af5030ac98ca tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:12.485102 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-899df72f-6ebb-4553-aedd-af5030ac98ca tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2715cf2a5129439c83a5347bb963f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4159dc366f41bc9e4057a079f6fb5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:12.495565 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-899df72f-6ebb-4553-aedd-af5030ac98ca tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "GET /compute/v2.1/servers/e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311" status: 200 len: 1367 microversion: 2.1 time: 0.184663 Aug 24 11:32:12.501834 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 46/85] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:12 2022] GET /compute/v2.1/servers/e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311 => generated 1367 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:12.606592 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-04a9b9a3-8780-4611-8d9a-bf97ab07b081 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:12.607274 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-04a9b9a3-8780-4611-8d9a-bf97ab07b081 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: 2e661217-fb1a-48ad-9f1b-47985a4074de] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:12.613973 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-04a9b9a3-8780-4611-8d9a-bf97ab07b081 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:12.614450 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-04a9b9a3-8780-4611-8d9a-bf97ab07b081 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:12.614883 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-04a9b9a3-8780-4611-8d9a-bf97ab07b081 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:12.615567 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-04a9b9a3-8780-4611-8d9a-bf97ab07b081 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:12.616017 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-04a9b9a3-8780-4611-8d9a-bf97ab07b081 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:12.616434 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-04a9b9a3-8780-4611-8d9a-bf97ab07b081 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:12.624184 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-f5b47980-eddb-4b2e-8672-16da16083edf tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:12.625319 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-f5b47980-eddb-4b2e-8672-16da16083edf tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] [instance: 15d4a46e-9504-4897-918d-39aafc20d22a] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:12.632753 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f5b47980-eddb-4b2e-8672-16da16083edf tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:12.647473 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f5b47980-eddb-4b2e-8672-16da16083edf tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:12.647473 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f5b47980-eddb-4b2e-8672-16da16083edf tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:12.647473 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f5b47980-eddb-4b2e-8672-16da16083edf tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:12.647473 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f5b47980-eddb-4b2e-8672-16da16083edf tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:12.648044 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f5b47980-eddb-4b2e-8672-16da16083edf tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:12.714968 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-04a9b9a3-8780-4611-8d9a-bf97ab07b081 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:12.724718 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-04a9b9a3-8780-4611-8d9a-bf97ab07b081 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:12.726473 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-04a9b9a3-8780-4611-8d9a-bf97ab07b081 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:12.728167 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-04a9b9a3-8780-4611-8d9a-bf97ab07b081 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de" status: 200 len: 1352 microversion: 2.20 time: 0.125401 Aug 24 11:32:12.733345 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 40/86] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:32:12 2022] GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de => generated 1352 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:32:12.820463 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-f5b47980-eddb-4b2e-8672-16da16083edf tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031939e16194f63b99e6f27f700fa8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecec6d0c155f4d658197c4779ab9ffce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:12.831421 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-f5b47980-eddb-4b2e-8672-16da16083edf tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] 10.222.0.84 "GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a" status: 200 len: 1363 microversion: 2.1 time: 0.211539 Aug 24 11:32:12.832650 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 47/87] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:12 2022] GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a => generated 1363 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:32:12.869817 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-3664bfe9-1c0e-4f0c-b72c-3362eba32a11 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:12.870888 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-3664bfe9-1c0e-4f0c-b72c-3362eba32a11 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: 2d4527c9-c18c-4028-a452-d23423d9c4ee] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:12.878273 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-3664bfe9-1c0e-4f0c-b72c-3362eba32a11 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:12.878692 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-3664bfe9-1c0e-4f0c-b72c-3362eba32a11 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:12.879134 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-3664bfe9-1c0e-4f0c-b72c-3362eba32a11 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:12.879836 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-3664bfe9-1c0e-4f0c-b72c-3362eba32a11 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:12.880295 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-3664bfe9-1c0e-4f0c-b72c-3362eba32a11 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:12.880928 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-3664bfe9-1c0e-4f0c-b72c-3362eba32a11 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:13.062238 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-3664bfe9-1c0e-4f0c-b72c-3362eba32a11 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:13.076883 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-3664bfe9-1c0e-4f0c-b72c-3362eba32a11 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee" status: 200 len: 1322 microversion: 2.1 time: 0.211866 Aug 24 11:32:13.078156 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 41/88] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:12 2022] GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee => generated 1322 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:13.172984 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-e9fb1580-9e82-4a7a-ba41-fe0d25e62186 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:13.173571 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-e9fb1580-9e82-4a7a-ba41-fe0d25e62186 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] [instance: 07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:13.191081 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-e9fb1580-9e82-4a7a-ba41-fe0d25e62186 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:13.191756 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-e9fb1580-9e82-4a7a-ba41-fe0d25e62186 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:13.192609 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-e9fb1580-9e82-4a7a-ba41-fe0d25e62186 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:13.193867 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-e9fb1580-9e82-4a7a-ba41-fe0d25e62186 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:13.194680 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-e9fb1580-9e82-4a7a-ba41-fe0d25e62186 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:13.195415 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-e9fb1580-9e82-4a7a-ba41-fe0d25e62186 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:13.521366 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-c6f026ac-9e97-49b6-9e7b-2ae93d92e8f4 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:13.539221 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-c6f026ac-9e97-49b6-9e7b-2ae93d92e8f4 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:13.549967 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c6f026ac-9e97-49b6-9e7b-2ae93d92e8f4 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:13.551071 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c6f026ac-9e97-49b6-9e7b-2ae93d92e8f4 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:13.552697 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c6f026ac-9e97-49b6-9e7b-2ae93d92e8f4 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:13.554600 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c6f026ac-9e97-49b6-9e7b-2ae93d92e8f4 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:13.556548 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c6f026ac-9e97-49b6-9e7b-2ae93d92e8f4 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:13.557423 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c6f026ac-9e97-49b6-9e7b-2ae93d92e8f4 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:13.572946 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-e9fb1580-9e82-4a7a-ba41-fe0d25e62186 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cef1a9e6a241ac8401b88f4a0f69fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901780013b03485a83261796f69e1b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:13.589441 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-e9fb1580-9e82-4a7a-ba41-fe0d25e62186 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] 10.222.0.84 "GET /compute/v2.1/servers/07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0" status: 200 len: 1314 microversion: 2.1 time: 0.423352 Aug 24 11:32:13.590263 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 48/89] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:13 2022] GET /compute/v2.1/servers/07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0 => generated 1314 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:13.755107 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-ea6ef808-9f6b-4a5d-8cc7-d8a8f35fa1f3 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:13.755762 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-ea6ef808-9f6b-4a5d-8cc7-d8a8f35fa1f3 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: 2e661217-fb1a-48ad-9f1b-47985a4074de] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:13.762039 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-ea6ef808-9f6b-4a5d-8cc7-d8a8f35fa1f3 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:13.762532 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-ea6ef808-9f6b-4a5d-8cc7-d8a8f35fa1f3 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:13.762973 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-ea6ef808-9f6b-4a5d-8cc7-d8a8f35fa1f3 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:13.763671 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-ea6ef808-9f6b-4a5d-8cc7-d8a8f35fa1f3 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:13.764125 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-ea6ef808-9f6b-4a5d-8cc7-d8a8f35fa1f3 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:13.764544 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-ea6ef808-9f6b-4a5d-8cc7-d8a8f35fa1f3 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:13.874062 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-ea6ef808-9f6b-4a5d-8cc7-d8a8f35fa1f3 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:13.886085 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-ea6ef808-9f6b-4a5d-8cc7-d8a8f35fa1f3 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:13.894442 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-ea6ef808-9f6b-4a5d-8cc7-d8a8f35fa1f3 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:13.894442 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-ea6ef808-9f6b-4a5d-8cc7-d8a8f35fa1f3 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de" status: 200 len: 1340 microversion: 2.20 time: 0.141115 Aug 24 11:32:13.901960 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 49/90] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:32:13 2022] GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de => generated 1340 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:32:13.912317 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-6754e006-d0c4-4dc7-8d00-f56aaa6f1542 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:13.913142 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-6754e006-d0c4-4dc7-8d00-f56aaa6f1542 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] [instance: 15d4a46e-9504-4897-918d-39aafc20d22a] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:13.920939 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-6754e006-d0c4-4dc7-8d00-f56aaa6f1542 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:13.922414 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-6754e006-d0c4-4dc7-8d00-f56aaa6f1542 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:13.922999 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-6754e006-d0c4-4dc7-8d00-f56aaa6f1542 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:13.924041 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-6754e006-d0c4-4dc7-8d00-f56aaa6f1542 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:13.924639 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-6754e006-d0c4-4dc7-8d00-f56aaa6f1542 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:13.932225 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-6754e006-d0c4-4dc7-8d00-f56aaa6f1542 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:14.121148 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-c6f026ac-9e97-49b6-9e7b-2ae93d92e8f4 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2715cf2a5129439c83a5347bb963f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4159dc366f41bc9e4057a079f6fb5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:14.127290 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-c6f026ac-9e97-49b6-9e7b-2ae93d92e8f4 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "GET /compute/v2.1/servers/e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311" status: 200 len: 1367 microversion: 2.1 time: 0.612852 Aug 24 11:32:14.142623 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 42/91] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:13 2022] GET /compute/v2.1/servers/e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311 => generated 1367 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:32:14.148595 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-cc20bebb-e1eb-4685-9ae9-392266179ba5 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:14.149357 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-cc20bebb-e1eb-4685-9ae9-392266179ba5 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: 2d4527c9-c18c-4028-a452-d23423d9c4ee] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:14.156850 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-cc20bebb-e1eb-4685-9ae9-392266179ba5 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:14.161445 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-cc20bebb-e1eb-4685-9ae9-392266179ba5 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:14.161445 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-cc20bebb-e1eb-4685-9ae9-392266179ba5 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:14.161445 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-cc20bebb-e1eb-4685-9ae9-392266179ba5 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:14.161445 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-cc20bebb-e1eb-4685-9ae9-392266179ba5 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:14.162371 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-cc20bebb-e1eb-4685-9ae9-392266179ba5 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:14.314974 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-6754e006-d0c4-4dc7-8d00-f56aaa6f1542 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031939e16194f63b99e6f27f700fa8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecec6d0c155f4d658197c4779ab9ffce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:14.337197 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG dbcounter [-] [124769] Writing DB stats nova_cell1:SELECT=100 {{(pid=124769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:14.337197 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-6754e006-d0c4-4dc7-8d00-f56aaa6f1542 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] 10.222.0.84 "GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a" status: 200 len: 1363 microversion: 2.1 time: 0.421260 Aug 24 11:32:14.337197 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 50/92] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:13 2022] GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a => generated 1363 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:14.370920 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-cc20bebb-e1eb-4685-9ae9-392266179ba5 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:14.386465 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-cc20bebb-e1eb-4685-9ae9-392266179ba5 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee" status: 200 len: 1322 microversion: 2.1 time: 0.241869 Aug 24 11:32:14.388859 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 43/93] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:14 2022] GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee => generated 1322 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:14.614712 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-07718e01-23a8-4e78-ad48-d89c981e2f57 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:14.615799 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-07718e01-23a8-4e78-ad48-d89c981e2f57 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] [instance: 07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:14.623684 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-07718e01-23a8-4e78-ad48-d89c981e2f57 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:14.624474 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-07718e01-23a8-4e78-ad48-d89c981e2f57 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:14.626864 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-07718e01-23a8-4e78-ad48-d89c981e2f57 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:14.626864 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-07718e01-23a8-4e78-ad48-d89c981e2f57 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:14.626864 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-07718e01-23a8-4e78-ad48-d89c981e2f57 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:14.627130 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-07718e01-23a8-4e78-ad48-d89c981e2f57 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:14.917324 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-089b521a-ebcd-4a19-b30a-8ca3148208b3 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:14.918146 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-089b521a-ebcd-4a19-b30a-8ca3148208b3 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: 2e661217-fb1a-48ad-9f1b-47985a4074de] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:14.921257 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_cell0:SELECT=44 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:14.927368 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-089b521a-ebcd-4a19-b30a-8ca3148208b3 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:14.927368 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-089b521a-ebcd-4a19-b30a-8ca3148208b3 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:14.927368 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-089b521a-ebcd-4a19-b30a-8ca3148208b3 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:14.927368 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-089b521a-ebcd-4a19-b30a-8ca3148208b3 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:14.927807 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-089b521a-ebcd-4a19-b30a-8ca3148208b3 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:14.928385 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-089b521a-ebcd-4a19-b30a-8ca3148208b3 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:14.972232 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-07718e01-23a8-4e78-ad48-d89c981e2f57 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cef1a9e6a241ac8401b88f4a0f69fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901780013b03485a83261796f69e1b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:14.981076 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-07718e01-23a8-4e78-ad48-d89c981e2f57 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] 10.222.0.84 "GET /compute/v2.1/servers/07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0" status: 200 len: 1314 microversion: 2.1 time: 0.372100 Aug 24 11:32:14.982516 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 51/94] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:14 2022] GET /compute/v2.1/servers/07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0 => generated 1314 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:15.009764 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [req-3bc7f080-22a2-4d30-8aee-c39c942ede14 req-835e0b22-39ef-4442-bf3f-463a059a76ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15d4a46e-9504-4897-918d-39aafc20d22a", "tag": "a6afa636-0862-4c9f-9c7f-a90a8c528daa"}]} {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:32:15.028506 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [req-3bc7f080-22a2-4d30-8aee-c39c942ede14 req-835e0b22-39ef-4442-bf3f-463a059a76ec service nova] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:15.029045 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [req-3bc7f080-22a2-4d30-8aee-c39c942ede14 req-835e0b22-39ef-4442-bf3f-463a059a76ec service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:15.029512 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [req-3bc7f080-22a2-4d30-8aee-c39c942ede14 req-835e0b22-39ef-4442-bf3f-463a059a76ec service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:15.043492 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.compute.server_external_events [req-3bc7f080-22a2-4d30-8aee-c39c942ede14 req-835e0b22-39ef-4442-bf3f-463a059a76ec service nova] Creating event network-changed:a6afa636-0862-4c9f-9c7f-a90a8c528daa for instance 15d4a46e-9504-4897-918d-39aafc20d22a on hv-cinder-85427 Aug 24 11:32:15.050050 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [req-3bc7f080-22a2-4d30-8aee-c39c942ede14 req-835e0b22-39ef-4442-bf3f-463a059a76ec service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045771 Aug 24 11:32:15.050887 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 52/95] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Aug 24 11:32:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:32:15.054296 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-089b521a-ebcd-4a19-b30a-8ca3148208b3 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:15.067079 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-089b521a-ebcd-4a19-b30a-8ca3148208b3 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:15.068990 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-089b521a-ebcd-4a19-b30a-8ca3148208b3 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:15.070414 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-089b521a-ebcd-4a19-b30a-8ca3148208b3 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de" status: 200 len: 1340 microversion: 2.20 time: 0.156950 Aug 24 11:32:15.071400 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 44/96] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:32:14 2022] GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de => generated 1340 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:32:15.148543 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-97c97712-546c-4af3-aea6-1624dee6de1b tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:15.149279 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-97c97712-546c-4af3-aea6-1624dee6de1b tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:15.155817 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-97c97712-546c-4af3-aea6-1624dee6de1b tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:15.156951 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-97c97712-546c-4af3-aea6-1624dee6de1b tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:15.157557 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-97c97712-546c-4af3-aea6-1624dee6de1b tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:15.158245 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-97c97712-546c-4af3-aea6-1624dee6de1b tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:15.158699 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-97c97712-546c-4af3-aea6-1624dee6de1b tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:15.159143 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-97c97712-546c-4af3-aea6-1624dee6de1b tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:15.347760 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-a029c160-d305-42d3-a2c9-a3c2b3b85746 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:15.348524 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-a029c160-d305-42d3-a2c9-a3c2b3b85746 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] [instance: 15d4a46e-9504-4897-918d-39aafc20d22a] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:15.350478 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_cell0:SELECT=10 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:15.355645 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a029c160-d305-42d3-a2c9-a3c2b3b85746 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:15.356361 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a029c160-d305-42d3-a2c9-a3c2b3b85746 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:15.356870 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a029c160-d305-42d3-a2c9-a3c2b3b85746 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:15.357791 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a029c160-d305-42d3-a2c9-a3c2b3b85746 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:15.358486 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a029c160-d305-42d3-a2c9-a3c2b3b85746 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:15.358665 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a029c160-d305-42d3-a2c9-a3c2b3b85746 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:15.482245 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-97c97712-546c-4af3-aea6-1624dee6de1b tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2715cf2a5129439c83a5347bb963f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4159dc366f41bc9e4057a079f6fb5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:15.497412 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-97c97712-546c-4af3-aea6-1624dee6de1b tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "GET /compute/v2.1/servers/e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311" status: 200 len: 1367 microversion: 2.1 time: 0.352777 Aug 24 11:32:15.505499 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 53/97] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:15 2022] GET /compute/v2.1/servers/e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311 => generated 1367 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:15.524712 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-419f5932-8bab-49c5-8c06-1cfba28b5b9b tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:15.525875 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-419f5932-8bab-49c5-8c06-1cfba28b5b9b tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: 2d4527c9-c18c-4028-a452-d23423d9c4ee] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:15.536416 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-419f5932-8bab-49c5-8c06-1cfba28b5b9b tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:15.537111 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-419f5932-8bab-49c5-8c06-1cfba28b5b9b tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:15.540524 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-419f5932-8bab-49c5-8c06-1cfba28b5b9b tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:15.540524 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-419f5932-8bab-49c5-8c06-1cfba28b5b9b tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:15.540524 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-419f5932-8bab-49c5-8c06-1cfba28b5b9b tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:15.540524 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-419f5932-8bab-49c5-8c06-1cfba28b5b9b tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:15.579399 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-a029c160-d305-42d3-a2c9-a3c2b3b85746 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031939e16194f63b99e6f27f700fa8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecec6d0c155f4d658197c4779ab9ffce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:15.588417 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-a029c160-d305-42d3-a2c9-a3c2b3b85746 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] 10.222.0.84 "GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a" status: 200 len: 1363 microversion: 2.1 time: 0.245622 Aug 24 11:32:15.589215 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 45/98] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:15 2022] GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a => generated 1363 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:32:15.769322 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-419f5932-8bab-49c5-8c06-1cfba28b5b9b tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:15.779501 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-419f5932-8bab-49c5-8c06-1cfba28b5b9b tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee" status: 200 len: 1322 microversion: 2.1 time: 0.272493 Aug 24 11:32:15.780098 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 54/99] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:15 2022] GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee => generated 1322 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:16.003940 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-017eeac5-c896-4114-9f06-8d32f17f68e2 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:16.004482 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-017eeac5-c896-4114-9f06-8d32f17f68e2 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] [instance: 07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:16.010912 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-017eeac5-c896-4114-9f06-8d32f17f68e2 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:16.011403 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-017eeac5-c896-4114-9f06-8d32f17f68e2 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:16.011842 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-017eeac5-c896-4114-9f06-8d32f17f68e2 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:16.012533 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-017eeac5-c896-4114-9f06-8d32f17f68e2 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:16.013019 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-017eeac5-c896-4114-9f06-8d32f17f68e2 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:16.013742 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-017eeac5-c896-4114-9f06-8d32f17f68e2 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:16.095814 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-54e7419f-b225-4a22-9c55-6e176c84e50a tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:16.096643 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-54e7419f-b225-4a22-9c55-6e176c84e50a tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: 2e661217-fb1a-48ad-9f1b-47985a4074de] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:16.108822 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-54e7419f-b225-4a22-9c55-6e176c84e50a tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:16.110108 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-54e7419f-b225-4a22-9c55-6e176c84e50a tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:16.110866 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-54e7419f-b225-4a22-9c55-6e176c84e50a tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:16.111905 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-54e7419f-b225-4a22-9c55-6e176c84e50a tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:16.112496 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-54e7419f-b225-4a22-9c55-6e176c84e50a tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:16.113280 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-54e7419f-b225-4a22-9c55-6e176c84e50a tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:16.233337 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-017eeac5-c896-4114-9f06-8d32f17f68e2 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cef1a9e6a241ac8401b88f4a0f69fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901780013b03485a83261796f69e1b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:16.242994 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-017eeac5-c896-4114-9f06-8d32f17f68e2 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] 10.222.0.84 "GET /compute/v2.1/servers/07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0" status: 200 len: 1314 microversion: 2.1 time: 0.243830 Aug 24 11:32:16.246487 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 46/100] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:15 2022] GET /compute/v2.1/servers/07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0 => generated 1314 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:32:16.263194 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG dbcounter [-] [124769] Writing DB stats nova_cell0:SELECT=2 {{(pid=124769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:16.377587 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-54e7419f-b225-4a22-9c55-6e176c84e50a tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:16.386350 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-54e7419f-b225-4a22-9c55-6e176c84e50a tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:16.387839 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-54e7419f-b225-4a22-9c55-6e176c84e50a tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:16.388963 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-54e7419f-b225-4a22-9c55-6e176c84e50a tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de" status: 200 len: 1408 microversion: 2.20 time: 0.298417 Aug 24 11:32:16.389522 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 55/101] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:32:16 2022] GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de => generated 1408 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:32:16.521144 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-f09bb0a7-ca13-4eef-89c2-4c817e83aa67 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:16.521730 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-f09bb0a7-ca13-4eef-89c2-4c817e83aa67 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:16.527882 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-f09bb0a7-ca13-4eef-89c2-4c817e83aa67 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:16.528364 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-f09bb0a7-ca13-4eef-89c2-4c817e83aa67 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:16.532723 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-f09bb0a7-ca13-4eef-89c2-4c817e83aa67 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:16.532723 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-f09bb0a7-ca13-4eef-89c2-4c817e83aa67 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:16.532723 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-f09bb0a7-ca13-4eef-89c2-4c817e83aa67 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:16.532723 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-f09bb0a7-ca13-4eef-89c2-4c817e83aa67 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:16.611172 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-f6f29ba7-02de-4108-b2fc-7898b58e8093 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:16.611979 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-f6f29ba7-02de-4108-b2fc-7898b58e8093 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] [instance: 15d4a46e-9504-4897-918d-39aafc20d22a] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:16.618140 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f6f29ba7-02de-4108-b2fc-7898b58e8093 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:16.618507 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f6f29ba7-02de-4108-b2fc-7898b58e8093 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:16.619491 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f6f29ba7-02de-4108-b2fc-7898b58e8093 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:16.620300 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f6f29ba7-02de-4108-b2fc-7898b58e8093 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:16.621004 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f6f29ba7-02de-4108-b2fc-7898b58e8093 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:16.621559 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f6f29ba7-02de-4108-b2fc-7898b58e8093 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:16.717670 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-f09bb0a7-ca13-4eef-89c2-4c817e83aa67 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2715cf2a5129439c83a5347bb963f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4159dc366f41bc9e4057a079f6fb5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:16.727513 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-f09bb0a7-ca13-4eef-89c2-4c817e83aa67 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "GET /compute/v2.1/servers/e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311" status: 200 len: 1367 microversion: 2.1 time: 0.210091 Aug 24 11:32:16.728303 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 47/102] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:16 2022] GET /compute/v2.1/servers/e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311 => generated 1367 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:16.787938 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-f6f29ba7-02de-4108-b2fc-7898b58e8093 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031939e16194f63b99e6f27f700fa8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecec6d0c155f4d658197c4779ab9ffce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:16.801682 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-82abc008-e3b5-4be2-b9e0-32869bf55ef9 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:16.801968 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-f6f29ba7-02de-4108-b2fc-7898b58e8093 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] 10.222.0.84 "GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a" status: 200 len: 1363 microversion: 2.1 time: 0.195339 Aug 24 11:32:16.802294 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-82abc008-e3b5-4be2-b9e0-32869bf55ef9 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: 2d4527c9-c18c-4028-a452-d23423d9c4ee] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:16.802777 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 56/103] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:16 2022] GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a => generated 1363 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:32:16.817850 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-82abc008-e3b5-4be2-b9e0-32869bf55ef9 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:16.818345 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-82abc008-e3b5-4be2-b9e0-32869bf55ef9 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:16.818890 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-82abc008-e3b5-4be2-b9e0-32869bf55ef9 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:16.819592 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-82abc008-e3b5-4be2-b9e0-32869bf55ef9 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:16.820074 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-82abc008-e3b5-4be2-b9e0-32869bf55ef9 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:16.820500 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-82abc008-e3b5-4be2-b9e0-32869bf55ef9 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:17.020257 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-82abc008-e3b5-4be2-b9e0-32869bf55ef9 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:17.038631 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-82abc008-e3b5-4be2-b9e0-32869bf55ef9 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee" status: 200 len: 1322 microversion: 2.1 time: 0.241542 Aug 24 11:32:17.039678 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 48/104] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:16 2022] GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee => generated 1322 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:17.268305 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-a67ef4e4-d88f-49e1-8e2d-24f531d9afc2 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:17.268956 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-a67ef4e4-d88f-49e1-8e2d-24f531d9afc2 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] [instance: 07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:17.275243 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-a67ef4e4-d88f-49e1-8e2d-24f531d9afc2 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:17.275732 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-a67ef4e4-d88f-49e1-8e2d-24f531d9afc2 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:17.276203 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-a67ef4e4-d88f-49e1-8e2d-24f531d9afc2 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:17.277087 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-a67ef4e4-d88f-49e1-8e2d-24f531d9afc2 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:17.277715 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-a67ef4e4-d88f-49e1-8e2d-24f531d9afc2 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:17.278278 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-a67ef4e4-d88f-49e1-8e2d-24f531d9afc2 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:17.412638 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-36907142-da81-4aa8-a3f0-c239e021bf9c tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:17.413627 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-36907142-da81-4aa8-a3f0-c239e021bf9c tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: 2e661217-fb1a-48ad-9f1b-47985a4074de] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:17.420583 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-36907142-da81-4aa8-a3f0-c239e021bf9c tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:17.422536 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-36907142-da81-4aa8-a3f0-c239e021bf9c tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:17.422536 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-36907142-da81-4aa8-a3f0-c239e021bf9c tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:17.423376 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-36907142-da81-4aa8-a3f0-c239e021bf9c tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:17.423893 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-36907142-da81-4aa8-a3f0-c239e021bf9c tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:17.424308 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-36907142-da81-4aa8-a3f0-c239e021bf9c tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:17.429682 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_cell1:SELECT=100 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:17.613588 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-36907142-da81-4aa8-a3f0-c239e021bf9c tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:17.623227 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-36907142-da81-4aa8-a3f0-c239e021bf9c tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:17.624986 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-36907142-da81-4aa8-a3f0-c239e021bf9c tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:17.626305 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-36907142-da81-4aa8-a3f0-c239e021bf9c tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de" status: 200 len: 1408 microversion: 2.20 time: 0.217933 Aug 24 11:32:17.627239 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 49/105] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:32:17 2022] GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de => generated 1408 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 11:32:17.690350 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-a67ef4e4-d88f-49e1-8e2d-24f531d9afc2 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cef1a9e6a241ac8401b88f4a0f69fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901780013b03485a83261796f69e1b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:17.698357 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-a67ef4e4-d88f-49e1-8e2d-24f531d9afc2 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] 10.222.0.84 "GET /compute/v2.1/servers/07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0" status: 200 len: 1314 microversion: 2.1 time: 0.434070 Aug 24 11:32:17.699201 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 57/106] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:17 2022] GET /compute/v2.1/servers/07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0 => generated 1314 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:32:17.749169 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-37ddc229-897e-4032-8e99-44694c35a02b tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:17.749791 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-37ddc229-897e-4032-8e99-44694c35a02b tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:17.758509 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-37ddc229-897e-4032-8e99-44694c35a02b tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:17.761802 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-37ddc229-897e-4032-8e99-44694c35a02b tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:17.761802 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-37ddc229-897e-4032-8e99-44694c35a02b tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:17.761802 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-37ddc229-897e-4032-8e99-44694c35a02b tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:17.761802 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-37ddc229-897e-4032-8e99-44694c35a02b tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:17.762139 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-37ddc229-897e-4032-8e99-44694c35a02b tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:17.826747 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-3c10fc5f-3b9a-441d-885c-6f4fe902b0c3 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:17.829981 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-3c10fc5f-3b9a-441d-885c-6f4fe902b0c3 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] [instance: 15d4a46e-9504-4897-918d-39aafc20d22a] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:17.841316 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-3c10fc5f-3b9a-441d-885c-6f4fe902b0c3 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:17.857749 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-3c10fc5f-3b9a-441d-885c-6f4fe902b0c3 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:17.857749 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-3c10fc5f-3b9a-441d-885c-6f4fe902b0c3 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:17.857749 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-3c10fc5f-3b9a-441d-885c-6f4fe902b0c3 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:17.857749 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-3c10fc5f-3b9a-441d-885c-6f4fe902b0c3 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:17.858123 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-3c10fc5f-3b9a-441d-885c-6f4fe902b0c3 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:17.979421 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-37ddc229-897e-4032-8e99-44694c35a02b tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2715cf2a5129439c83a5347bb963f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4159dc366f41bc9e4057a079f6fb5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:17.990464 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-37ddc229-897e-4032-8e99-44694c35a02b tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "GET /compute/v2.1/servers/e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311" status: 200 len: 1367 microversion: 2.1 time: 0.245123 Aug 24 11:32:17.991306 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 50/107] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:17 2022] GET /compute/v2.1/servers/e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311 => generated 1367 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:32:18.064181 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-666b975a-c170-4bb6-8fa2-18fc05c4e009 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:18.065242 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-666b975a-c170-4bb6-8fa2-18fc05c4e009 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: 2d4527c9-c18c-4028-a452-d23423d9c4ee] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:18.074216 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-666b975a-c170-4bb6-8fa2-18fc05c4e009 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:18.075009 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-666b975a-c170-4bb6-8fa2-18fc05c4e009 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:18.075727 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-666b975a-c170-4bb6-8fa2-18fc05c4e009 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:18.076991 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-666b975a-c170-4bb6-8fa2-18fc05c4e009 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:18.077690 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-666b975a-c170-4bb6-8fa2-18fc05c4e009 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:18.078474 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-666b975a-c170-4bb6-8fa2-18fc05c4e009 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:18.233073 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-666b975a-c170-4bb6-8fa2-18fc05c4e009 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:18.242815 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-666b975a-c170-4bb6-8fa2-18fc05c4e009 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee" status: 200 len: 1322 microversion: 2.1 time: 0.185710 Aug 24 11:32:18.251080 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 51/108] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:18 2022] GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee => generated 1322 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:32:18.444160 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-3c10fc5f-3b9a-441d-885c-6f4fe902b0c3 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031939e16194f63b99e6f27f700fa8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecec6d0c155f4d658197c4779ab9ffce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:18.452872 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-3c10fc5f-3b9a-441d-885c-6f4fe902b0c3 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] 10.222.0.84 "GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a" status: 200 len: 1363 microversion: 2.1 time: 0.633206 Aug 24 11:32:18.454609 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 58/109] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:17 2022] GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a => generated 1363 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:18.657586 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-518c1af7-334a-49b5-8ba7-c8de9584aff5 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:18.657586 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-518c1af7-334a-49b5-8ba7-c8de9584aff5 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: 2e661217-fb1a-48ad-9f1b-47985a4074de] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:18.670495 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-518c1af7-334a-49b5-8ba7-c8de9584aff5 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:18.670495 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-518c1af7-334a-49b5-8ba7-c8de9584aff5 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:18.670495 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-518c1af7-334a-49b5-8ba7-c8de9584aff5 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:18.670495 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-518c1af7-334a-49b5-8ba7-c8de9584aff5 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:18.671043 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-518c1af7-334a-49b5-8ba7-c8de9584aff5 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:18.671043 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-518c1af7-334a-49b5-8ba7-c8de9584aff5 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:18.719496 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-148a0ca4-48cf-42ba-a7df-9107e69ba889 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:18.720306 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-148a0ca4-48cf-42ba-a7df-9107e69ba889 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] [instance: 07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:18.729749 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-148a0ca4-48cf-42ba-a7df-9107e69ba889 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:18.730237 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-148a0ca4-48cf-42ba-a7df-9107e69ba889 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:18.730887 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-148a0ca4-48cf-42ba-a7df-9107e69ba889 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:18.731897 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-148a0ca4-48cf-42ba-a7df-9107e69ba889 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:18.732497 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-148a0ca4-48cf-42ba-a7df-9107e69ba889 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:18.733088 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-148a0ca4-48cf-42ba-a7df-9107e69ba889 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:18.945349 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-518c1af7-334a-49b5-8ba7-c8de9584aff5 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:18.956912 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-518c1af7-334a-49b5-8ba7-c8de9584aff5 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:18.958816 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-518c1af7-334a-49b5-8ba7-c8de9584aff5 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:18.960322 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-518c1af7-334a-49b5-8ba7-c8de9584aff5 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de" status: 200 len: 1408 microversion: 2.20 time: 0.314948 Aug 24 11:32:18.973829 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 52/110] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:32:18 2022] GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de => generated 1408 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 11:32:19.017304 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-25a0f2d8-472d-4996-83f0-9e6ef2e83533 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:19.017896 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-25a0f2d8-472d-4996-83f0-9e6ef2e83533 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:19.033119 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-148a0ca4-48cf-42ba-a7df-9107e69ba889 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cef1a9e6a241ac8401b88f4a0f69fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901780013b03485a83261796f69e1b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:19.035357 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-25a0f2d8-472d-4996-83f0-9e6ef2e83533 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:19.035864 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-25a0f2d8-472d-4996-83f0-9e6ef2e83533 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:19.036297 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-25a0f2d8-472d-4996-83f0-9e6ef2e83533 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:19.037031 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-25a0f2d8-472d-4996-83f0-9e6ef2e83533 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:19.037509 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-25a0f2d8-472d-4996-83f0-9e6ef2e83533 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:19.037903 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-25a0f2d8-472d-4996-83f0-9e6ef2e83533 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:19.043000 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-148a0ca4-48cf-42ba-a7df-9107e69ba889 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] 10.222.0.84 "GET /compute/v2.1/servers/07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0" status: 200 len: 1314 microversion: 2.1 time: 0.327268 Aug 24 11:32:19.043733 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 59/111] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:18 2022] GET /compute/v2.1/servers/07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0 => generated 1314 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:32:19.263602 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-b7009d48-c072-48ae-8dd9-28f99f7532f1 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:19.264214 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-b7009d48-c072-48ae-8dd9-28f99f7532f1 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: 2d4527c9-c18c-4028-a452-d23423d9c4ee] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:19.275899 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-b7009d48-c072-48ae-8dd9-28f99f7532f1 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:19.277326 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-b7009d48-c072-48ae-8dd9-28f99f7532f1 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:19.282527 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-b7009d48-c072-48ae-8dd9-28f99f7532f1 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:19.282527 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-b7009d48-c072-48ae-8dd9-28f99f7532f1 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:19.282527 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-b7009d48-c072-48ae-8dd9-28f99f7532f1 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:19.282527 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-b7009d48-c072-48ae-8dd9-28f99f7532f1 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:19.488637 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-b7009d48-c072-48ae-8dd9-28f99f7532f1 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:19.500515 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-b7009d48-c072-48ae-8dd9-28f99f7532f1 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee" status: 200 len: 1322 microversion: 2.1 time: 0.237525 Aug 24 11:32:19.500515 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 60/112] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:19 2022] GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee => generated 1322 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:19.503453 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [req-e2408bf8-063c-4d6c-a8c9-d2ef62791800 req-82342f4e-42f0-4517-9e22-760007932f2f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e661217-fb1a-48ad-9f1b-47985a4074de", "tag": "e82d60e7-8369-4554-9da0-a0a3a25fe586"}]} {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:32:19.517524 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [req-e2408bf8-063c-4d6c-a8c9-d2ef62791800 req-82342f4e-42f0-4517-9e22-760007932f2f service nova] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:19.517763 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [req-e2408bf8-063c-4d6c-a8c9-d2ef62791800 req-82342f4e-42f0-4517-9e22-760007932f2f service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:19.518197 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [req-e2408bf8-063c-4d6c-a8c9-d2ef62791800 req-82342f4e-42f0-4517-9e22-760007932f2f service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:19.534683 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.compute.server_external_events [req-e2408bf8-063c-4d6c-a8c9-d2ef62791800 req-82342f4e-42f0-4517-9e22-760007932f2f service nova] Creating event network-changed:e82d60e7-8369-4554-9da0-a0a3a25fe586 for instance 2e661217-fb1a-48ad-9f1b-47985a4074de on hv-cinder-85427 Aug 24 11:32:19.545836 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [req-e2408bf8-063c-4d6c-a8c9-d2ef62791800 req-82342f4e-42f0-4517-9e22-760007932f2f service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046800 Aug 24 11:32:19.547167 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 61/113] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Aug 24 11:32:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:32:19.553678 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-550099c2-9c4b-4952-be72-25ba32a3d1bd tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:19.554568 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-550099c2-9c4b-4952-be72-25ba32a3d1bd tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] [instance: 15d4a46e-9504-4897-918d-39aafc20d22a] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:19.561975 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-550099c2-9c4b-4952-be72-25ba32a3d1bd tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:19.563810 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-550099c2-9c4b-4952-be72-25ba32a3d1bd tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:19.564413 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-550099c2-9c4b-4952-be72-25ba32a3d1bd tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:19.565436 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-550099c2-9c4b-4952-be72-25ba32a3d1bd tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:19.566047 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-550099c2-9c4b-4952-be72-25ba32a3d1bd tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:19.569922 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-550099c2-9c4b-4952-be72-25ba32a3d1bd tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:19.643773 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-25a0f2d8-472d-4996-83f0-9e6ef2e83533 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2715cf2a5129439c83a5347bb963f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4159dc366f41bc9e4057a079f6fb5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:19.652084 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-25a0f2d8-472d-4996-83f0-9e6ef2e83533 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "GET /compute/v2.1/servers/e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311" status: 200 len: 1367 microversion: 2.1 time: 0.639125 Aug 24 11:32:19.653278 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 53/114] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:19 2022] GET /compute/v2.1/servers/e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311 => generated 1367 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:19.739645 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-550099c2-9c4b-4952-be72-25ba32a3d1bd tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031939e16194f63b99e6f27f700fa8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecec6d0c155f4d658197c4779ab9ffce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:19.748622 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-550099c2-9c4b-4952-be72-25ba32a3d1bd tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] 10.222.0.84 "GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a" status: 200 len: 1363 microversion: 2.1 time: 0.199717 Aug 24 11:32:19.752759 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 62/115] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:19 2022] GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a => generated 1363 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:19.990712 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-6e6ba7dd-4299-47e7-9400-b05d9469e482 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:19.991463 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-6e6ba7dd-4299-47e7-9400-b05d9469e482 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: 2e661217-fb1a-48ad-9f1b-47985a4074de] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:20.009263 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6e6ba7dd-4299-47e7-9400-b05d9469e482 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:20.011932 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6e6ba7dd-4299-47e7-9400-b05d9469e482 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:20.013421 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6e6ba7dd-4299-47e7-9400-b05d9469e482 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:20.015012 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6e6ba7dd-4299-47e7-9400-b05d9469e482 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:20.016383 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6e6ba7dd-4299-47e7-9400-b05d9469e482 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:20.017134 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6e6ba7dd-4299-47e7-9400-b05d9469e482 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:20.066141 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-a2b5fc4a-cf10-4b7c-abe9-3de992652187 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:20.066977 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-a2b5fc4a-cf10-4b7c-abe9-3de992652187 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] [instance: 07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:20.073052 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-a2b5fc4a-cf10-4b7c-abe9-3de992652187 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:20.073540 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-a2b5fc4a-cf10-4b7c-abe9-3de992652187 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:20.073975 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-a2b5fc4a-cf10-4b7c-abe9-3de992652187 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:20.074672 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-a2b5fc4a-cf10-4b7c-abe9-3de992652187 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:20.075121 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-a2b5fc4a-cf10-4b7c-abe9-3de992652187 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:20.075642 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-a2b5fc4a-cf10-4b7c-abe9-3de992652187 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:20.196359 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-6e6ba7dd-4299-47e7-9400-b05d9469e482 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:20.204981 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-6e6ba7dd-4299-47e7-9400-b05d9469e482 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:20.206993 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-6e6ba7dd-4299-47e7-9400-b05d9469e482 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:20.208096 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-6e6ba7dd-4299-47e7-9400-b05d9469e482 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de" status: 200 len: 1408 microversion: 2.20 time: 0.225660 Aug 24 11:32:20.208906 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 54/116] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:32:19 2022] GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de => generated 1408 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:32:20.242612 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-a2b5fc4a-cf10-4b7c-abe9-3de992652187 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cef1a9e6a241ac8401b88f4a0f69fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901780013b03485a83261796f69e1b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:20.251421 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-a2b5fc4a-cf10-4b7c-abe9-3de992652187 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] 10.222.0.84 "GET /compute/v2.1/servers/07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0" status: 200 len: 1314 microversion: 2.1 time: 0.191041 Aug 24 11:32:20.251990 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 63/117] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:20 2022] GET /compute/v2.1/servers/07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0 => generated 1314 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:32:20.522623 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-229636b2-6a6a-4e69-831f-3dc738f45e2d tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:20.523165 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-229636b2-6a6a-4e69-831f-3dc738f45e2d tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: 2d4527c9-c18c-4028-a452-d23423d9c4ee] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:20.529227 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-229636b2-6a6a-4e69-831f-3dc738f45e2d tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:20.529701 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-229636b2-6a6a-4e69-831f-3dc738f45e2d tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:20.530135 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-229636b2-6a6a-4e69-831f-3dc738f45e2d tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:20.530808 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-229636b2-6a6a-4e69-831f-3dc738f45e2d tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:20.531954 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-229636b2-6a6a-4e69-831f-3dc738f45e2d tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:20.532420 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-229636b2-6a6a-4e69-831f-3dc738f45e2d tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:20.676992 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-198ac3f0-3a63-4de4-8b83-70feb3e38fae tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:20.677873 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-198ac3f0-3a63-4de4-8b83-70feb3e38fae tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:20.684859 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-198ac3f0-3a63-4de4-8b83-70feb3e38fae tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:20.685549 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-198ac3f0-3a63-4de4-8b83-70feb3e38fae tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:20.688310 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-198ac3f0-3a63-4de4-8b83-70feb3e38fae tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:20.688310 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-198ac3f0-3a63-4de4-8b83-70feb3e38fae tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:20.688310 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-198ac3f0-3a63-4de4-8b83-70feb3e38fae tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:20.688310 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-198ac3f0-3a63-4de4-8b83-70feb3e38fae tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:20.712918 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-229636b2-6a6a-4e69-831f-3dc738f45e2d tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:20.723248 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-229636b2-6a6a-4e69-831f-3dc738f45e2d tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee" status: 200 len: 1322 microversion: 2.1 time: 0.205260 Aug 24 11:32:20.724438 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 55/118] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:20 2022] GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee => generated 1322 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:20.770408 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-60fdb63b-07ad-472c-b319-0d9a29727e9b tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:20.771243 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-60fdb63b-07ad-472c-b319-0d9a29727e9b tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] [instance: 15d4a46e-9504-4897-918d-39aafc20d22a] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:20.777699 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-60fdb63b-07ad-472c-b319-0d9a29727e9b tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:20.778375 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-60fdb63b-07ad-472c-b319-0d9a29727e9b tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:20.779279 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-60fdb63b-07ad-472c-b319-0d9a29727e9b tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:20.780276 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-60fdb63b-07ad-472c-b319-0d9a29727e9b tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:20.781184 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-60fdb63b-07ad-472c-b319-0d9a29727e9b tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:20.782827 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-60fdb63b-07ad-472c-b319-0d9a29727e9b tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:20.878100 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-198ac3f0-3a63-4de4-8b83-70feb3e38fae tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2715cf2a5129439c83a5347bb963f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4159dc366f41bc9e4057a079f6fb5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:20.888263 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-198ac3f0-3a63-4de4-8b83-70feb3e38fae tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "GET /compute/v2.1/servers/e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311" status: 200 len: 1367 microversion: 2.1 time: 0.217695 Aug 24 11:32:20.901886 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 64/119] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:20 2022] GET /compute/v2.1/servers/e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311 => generated 1367 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:32:20.981042 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-60fdb63b-07ad-472c-b319-0d9a29727e9b tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031939e16194f63b99e6f27f700fa8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecec6d0c155f4d658197c4779ab9ffce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:20.994107 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-60fdb63b-07ad-472c-b319-0d9a29727e9b tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] 10.222.0.84 "GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a" status: 200 len: 1363 microversion: 2.1 time: 0.227803 Aug 24 11:32:20.995631 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 56/120] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:20 2022] GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a => generated 1363 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:21.237375 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-3663ab12-3a8f-4052-8b24-c775c3c22128 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:21.238740 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-3663ab12-3a8f-4052-8b24-c775c3c22128 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: 2e661217-fb1a-48ad-9f1b-47985a4074de] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:21.254180 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-3663ab12-3a8f-4052-8b24-c775c3c22128 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:21.254743 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-3663ab12-3a8f-4052-8b24-c775c3c22128 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:21.255359 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-3663ab12-3a8f-4052-8b24-c775c3c22128 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:21.256497 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-3663ab12-3a8f-4052-8b24-c775c3c22128 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:21.257598 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-3663ab12-3a8f-4052-8b24-c775c3c22128 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:21.258308 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-3663ab12-3a8f-4052-8b24-c775c3c22128 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:21.275910 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-97ae8b18-e53b-406c-81ee-6e524037e2ad tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:21.277100 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-97ae8b18-e53b-406c-81ee-6e524037e2ad tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] [instance: 07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:21.284399 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-97ae8b18-e53b-406c-81ee-6e524037e2ad tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:21.285241 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-97ae8b18-e53b-406c-81ee-6e524037e2ad tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:21.285943 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-97ae8b18-e53b-406c-81ee-6e524037e2ad tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:21.286841 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-97ae8b18-e53b-406c-81ee-6e524037e2ad tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:21.287525 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-97ae8b18-e53b-406c-81ee-6e524037e2ad tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:21.288000 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-97ae8b18-e53b-406c-81ee-6e524037e2ad tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:21.425758 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-3663ab12-3a8f-4052-8b24-c775c3c22128 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:21.438336 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-3663ab12-3a8f-4052-8b24-c775c3c22128 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:21.440086 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-3663ab12-3a8f-4052-8b24-c775c3c22128 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:21.441354 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-3663ab12-3a8f-4052-8b24-c775c3c22128 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de" status: 200 len: 1408 microversion: 2.20 time: 0.212368 Aug 24 11:32:21.441908 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 65/121] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:32:21 2022] GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de => generated 1408 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:32:21.452121 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-97ae8b18-e53b-406c-81ee-6e524037e2ad tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cef1a9e6a241ac8401b88f4a0f69fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901780013b03485a83261796f69e1b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:21.461483 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-97ae8b18-e53b-406c-81ee-6e524037e2ad tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] 10.222.0.84 "GET /compute/v2.1/servers/07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0" status: 200 len: 1314 microversion: 2.1 time: 0.192582 Aug 24 11:32:21.461944 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 57/122] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:21 2022] GET /compute/v2.1/servers/07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0 => generated 1314 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:21.745427 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-cbd44d71-c40b-47f3-9203-f4c60946d17e tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:21.746027 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-cbd44d71-c40b-47f3-9203-f4c60946d17e tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: 2d4527c9-c18c-4028-a452-d23423d9c4ee] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:21.752471 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-cbd44d71-c40b-47f3-9203-f4c60946d17e tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:21.752992 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-cbd44d71-c40b-47f3-9203-f4c60946d17e tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:21.755170 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-cbd44d71-c40b-47f3-9203-f4c60946d17e tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:21.755170 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-cbd44d71-c40b-47f3-9203-f4c60946d17e tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:21.755170 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-cbd44d71-c40b-47f3-9203-f4c60946d17e tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:21.755170 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-cbd44d71-c40b-47f3-9203-f4c60946d17e tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:21.913380 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-cbd44d71-c40b-47f3-9203-f4c60946d17e tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:21.913804 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-d571eee9-4853-4fab-af7b-7a87ab3b59b2 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:21.915528 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-d571eee9-4853-4fab-af7b-7a87ab3b59b2 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:21.933381 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d571eee9-4853-4fab-af7b-7a87ab3b59b2 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:21.934229 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d571eee9-4853-4fab-af7b-7a87ab3b59b2 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:21.935548 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d571eee9-4853-4fab-af7b-7a87ab3b59b2 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:21.937456 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d571eee9-4853-4fab-af7b-7a87ab3b59b2 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:21.939395 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d571eee9-4853-4fab-af7b-7a87ab3b59b2 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:21.939996 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d571eee9-4853-4fab-af7b-7a87ab3b59b2 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:21.942418 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-cbd44d71-c40b-47f3-9203-f4c60946d17e tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee" status: 200 len: 1322 microversion: 2.1 time: 0.197570 Aug 24 11:32:21.945143 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 66/123] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:21 2022] GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee => generated 1322 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:22.018975 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-794b9f56-5e9b-4409-b11f-63d0c09abc94 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:22.019752 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-794b9f56-5e9b-4409-b11f-63d0c09abc94 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] [instance: 15d4a46e-9504-4897-918d-39aafc20d22a] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:22.027466 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-794b9f56-5e9b-4409-b11f-63d0c09abc94 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:22.028210 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-794b9f56-5e9b-4409-b11f-63d0c09abc94 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:22.028747 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-794b9f56-5e9b-4409-b11f-63d0c09abc94 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:22.029927 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-794b9f56-5e9b-4409-b11f-63d0c09abc94 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:22.030547 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-794b9f56-5e9b-4409-b11f-63d0c09abc94 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:22.032627 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-794b9f56-5e9b-4409-b11f-63d0c09abc94 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:22.246127 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-d571eee9-4853-4fab-af7b-7a87ab3b59b2 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2715cf2a5129439c83a5347bb963f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4159dc366f41bc9e4057a079f6fb5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:22.255173 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-d571eee9-4853-4fab-af7b-7a87ab3b59b2 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "GET /compute/v2.1/servers/e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311" status: 200 len: 1367 microversion: 2.1 time: 0.346576 Aug 24 11:32:22.255757 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 58/124] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:21 2022] GET /compute/v2.1/servers/e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311 => generated 1367 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:22.269914 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-794b9f56-5e9b-4409-b11f-63d0c09abc94 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031939e16194f63b99e6f27f700fa8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecec6d0c155f4d658197c4779ab9ffce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:22.278555 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-794b9f56-5e9b-4409-b11f-63d0c09abc94 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] 10.222.0.84 "GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a" status: 200 len: 1363 microversion: 2.1 time: 0.264760 Aug 24 11:32:22.279787 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 67/125] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:22 2022] GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a => generated 1363 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:22.465013 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-7dca12b2-c82c-46a0-976d-422385456010 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:22.465707 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-7dca12b2-c82c-46a0-976d-422385456010 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: 2e661217-fb1a-48ad-9f1b-47985a4074de] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:22.472137 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-7dca12b2-c82c-46a0-976d-422385456010 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:22.472622 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-7dca12b2-c82c-46a0-976d-422385456010 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:22.473291 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-7dca12b2-c82c-46a0-976d-422385456010 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:22.474128 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-7dca12b2-c82c-46a0-976d-422385456010 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:22.474671 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-7dca12b2-c82c-46a0-976d-422385456010 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:22.475106 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-7dca12b2-c82c-46a0-976d-422385456010 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:22.487363 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-8d0078b0-a977-478e-a1c0-4327cf0f71bb tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:22.488292 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-8d0078b0-a977-478e-a1c0-4327cf0f71bb tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] [instance: 07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:22.514449 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-8d0078b0-a977-478e-a1c0-4327cf0f71bb tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:22.519600 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-8d0078b0-a977-478e-a1c0-4327cf0f71bb tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:22.520155 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-8d0078b0-a977-478e-a1c0-4327cf0f71bb tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:22.522704 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-8d0078b0-a977-478e-a1c0-4327cf0f71bb tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:22.522704 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-8d0078b0-a977-478e-a1c0-4327cf0f71bb tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:22.529773 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-8d0078b0-a977-478e-a1c0-4327cf0f71bb tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:22.712521 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-8d0078b0-a977-478e-a1c0-4327cf0f71bb tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cef1a9e6a241ac8401b88f4a0f69fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901780013b03485a83261796f69e1b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:22.716290 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG dbcounter [-] [124769] Writing DB stats nova_cell1:SELECT=100 {{(pid=124769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:22.722087 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-8d0078b0-a977-478e-a1c0-4327cf0f71bb tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] 10.222.0.84 "GET /compute/v2.1/servers/07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0" status: 200 len: 1314 microversion: 2.1 time: 0.240120 Aug 24 11:32:22.723239 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 68/126] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:22 2022] GET /compute/v2.1/servers/07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0 => generated 1314 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:22.759027 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-7dca12b2-c82c-46a0-976d-422385456010 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:22.768282 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-7dca12b2-c82c-46a0-976d-422385456010 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:22.769805 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-7dca12b2-c82c-46a0-976d-422385456010 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:22.770916 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-7dca12b2-c82c-46a0-976d-422385456010 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de" status: 200 len: 1408 microversion: 2.20 time: 0.310153 Aug 24 11:32:22.771469 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 59/127] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:32:22 2022] GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de => generated 1408 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:32:22.969027 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-173b7321-6dd9-449a-95e0-93b089463127 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:22.969800 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-173b7321-6dd9-449a-95e0-93b089463127 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: 2d4527c9-c18c-4028-a452-d23423d9c4ee] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:22.975666 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-173b7321-6dd9-449a-95e0-93b089463127 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:22.976154 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-173b7321-6dd9-449a-95e0-93b089463127 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:22.976592 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-173b7321-6dd9-449a-95e0-93b089463127 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:22.977329 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-173b7321-6dd9-449a-95e0-93b089463127 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:22.977765 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-173b7321-6dd9-449a-95e0-93b089463127 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:22.978179 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-173b7321-6dd9-449a-95e0-93b089463127 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:23.061426 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [req-4b72f2fa-801d-46a2-84d7-e5c5f2cdd01d req-f7269e1a-6628-4928-9a2f-6b9bfc75adca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a7e223c-57dd-4ecc-a81f-9f4802472f4f", "name": "network-vif-plugged", "status": "completed", "tag": "ec53573c-c069-4fd3-ba2f-e0ddb8ebc30f"}]} {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:32:23.076669 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [req-4b72f2fa-801d-46a2-84d7-e5c5f2cdd01d req-f7269e1a-6628-4928-9a2f-6b9bfc75adca service nova] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:23.079679 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [req-4b72f2fa-801d-46a2-84d7-e5c5f2cdd01d req-f7269e1a-6628-4928-9a2f-6b9bfc75adca service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:23.080160 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [req-4b72f2fa-801d-46a2-84d7-e5c5f2cdd01d req-f7269e1a-6628-4928-9a2f-6b9bfc75adca service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:23.096526 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.compute.server_external_events [req-4b72f2fa-801d-46a2-84d7-e5c5f2cdd01d req-f7269e1a-6628-4928-9a2f-6b9bfc75adca service nova] Creating event network-vif-plugged:ec53573c-c069-4fd3-ba2f-e0ddb8ebc30f for instance 3a7e223c-57dd-4ecc-a81f-9f4802472f4f on hv-cinder-85427 Aug 24 11:32:23.105620 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [req-4b72f2fa-801d-46a2-84d7-e5c5f2cdd01d req-f7269e1a-6628-4928-9a2f-6b9bfc75adca service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.380923 Aug 24 11:32:23.106280 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 69/128] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Aug 24 11:32:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:32:23.162725 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-173b7321-6dd9-449a-95e0-93b089463127 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:23.171206 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-173b7321-6dd9-449a-95e0-93b089463127 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee" status: 200 len: 1322 microversion: 2.1 time: 0.207645 Aug 24 11:32:23.173089 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 60/129] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:22 2022] GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee => generated 1322 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:32:23.278409 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-088ca099-5549-4b76-a224-2f78bd2bbc8f tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:23.282460 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-088ca099-5549-4b76-a224-2f78bd2bbc8f tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:23.289147 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-088ca099-5549-4b76-a224-2f78bd2bbc8f tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:23.289652 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-088ca099-5549-4b76-a224-2f78bd2bbc8f tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:23.290084 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-088ca099-5549-4b76-a224-2f78bd2bbc8f tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:23.290786 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-088ca099-5549-4b76-a224-2f78bd2bbc8f tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:23.291242 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-088ca099-5549-4b76-a224-2f78bd2bbc8f tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:23.291658 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-088ca099-5549-4b76-a224-2f78bd2bbc8f tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:23.303468 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-f37ff6e1-9669-45db-b3da-6f65946c4af7 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:23.304081 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-f37ff6e1-9669-45db-b3da-6f65946c4af7 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] [instance: 15d4a46e-9504-4897-918d-39aafc20d22a] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:23.312839 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-f37ff6e1-9669-45db-b3da-6f65946c4af7 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:23.312839 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-f37ff6e1-9669-45db-b3da-6f65946c4af7 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:23.312839 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-f37ff6e1-9669-45db-b3da-6f65946c4af7 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:23.312839 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-f37ff6e1-9669-45db-b3da-6f65946c4af7 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:23.316148 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-f37ff6e1-9669-45db-b3da-6f65946c4af7 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:23.316148 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-f37ff6e1-9669-45db-b3da-6f65946c4af7 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:24.067084 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-088ca099-5549-4b76-a224-2f78bd2bbc8f tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2715cf2a5129439c83a5347bb963f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4159dc366f41bc9e4057a079f6fb5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:24.077524 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-088ca099-5549-4b76-a224-2f78bd2bbc8f tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "GET /compute/v2.1/servers/e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311" status: 200 len: 1367 microversion: 2.1 time: 0.804869 Aug 24 11:32:24.081112 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 70/130] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:23 2022] GET /compute/v2.1/servers/e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311 => generated 1367 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:24.099560 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-05c5f51b-de22-4e2d-aabb-66c994c21fbd tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:24.101244 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-05c5f51b-de22-4e2d-aabb-66c994c21fbd tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] [instance: 07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:24.116680 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-05c5f51b-de22-4e2d-aabb-66c994c21fbd tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:24.118385 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-05c5f51b-de22-4e2d-aabb-66c994c21fbd tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:24.119329 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-05c5f51b-de22-4e2d-aabb-66c994c21fbd tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:24.120217 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-05c5f51b-de22-4e2d-aabb-66c994c21fbd tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:24.121041 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-05c5f51b-de22-4e2d-aabb-66c994c21fbd tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:24.122375 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-05c5f51b-de22-4e2d-aabb-66c994c21fbd tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:24.456754 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-f37ff6e1-9669-45db-b3da-6f65946c4af7 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031939e16194f63b99e6f27f700fa8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecec6d0c155f4d658197c4779ab9ffce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:24.469633 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-f37ff6e1-9669-45db-b3da-6f65946c4af7 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] 10.222.0.84 "GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a" status: 200 len: 1363 microversion: 2.1 time: 1.170181 Aug 24 11:32:24.470536 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 61/131] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:23 2022] GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a => generated 1363 bytes in 1172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:32:24.476857 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-79784760-968e-4cc5-b0f9-4ed4775ccdb9 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:24.483978 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-79784760-968e-4cc5-b0f9-4ed4775ccdb9 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: 2e661217-fb1a-48ad-9f1b-47985a4074de] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:24.485722 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-79784760-968e-4cc5-b0f9-4ed4775ccdb9 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:24.486272 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-79784760-968e-4cc5-b0f9-4ed4775ccdb9 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:24.486888 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-79784760-968e-4cc5-b0f9-4ed4775ccdb9 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:24.487809 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-79784760-968e-4cc5-b0f9-4ed4775ccdb9 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:24.488531 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-79784760-968e-4cc5-b0f9-4ed4775ccdb9 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:24.489173 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-79784760-968e-4cc5-b0f9-4ed4775ccdb9 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:24.663001 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-05c5f51b-de22-4e2d-aabb-66c994c21fbd tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cef1a9e6a241ac8401b88f4a0f69fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901780013b03485a83261796f69e1b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:24.692560 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-05c5f51b-de22-4e2d-aabb-66c994c21fbd tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] 10.222.0.84 "GET /compute/v2.1/servers/07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0" status: 200 len: 1314 microversion: 2.1 time: 0.607190 Aug 24 11:32:24.693969 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 71/132] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:24 2022] GET /compute/v2.1/servers/07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0 => generated 1314 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:24.726386 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-266d1d95-434b-4a41-a209-71c584110090 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:24.727016 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-266d1d95-434b-4a41-a209-71c584110090 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: 2d4527c9-c18c-4028-a452-d23423d9c4ee] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:24.749123 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-266d1d95-434b-4a41-a209-71c584110090 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:24.751217 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-266d1d95-434b-4a41-a209-71c584110090 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:24.751821 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-266d1d95-434b-4a41-a209-71c584110090 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:24.752661 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-266d1d95-434b-4a41-a209-71c584110090 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:24.753245 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-266d1d95-434b-4a41-a209-71c584110090 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:24.757804 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-266d1d95-434b-4a41-a209-71c584110090 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:25.004584 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-266d1d95-434b-4a41-a209-71c584110090 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:25.024607 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-266d1d95-434b-4a41-a209-71c584110090 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee" status: 200 len: 1322 microversion: 2.1 time: 0.329104 Aug 24 11:32:25.039056 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-79784760-968e-4cc5-b0f9-4ed4775ccdb9 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:25.043327 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 72/133] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:24 2022] GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee => generated 1322 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:25.052190 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-79784760-968e-4cc5-b0f9-4ed4775ccdb9 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:25.061260 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-79784760-968e-4cc5-b0f9-4ed4775ccdb9 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:25.064692 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-79784760-968e-4cc5-b0f9-4ed4775ccdb9 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de" status: 200 len: 1408 microversion: 2.20 time: 0.592908 Aug 24 11:32:25.068428 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 62/134] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:32:24 2022] GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de => generated 1408 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:32:25.100724 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-1aa34b8d-b396-4acf-8610-e32093c32392 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:25.102047 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-1aa34b8d-b396-4acf-8610-e32093c32392 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:25.113251 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-1aa34b8d-b396-4acf-8610-e32093c32392 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:25.113866 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-1aa34b8d-b396-4acf-8610-e32093c32392 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:25.124531 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-1aa34b8d-b396-4acf-8610-e32093c32392 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:25.125864 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-1aa34b8d-b396-4acf-8610-e32093c32392 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:25.127948 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [req-ad7e372f-03a8-4171-9ab3-398964bb8c72 req-76510b7f-85e2-4872-9a2a-4187c7268b40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0", "name": "network-vif-plugged", "status": "completed", "tag": "6b1e0c30-55ba-4a63-afed-d5e130d41fb3"}]} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:32:25.128856 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-1aa34b8d-b396-4acf-8610-e32093c32392 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:25.129536 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-1aa34b8d-b396-4acf-8610-e32093c32392 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:25.146164 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:25.159521 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-ad7e372f-03a8-4171-9ab3-398964bb8c72 req-76510b7f-85e2-4872-9a2a-4187c7268b40 service nova] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:25.160128 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-ad7e372f-03a8-4171-9ab3-398964bb8c72 req-76510b7f-85e2-4872-9a2a-4187c7268b40 service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:25.160746 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-ad7e372f-03a8-4171-9ab3-398964bb8c72 req-76510b7f-85e2-4872-9a2a-4187c7268b40 service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:25.189820 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.compute.server_external_events [req-ad7e372f-03a8-4171-9ab3-398964bb8c72 req-76510b7f-85e2-4872-9a2a-4187c7268b40 service nova] Creating event network-vif-plugged:6b1e0c30-55ba-4a63-afed-d5e130d41fb3 for instance 07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0 on hv-cinder-85427 Aug 24 11:32:25.204192 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [req-ad7e372f-03a8-4171-9ab3-398964bb8c72 req-76510b7f-85e2-4872-9a2a-4187c7268b40 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078559 Aug 24 11:32:25.211868 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 63/135] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Aug 24 11:32:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:32:25.349638 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-1aa34b8d-b396-4acf-8610-e32093c32392 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2715cf2a5129439c83a5347bb963f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4159dc366f41bc9e4057a079f6fb5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:25.359943 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-1aa34b8d-b396-4acf-8610-e32093c32392 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "GET /compute/v2.1/servers/e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311" status: 200 len: 1367 microversion: 2.1 time: 0.263360 Aug 24 11:32:25.361683 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 73/136] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:25 2022] GET /compute/v2.1/servers/e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311 => generated 1367 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:25.505057 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-2febb025-77c2-4a11-9511-360c098a8959 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:25.505922 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-2febb025-77c2-4a11-9511-360c098a8959 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] [instance: 15d4a46e-9504-4897-918d-39aafc20d22a] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:25.512451 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-2febb025-77c2-4a11-9511-360c098a8959 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:25.512984 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-2febb025-77c2-4a11-9511-360c098a8959 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:25.513418 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-2febb025-77c2-4a11-9511-360c098a8959 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:25.514475 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-2febb025-77c2-4a11-9511-360c098a8959 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:25.514582 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-2febb025-77c2-4a11-9511-360c098a8959 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:25.514945 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-2febb025-77c2-4a11-9511-360c098a8959 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:25.676485 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-2febb025-77c2-4a11-9511-360c098a8959 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031939e16194f63b99e6f27f700fa8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecec6d0c155f4d658197c4779ab9ffce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:25.685094 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-2febb025-77c2-4a11-9511-360c098a8959 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] 10.222.0.84 "GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a" status: 200 len: 1363 microversion: 2.1 time: 0.184350 Aug 24 11:32:25.686144 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 64/137] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:25 2022] GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a => generated 1363 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:32:25.715833 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-6c7f74ce-296e-48dd-8e40-9f89141fc9a1 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:25.717028 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-6c7f74ce-296e-48dd-8e40-9f89141fc9a1 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] [instance: 07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:25.724215 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-6c7f74ce-296e-48dd-8e40-9f89141fc9a1 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:25.724774 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-6c7f74ce-296e-48dd-8e40-9f89141fc9a1 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:25.725305 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-6c7f74ce-296e-48dd-8e40-9f89141fc9a1 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:25.726156 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-6c7f74ce-296e-48dd-8e40-9f89141fc9a1 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:25.726681 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-6c7f74ce-296e-48dd-8e40-9f89141fc9a1 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:25.727165 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-6c7f74ce-296e-48dd-8e40-9f89141fc9a1 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:25.874271 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-6c7f74ce-296e-48dd-8e40-9f89141fc9a1 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cef1a9e6a241ac8401b88f4a0f69fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901780013b03485a83261796f69e1b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:25.882058 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-6c7f74ce-296e-48dd-8e40-9f89141fc9a1 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] 10.222.0.84 "GET /compute/v2.1/servers/07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0" status: 200 len: 1314 microversion: 2.1 time: 0.170592 Aug 24 11:32:25.882618 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 74/138] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:25 2022] GET /compute/v2.1/servers/07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:26.047141 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-f2c40f35-44ca-4c65-9674-9d3ded3f3740 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:26.047661 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-f2c40f35-44ca-4c65-9674-9d3ded3f3740 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: 2d4527c9-c18c-4028-a452-d23423d9c4ee] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:26.053559 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-f2c40f35-44ca-4c65-9674-9d3ded3f3740 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:26.054042 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-f2c40f35-44ca-4c65-9674-9d3ded3f3740 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:26.054520 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-f2c40f35-44ca-4c65-9674-9d3ded3f3740 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:26.055185 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-f2c40f35-44ca-4c65-9674-9d3ded3f3740 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:26.055628 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-f2c40f35-44ca-4c65-9674-9d3ded3f3740 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:26.056040 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-f2c40f35-44ca-4c65-9674-9d3ded3f3740 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:26.099557 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-fa1543b0-f67c-48f6-9b94-7a15acbe162a tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:26.100218 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-fa1543b0-f67c-48f6-9b94-7a15acbe162a tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: 2e661217-fb1a-48ad-9f1b-47985a4074de] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:26.120010 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-fa1543b0-f67c-48f6-9b94-7a15acbe162a tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:26.120677 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-fa1543b0-f67c-48f6-9b94-7a15acbe162a tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:26.122081 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-fa1543b0-f67c-48f6-9b94-7a15acbe162a tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:26.123489 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-fa1543b0-f67c-48f6-9b94-7a15acbe162a tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:26.124242 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-fa1543b0-f67c-48f6-9b94-7a15acbe162a tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:26.125918 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-fa1543b0-f67c-48f6-9b94-7a15acbe162a tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:26.229147 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-f2c40f35-44ca-4c65-9674-9d3ded3f3740 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:26.239445 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-f2c40f35-44ca-4c65-9674-9d3ded3f3740 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee" status: 200 len: 1322 microversion: 2.1 time: 0.196134 Aug 24 11:32:26.240656 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 65/139] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:26 2022] GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee => generated 1322 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:26.316427 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-fa1543b0-f67c-48f6-9b94-7a15acbe162a tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:26.327252 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-fa1543b0-f67c-48f6-9b94-7a15acbe162a tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:26.333001 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-fa1543b0-f67c-48f6-9b94-7a15acbe162a tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:26.333001 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-fa1543b0-f67c-48f6-9b94-7a15acbe162a tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de" status: 200 len: 1408 microversion: 2.20 time: 0.237119 Aug 24 11:32:26.333001 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 75/140] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:32:26 2022] GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de => generated 1408 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:32:26.382554 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-1b470a08-993e-4035-a117-825ef34b2ec0 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:26.383170 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-1b470a08-993e-4035-a117-825ef34b2ec0 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:26.390009 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1b470a08-993e-4035-a117-825ef34b2ec0 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:26.390833 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1b470a08-993e-4035-a117-825ef34b2ec0 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:26.391223 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1b470a08-993e-4035-a117-825ef34b2ec0 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:26.392372 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1b470a08-993e-4035-a117-825ef34b2ec0 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:26.392915 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1b470a08-993e-4035-a117-825ef34b2ec0 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:26.393345 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1b470a08-993e-4035-a117-825ef34b2ec0 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:26.410959 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_cell1:SELECT=100 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:26.546534 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-1b470a08-993e-4035-a117-825ef34b2ec0 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2715cf2a5129439c83a5347bb963f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4159dc366f41bc9e4057a079f6fb5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:26.555780 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-1b470a08-993e-4035-a117-825ef34b2ec0 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "GET /compute/v2.1/servers/e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311" status: 200 len: 1367 microversion: 2.1 time: 0.177410 Aug 24 11:32:26.556502 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 66/141] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:26 2022] GET /compute/v2.1/servers/e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311 => generated 1367 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:26.706779 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-44c11085-6e04-4fa7-b836-6f5713c157f4 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:26.707546 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-44c11085-6e04-4fa7-b836-6f5713c157f4 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] [instance: 15d4a46e-9504-4897-918d-39aafc20d22a] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:26.714630 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-44c11085-6e04-4fa7-b836-6f5713c157f4 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:26.721283 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-44c11085-6e04-4fa7-b836-6f5713c157f4 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:26.721283 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-44c11085-6e04-4fa7-b836-6f5713c157f4 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:26.721283 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-44c11085-6e04-4fa7-b836-6f5713c157f4 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:26.721283 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-44c11085-6e04-4fa7-b836-6f5713c157f4 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:26.722080 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-44c11085-6e04-4fa7-b836-6f5713c157f4 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:26.859819 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-44c11085-6e04-4fa7-b836-6f5713c157f4 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031939e16194f63b99e6f27f700fa8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecec6d0c155f4d658197c4779ab9ffce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:26.867602 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-44c11085-6e04-4fa7-b836-6f5713c157f4 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] 10.222.0.84 "GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a" status: 200 len: 1363 microversion: 2.1 time: 0.165668 Aug 24 11:32:26.868158 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 76/142] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:26 2022] GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a => generated 1363 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:26.903431 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-d502a7a3-e8c3-4efa-963e-7436e5687d56 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:26.904041 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-d502a7a3-e8c3-4efa-963e-7436e5687d56 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] [instance: 07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:26.910783 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d502a7a3-e8c3-4efa-963e-7436e5687d56 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:26.911277 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d502a7a3-e8c3-4efa-963e-7436e5687d56 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:26.919031 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d502a7a3-e8c3-4efa-963e-7436e5687d56 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:26.919031 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d502a7a3-e8c3-4efa-963e-7436e5687d56 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:26.919031 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d502a7a3-e8c3-4efa-963e-7436e5687d56 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:26.919031 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d502a7a3-e8c3-4efa-963e-7436e5687d56 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:27.054590 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-d502a7a3-e8c3-4efa-963e-7436e5687d56 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cef1a9e6a241ac8401b88f4a0f69fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901780013b03485a83261796f69e1b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:27.062834 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-d502a7a3-e8c3-4efa-963e-7436e5687d56 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] 10.222.0.84 "GET /compute/v2.1/servers/07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0" status: 200 len: 1314 microversion: 2.1 time: 0.162734 Aug 24 11:32:27.063811 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 67/143] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:26 2022] GET /compute/v2.1/servers/07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:27.271891 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-21560b3b-642b-455d-a4f7-98b5f9e12898 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:27.272638 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-21560b3b-642b-455d-a4f7-98b5f9e12898 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: 2d4527c9-c18c-4028-a452-d23423d9c4ee] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:27.279753 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-21560b3b-642b-455d-a4f7-98b5f9e12898 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:27.280239 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-21560b3b-642b-455d-a4f7-98b5f9e12898 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:27.280672 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-21560b3b-642b-455d-a4f7-98b5f9e12898 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:27.281459 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-21560b3b-642b-455d-a4f7-98b5f9e12898 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:27.282267 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-21560b3b-642b-455d-a4f7-98b5f9e12898 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:27.282831 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-21560b3b-642b-455d-a4f7-98b5f9e12898 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:27.353946 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-5ad44de9-667c-47e4-92d4-5d93022aa423 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:27.354562 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-5ad44de9-667c-47e4-92d4-5d93022aa423 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: 2e661217-fb1a-48ad-9f1b-47985a4074de] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:27.361649 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5ad44de9-667c-47e4-92d4-5d93022aa423 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:27.361969 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5ad44de9-667c-47e4-92d4-5d93022aa423 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:27.362420 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5ad44de9-667c-47e4-92d4-5d93022aa423 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:27.363131 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5ad44de9-667c-47e4-92d4-5d93022aa423 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:27.363595 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5ad44de9-667c-47e4-92d4-5d93022aa423 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:27.364021 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5ad44de9-667c-47e4-92d4-5d93022aa423 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:27.515217 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-5ad44de9-667c-47e4-92d4-5d93022aa423 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:27.524626 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-5ad44de9-667c-47e4-92d4-5d93022aa423 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:27.526306 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-5ad44de9-667c-47e4-92d4-5d93022aa423 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:27.527506 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-5ad44de9-667c-47e4-92d4-5d93022aa423 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de" status: 200 len: 1408 microversion: 2.20 time: 0.177753 Aug 24 11:32:27.528048 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 68/144] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:32:27 2022] GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de => generated 1408 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 11:32:27.577490 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-7c8706c9-0208-4b03-84d2-16322484c206 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:27.578157 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-7c8706c9-0208-4b03-84d2-16322484c206 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:27.585016 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-7c8706c9-0208-4b03-84d2-16322484c206 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:27.585509 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-7c8706c9-0208-4b03-84d2-16322484c206 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:27.585950 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-7c8706c9-0208-4b03-84d2-16322484c206 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:27.586896 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-7c8706c9-0208-4b03-84d2-16322484c206 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:27.587670 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-7c8706c9-0208-4b03-84d2-16322484c206 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:27.588340 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-7c8706c9-0208-4b03-84d2-16322484c206 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:27.713701 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-21560b3b-642b-455d-a4f7-98b5f9e12898 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:27.723337 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-21560b3b-642b-455d-a4f7-98b5f9e12898 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee" status: 200 len: 1322 microversion: 2.1 time: 0.459535 Aug 24 11:32:27.724438 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 77/145] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:27 2022] GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee => generated 1322 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:27.783405 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-7c8706c9-0208-4b03-84d2-16322484c206 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2715cf2a5129439c83a5347bb963f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4159dc366f41bc9e4057a079f6fb5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:27.791538 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-7c8706c9-0208-4b03-84d2-16322484c206 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "GET /compute/v2.1/servers/e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311" status: 200 len: 1367 microversion: 2.1 time: 0.217992 Aug 24 11:32:27.792138 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 69/146] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:27 2022] GET /compute/v2.1/servers/e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311 => generated 1367 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:27.889227 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-b7a4bb66-5341-4530-8bed-b79bf6f5bbfa tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:27.890174 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-b7a4bb66-5341-4530-8bed-b79bf6f5bbfa tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] [instance: 15d4a46e-9504-4897-918d-39aafc20d22a] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:27.896781 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-b7a4bb66-5341-4530-8bed-b79bf6f5bbfa tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:27.897298 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-b7a4bb66-5341-4530-8bed-b79bf6f5bbfa tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:27.897763 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-b7a4bb66-5341-4530-8bed-b79bf6f5bbfa tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:27.898529 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-b7a4bb66-5341-4530-8bed-b79bf6f5bbfa tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:27.899049 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-b7a4bb66-5341-4530-8bed-b79bf6f5bbfa tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:27.899476 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-b7a4bb66-5341-4530-8bed-b79bf6f5bbfa tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:28.057303 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-b7a4bb66-5341-4530-8bed-b79bf6f5bbfa tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031939e16194f63b99e6f27f700fa8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecec6d0c155f4d658197c4779ab9ffce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:28.065630 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-b7a4bb66-5341-4530-8bed-b79bf6f5bbfa tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] 10.222.0.84 "GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a" status: 200 len: 1363 microversion: 2.1 time: 0.180506 Aug 24 11:32:28.066213 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 78/147] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:27 2022] GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a => generated 1363 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:28.084306 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-01a6e5f8-3997-4fc3-b541-0e04b6a7f75c tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:28.084959 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-01a6e5f8-3997-4fc3-b541-0e04b6a7f75c tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] [instance: 07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:28.091234 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-01a6e5f8-3997-4fc3-b541-0e04b6a7f75c tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:28.091794 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-01a6e5f8-3997-4fc3-b541-0e04b6a7f75c tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:28.092237 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-01a6e5f8-3997-4fc3-b541-0e04b6a7f75c tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:28.092972 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-01a6e5f8-3997-4fc3-b541-0e04b6a7f75c tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:28.094032 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-01a6e5f8-3997-4fc3-b541-0e04b6a7f75c tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:28.094452 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-01a6e5f8-3997-4fc3-b541-0e04b6a7f75c tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:28.231365 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-01a6e5f8-3997-4fc3-b541-0e04b6a7f75c tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cef1a9e6a241ac8401b88f4a0f69fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901780013b03485a83261796f69e1b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:28.239622 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-01a6e5f8-3997-4fc3-b541-0e04b6a7f75c tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] 10.222.0.84 "GET /compute/v2.1/servers/07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0" status: 200 len: 1314 microversion: 2.1 time: 0.159199 Aug 24 11:32:28.240204 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 70/148] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:28 2022] GET /compute/v2.1/servers/07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:28.553622 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-01ac4ad6-8d57-4dc5-81f8-17e6b59a67c6 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:28.554820 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-01ac4ad6-8d57-4dc5-81f8-17e6b59a67c6 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: 2e661217-fb1a-48ad-9f1b-47985a4074de] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:28.567672 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-01ac4ad6-8d57-4dc5-81f8-17e6b59a67c6 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:28.568316 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-01ac4ad6-8d57-4dc5-81f8-17e6b59a67c6 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:28.568841 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-01ac4ad6-8d57-4dc5-81f8-17e6b59a67c6 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:28.569958 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-01ac4ad6-8d57-4dc5-81f8-17e6b59a67c6 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:28.570543 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-01ac4ad6-8d57-4dc5-81f8-17e6b59a67c6 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:28.571092 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-01ac4ad6-8d57-4dc5-81f8-17e6b59a67c6 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:28.746409 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-0361c469-24d1-4b13-aa2a-01dc6c0b5a81 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:28.752107 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-0361c469-24d1-4b13-aa2a-01dc6c0b5a81 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: 2d4527c9-c18c-4028-a452-d23423d9c4ee] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:28.762700 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-0361c469-24d1-4b13-aa2a-01dc6c0b5a81 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:28.764494 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-0361c469-24d1-4b13-aa2a-01dc6c0b5a81 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:28.765946 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-0361c469-24d1-4b13-aa2a-01dc6c0b5a81 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:28.770293 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-0361c469-24d1-4b13-aa2a-01dc6c0b5a81 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:28.771235 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-0361c469-24d1-4b13-aa2a-01dc6c0b5a81 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:28.772236 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-0361c469-24d1-4b13-aa2a-01dc6c0b5a81 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:28.830014 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-01ac4ad6-8d57-4dc5-81f8-17e6b59a67c6 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:28.843445 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-01ac4ad6-8d57-4dc5-81f8-17e6b59a67c6 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:28.847008 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-01ac4ad6-8d57-4dc5-81f8-17e6b59a67c6 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:28.850439 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-01ac4ad6-8d57-4dc5-81f8-17e6b59a67c6 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de" status: 200 len: 1408 microversion: 2.20 time: 0.303301 Aug 24 11:32:28.851704 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 79/149] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:32:28 2022] GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de => generated 1408 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:32:28.858635 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [req-80fe9126-c1da-4f7e-94c6-064ef67faea3 req-c36dac9b-e106-4baa-9657-e090f5a84100 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d4527c9-c18c-4028-a452-d23423d9c4ee", "name": "network-vif-plugged", "status": "completed", "tag": "e12ef962-191c-4cfc-8320-f430d725d0bb"}]} {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:32:28.873227 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [req-80fe9126-c1da-4f7e-94c6-064ef67faea3 req-c36dac9b-e106-4baa-9657-e090f5a84100 service nova] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:28.874129 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [req-80fe9126-c1da-4f7e-94c6-064ef67faea3 req-c36dac9b-e106-4baa-9657-e090f5a84100 service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:28.875899 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [req-80fe9126-c1da-4f7e-94c6-064ef67faea3 req-c36dac9b-e106-4baa-9657-e090f5a84100 service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:28.901207 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.compute.server_external_events [req-80fe9126-c1da-4f7e-94c6-064ef67faea3 req-c36dac9b-e106-4baa-9657-e090f5a84100 service nova] Creating event network-vif-plugged:e12ef962-191c-4cfc-8320-f430d725d0bb for instance 2d4527c9-c18c-4028-a452-d23423d9c4ee on hv-cinder-85427 Aug 24 11:32:28.907166 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [req-80fe9126-c1da-4f7e-94c6-064ef67faea3 req-c36dac9b-e106-4baa-9657-e090f5a84100 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053026 Aug 24 11:32:28.907914 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 80/150] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Aug 24 11:32:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:32:28.913797 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-dfa20c0e-02cb-4624-8c4f-c99054bbed88 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:28.914384 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-dfa20c0e-02cb-4624-8c4f-c99054bbed88 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:28.920879 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-dfa20c0e-02cb-4624-8c4f-c99054bbed88 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:28.921372 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-dfa20c0e-02cb-4624-8c4f-c99054bbed88 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:28.922270 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-dfa20c0e-02cb-4624-8c4f-c99054bbed88 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:28.925564 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-dfa20c0e-02cb-4624-8c4f-c99054bbed88 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:28.925564 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-dfa20c0e-02cb-4624-8c4f-c99054bbed88 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:28.925564 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-dfa20c0e-02cb-4624-8c4f-c99054bbed88 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:28.946502 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-0361c469-24d1-4b13-aa2a-01dc6c0b5a81 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:28.960642 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-0361c469-24d1-4b13-aa2a-01dc6c0b5a81 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee" status: 200 len: 1322 microversion: 2.1 time: 0.215047 Aug 24 11:32:28.960642 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 71/151] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:28 2022] GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee => generated 1322 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:29.070669 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-dfa20c0e-02cb-4624-8c4f-c99054bbed88 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2715cf2a5129439c83a5347bb963f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4159dc366f41bc9e4057a079f6fb5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:29.079555 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-dfa20c0e-02cb-4624-8c4f-c99054bbed88 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "GET /compute/v2.1/servers/e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311" status: 200 len: 1367 microversion: 2.1 time: 0.170271 Aug 24 11:32:29.080119 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 81/152] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:28 2022] GET /compute/v2.1/servers/e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311 => generated 1367 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:29.087116 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-834835d7-1099-4c57-b41a-c6cf4b8cb4d6 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:29.087759 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-834835d7-1099-4c57-b41a-c6cf4b8cb4d6 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] [instance: 15d4a46e-9504-4897-918d-39aafc20d22a] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:29.099671 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-834835d7-1099-4c57-b41a-c6cf4b8cb4d6 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:29.100226 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-834835d7-1099-4c57-b41a-c6cf4b8cb4d6 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:29.102166 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-834835d7-1099-4c57-b41a-c6cf4b8cb4d6 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:29.103156 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-834835d7-1099-4c57-b41a-c6cf4b8cb4d6 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:29.103784 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-834835d7-1099-4c57-b41a-c6cf4b8cb4d6 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:29.104392 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-834835d7-1099-4c57-b41a-c6cf4b8cb4d6 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:29.267992 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-834835d7-1099-4c57-b41a-c6cf4b8cb4d6 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031939e16194f63b99e6f27f700fa8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecec6d0c155f4d658197c4779ab9ffce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:29.268615 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-e2e80611-d5b2-4372-9030-a24c870a6a30 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:29.269199 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-e2e80611-d5b2-4372-9030-a24c870a6a30 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] [instance: 07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:29.285798 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-e2e80611-d5b2-4372-9030-a24c870a6a30 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:29.286640 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-e2e80611-d5b2-4372-9030-a24c870a6a30 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:29.289156 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-e2e80611-d5b2-4372-9030-a24c870a6a30 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:29.290327 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-e2e80611-d5b2-4372-9030-a24c870a6a30 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:29.292152 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-e2e80611-d5b2-4372-9030-a24c870a6a30 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:29.292888 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-e2e80611-d5b2-4372-9030-a24c870a6a30 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:29.293764 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-834835d7-1099-4c57-b41a-c6cf4b8cb4d6 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] 10.222.0.84 "GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a" status: 200 len: 1363 microversion: 2.1 time: 0.210405 Aug 24 11:32:29.317045 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 72/153] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:29 2022] GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a => generated 1363 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:32:29.489161 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-e2e80611-d5b2-4372-9030-a24c870a6a30 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cef1a9e6a241ac8401b88f4a0f69fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901780013b03485a83261796f69e1b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:29.505449 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-e2e80611-d5b2-4372-9030-a24c870a6a30 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] 10.222.0.84 "GET /compute/v2.1/servers/07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0" status: 200 len: 1314 microversion: 2.1 time: 0.240439 Aug 24 11:32:29.505449 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 82/154] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:29 2022] GET /compute/v2.1/servers/07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0 => generated 1314 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:32:29.876006 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-b60066c0-e838-42b9-826f-3c55912cf371 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:29.876606 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-b60066c0-e838-42b9-826f-3c55912cf371 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: 2e661217-fb1a-48ad-9f1b-47985a4074de] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:29.882721 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b60066c0-e838-42b9-826f-3c55912cf371 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:29.885619 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b60066c0-e838-42b9-826f-3c55912cf371 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:29.885619 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b60066c0-e838-42b9-826f-3c55912cf371 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:29.885619 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b60066c0-e838-42b9-826f-3c55912cf371 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:29.885619 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b60066c0-e838-42b9-826f-3c55912cf371 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:29.885925 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b60066c0-e838-42b9-826f-3c55912cf371 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:29.978699 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-83de8f04-5655-4efa-8fb8-a22a77daac81 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:29.979468 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-83de8f04-5655-4efa-8fb8-a22a77daac81 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: 2d4527c9-c18c-4028-a452-d23423d9c4ee] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:29.987002 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-83de8f04-5655-4efa-8fb8-a22a77daac81 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:29.987571 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-83de8f04-5655-4efa-8fb8-a22a77daac81 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:29.988078 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-83de8f04-5655-4efa-8fb8-a22a77daac81 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:29.988891 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-83de8f04-5655-4efa-8fb8-a22a77daac81 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:29.989425 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-83de8f04-5655-4efa-8fb8-a22a77daac81 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:29.989849 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-83de8f04-5655-4efa-8fb8-a22a77daac81 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:30.128089 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-b60066c0-e838-42b9-826f-3c55912cf371 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:30.142196 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-b60066c0-e838-42b9-826f-3c55912cf371 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:30.143981 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-b60066c0-e838-42b9-826f-3c55912cf371 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:30.145115 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-b60066c0-e838-42b9-826f-3c55912cf371 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de" status: 200 len: 1408 microversion: 2.20 time: 0.273115 Aug 24 11:32:30.145668 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 73/155] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:32:29 2022] GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de => generated 1408 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 11:32:30.151693 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-0c2d5f52-102c-4a4b-afc1-d205cba2134e tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:30.152301 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-0c2d5f52-102c-4a4b-afc1-d205cba2134e tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:30.160733 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-0c2d5f52-102c-4a4b-afc1-d205cba2134e tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:30.161513 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-0c2d5f52-102c-4a4b-afc1-d205cba2134e tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:30.161999 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-0c2d5f52-102c-4a4b-afc1-d205cba2134e tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:30.163631 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-0c2d5f52-102c-4a4b-afc1-d205cba2134e tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:30.164308 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-0c2d5f52-102c-4a4b-afc1-d205cba2134e tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:30.164734 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-0c2d5f52-102c-4a4b-afc1-d205cba2134e tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:30.176587 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-83de8f04-5655-4efa-8fb8-a22a77daac81 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:30.185468 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-83de8f04-5655-4efa-8fb8-a22a77daac81 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee" status: 200 len: 1322 microversion: 2.1 time: 0.210618 Aug 24 11:32:30.186253 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 83/156] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:29 2022] GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee => generated 1322 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:30.320498 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-48d1258e-e9fa-4cea-adf1-ca0af22dab7e tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:30.321170 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-48d1258e-e9fa-4cea-adf1-ca0af22dab7e tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] [instance: 15d4a46e-9504-4897-918d-39aafc20d22a] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:30.328285 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-48d1258e-e9fa-4cea-adf1-ca0af22dab7e tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:30.336710 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-48d1258e-e9fa-4cea-adf1-ca0af22dab7e tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:30.336710 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-48d1258e-e9fa-4cea-adf1-ca0af22dab7e tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:30.336710 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-48d1258e-e9fa-4cea-adf1-ca0af22dab7e tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:30.336710 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-48d1258e-e9fa-4cea-adf1-ca0af22dab7e tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:30.337111 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-48d1258e-e9fa-4cea-adf1-ca0af22dab7e tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:30.383588 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-0c2d5f52-102c-4a4b-afc1-d205cba2134e tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2715cf2a5129439c83a5347bb963f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4159dc366f41bc9e4057a079f6fb5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:30.394097 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-0c2d5f52-102c-4a4b-afc1-d205cba2134e tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "GET /compute/v2.1/servers/e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311" status: 200 len: 1367 microversion: 2.1 time: 0.246161 Aug 24 11:32:30.395300 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 74/157] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:30 2022] GET /compute/v2.1/servers/e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311 => generated 1367 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:30.513607 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-48d1258e-e9fa-4cea-adf1-ca0af22dab7e tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031939e16194f63b99e6f27f700fa8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecec6d0c155f4d658197c4779ab9ffce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:30.526608 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-93f64c2e-1168-4c34-8602-5588792c332c tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:30.527514 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-93f64c2e-1168-4c34-8602-5588792c332c tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] [instance: 07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:30.533499 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-48d1258e-e9fa-4cea-adf1-ca0af22dab7e tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] 10.222.0.84 "GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a" status: 200 len: 1363 microversion: 2.1 time: 0.203491 Aug 24 11:32:30.534321 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 84/158] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:30 2022] GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a => generated 1363 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:32:30.537154 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-93f64c2e-1168-4c34-8602-5588792c332c tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:30.538373 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-93f64c2e-1168-4c34-8602-5588792c332c tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:30.538373 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-93f64c2e-1168-4c34-8602-5588792c332c tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:30.539096 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-93f64c2e-1168-4c34-8602-5588792c332c tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:30.539695 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-93f64c2e-1168-4c34-8602-5588792c332c tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:30.540463 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-93f64c2e-1168-4c34-8602-5588792c332c tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:30.764652 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-93f64c2e-1168-4c34-8602-5588792c332c tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cef1a9e6a241ac8401b88f4a0f69fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901780013b03485a83261796f69e1b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:30.774149 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-93f64c2e-1168-4c34-8602-5588792c332c tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] 10.222.0.84 "GET /compute/v2.1/servers/07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0" status: 200 len: 1314 microversion: 2.1 time: 0.253103 Aug 24 11:32:30.774735 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 75/159] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:30 2022] GET /compute/v2.1/servers/07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0 => generated 1314 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:32:31.168529 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-778a6e63-2648-4f47-af31-694caa8d09a9 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:31.169315 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-778a6e63-2648-4f47-af31-694caa8d09a9 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: 2e661217-fb1a-48ad-9f1b-47985a4074de] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:31.175468 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-778a6e63-2648-4f47-af31-694caa8d09a9 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:31.175942 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-778a6e63-2648-4f47-af31-694caa8d09a9 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:31.176368 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-778a6e63-2648-4f47-af31-694caa8d09a9 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:31.177082 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-778a6e63-2648-4f47-af31-694caa8d09a9 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:31.177527 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-778a6e63-2648-4f47-af31-694caa8d09a9 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:31.177946 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-778a6e63-2648-4f47-af31-694caa8d09a9 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:31.218196 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-c31535b7-6c7d-4bde-866e-400a7005d3ef tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:31.220298 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-c31535b7-6c7d-4bde-866e-400a7005d3ef tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: 2d4527c9-c18c-4028-a452-d23423d9c4ee] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:31.226422 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c31535b7-6c7d-4bde-866e-400a7005d3ef tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:31.226838 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c31535b7-6c7d-4bde-866e-400a7005d3ef tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:31.227275 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c31535b7-6c7d-4bde-866e-400a7005d3ef tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:31.228017 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c31535b7-6c7d-4bde-866e-400a7005d3ef tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:31.228473 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c31535b7-6c7d-4bde-866e-400a7005d3ef tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:31.228922 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c31535b7-6c7d-4bde-866e-400a7005d3ef tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:31.332789 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-778a6e63-2648-4f47-af31-694caa8d09a9 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:31.342098 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-778a6e63-2648-4f47-af31-694caa8d09a9 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:31.345188 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-778a6e63-2648-4f47-af31-694caa8d09a9 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:31.345188 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-778a6e63-2648-4f47-af31-694caa8d09a9 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de" status: 200 len: 1408 microversion: 2.20 time: 0.180505 Aug 24 11:32:31.345915 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 85/160] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:32:31 2022] GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de => generated 1408 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:32:31.420340 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-06a4d7b9-92d2-43f8-ad7e-d32049ba32af tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:31.422267 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-06a4d7b9-92d2-43f8-ad7e-d32049ba32af tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:31.426714 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG dbcounter [-] [124769] Writing DB stats nova_api:SELECT=100 {{(pid=124769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:31.432326 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-06a4d7b9-92d2-43f8-ad7e-d32049ba32af tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:31.433117 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-06a4d7b9-92d2-43f8-ad7e-d32049ba32af tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:31.434014 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-06a4d7b9-92d2-43f8-ad7e-d32049ba32af tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:31.435115 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-06a4d7b9-92d2-43f8-ad7e-d32049ba32af tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:31.435846 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-06a4d7b9-92d2-43f8-ad7e-d32049ba32af tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:31.436525 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-06a4d7b9-92d2-43f8-ad7e-d32049ba32af tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:31.454802 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-c31535b7-6c7d-4bde-866e-400a7005d3ef tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:31.463213 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-c31535b7-6c7d-4bde-866e-400a7005d3ef tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee" status: 200 len: 1322 microversion: 2.1 time: 0.248779 Aug 24 11:32:31.463803 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 76/161] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:31 2022] GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee => generated 1322 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:32:31.563994 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-90e3afd8-ddf5-4593-be28-edbdcb051aa8 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:31.564788 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-90e3afd8-ddf5-4593-be28-edbdcb051aa8 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] [instance: 15d4a46e-9504-4897-918d-39aafc20d22a] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:31.571439 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-90e3afd8-ddf5-4593-be28-edbdcb051aa8 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:31.572286 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-90e3afd8-ddf5-4593-be28-edbdcb051aa8 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:31.572900 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-90e3afd8-ddf5-4593-be28-edbdcb051aa8 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:31.573785 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-90e3afd8-ddf5-4593-be28-edbdcb051aa8 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:31.574407 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-90e3afd8-ddf5-4593-be28-edbdcb051aa8 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:31.574996 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-90e3afd8-ddf5-4593-be28-edbdcb051aa8 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:31.615569 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-06a4d7b9-92d2-43f8-ad7e-d32049ba32af tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2715cf2a5129439c83a5347bb963f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4159dc366f41bc9e4057a079f6fb5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:31.619527 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG dbcounter [-] [124769] Writing DB stats nova_cell1:SELECT=100 {{(pid=124769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:31.626431 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-06a4d7b9-92d2-43f8-ad7e-d32049ba32af tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "GET /compute/v2.1/servers/e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311" status: 200 len: 1367 microversion: 2.1 time: 0.212669 Aug 24 11:32:31.640930 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 86/162] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:31 2022] GET /compute/v2.1/servers/e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311 => generated 1367 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:32:31.760083 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-90e3afd8-ddf5-4593-be28-edbdcb051aa8 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031939e16194f63b99e6f27f700fa8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecec6d0c155f4d658197c4779ab9ffce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:31.768730 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-90e3afd8-ddf5-4593-be28-edbdcb051aa8 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] 10.222.0.84 "GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a" status: 200 len: 1363 microversion: 2.1 time: 0.212963 Aug 24 11:32:31.769788 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 77/163] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:31 2022] GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a => generated 1363 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:31.797689 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-bf09a026-6915-4eb2-a180-b12443a3f0d5 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:31.798583 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-bf09a026-6915-4eb2-a180-b12443a3f0d5 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] [instance: 07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:31.804644 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-bf09a026-6915-4eb2-a180-b12443a3f0d5 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:31.805328 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-bf09a026-6915-4eb2-a180-b12443a3f0d5 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:31.805833 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-bf09a026-6915-4eb2-a180-b12443a3f0d5 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:31.806611 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-bf09a026-6915-4eb2-a180-b12443a3f0d5 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:31.807177 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-bf09a026-6915-4eb2-a180-b12443a3f0d5 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:31.807738 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-bf09a026-6915-4eb2-a180-b12443a3f0d5 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:31.945639 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-bf09a026-6915-4eb2-a180-b12443a3f0d5 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cef1a9e6a241ac8401b88f4a0f69fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901780013b03485a83261796f69e1b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:31.954241 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-bf09a026-6915-4eb2-a180-b12443a3f0d5 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] 10.222.0.84 "GET /compute/v2.1/servers/07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0" status: 200 len: 1314 microversion: 2.1 time: 0.162407 Aug 24 11:32:31.954834 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 87/164] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:31 2022] GET /compute/v2.1/servers/07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:32.371619 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-eabcdc60-74a2-4c85-aa83-f1b0d10542f7 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:32.372512 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-eabcdc60-74a2-4c85-aa83-f1b0d10542f7 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: 2e661217-fb1a-48ad-9f1b-47985a4074de] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:32.384495 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-eabcdc60-74a2-4c85-aa83-f1b0d10542f7 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:32.385067 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-eabcdc60-74a2-4c85-aa83-f1b0d10542f7 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:32.385532 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-eabcdc60-74a2-4c85-aa83-f1b0d10542f7 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:32.386285 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-eabcdc60-74a2-4c85-aa83-f1b0d10542f7 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:32.387426 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-eabcdc60-74a2-4c85-aa83-f1b0d10542f7 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:32.387856 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-eabcdc60-74a2-4c85-aa83-f1b0d10542f7 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:32.493502 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-4953b961-a513-4b02-a17f-e5ebf99cc78e tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:32.494676 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-4953b961-a513-4b02-a17f-e5ebf99cc78e tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: 2d4527c9-c18c-4028-a452-d23423d9c4ee] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:32.503120 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-4953b961-a513-4b02-a17f-e5ebf99cc78e tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:32.503613 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-4953b961-a513-4b02-a17f-e5ebf99cc78e tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:32.504041 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-4953b961-a513-4b02-a17f-e5ebf99cc78e tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:32.504733 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-4953b961-a513-4b02-a17f-e5ebf99cc78e tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:32.505779 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-4953b961-a513-4b02-a17f-e5ebf99cc78e tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:32.505779 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-4953b961-a513-4b02-a17f-e5ebf99cc78e tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:32.528169 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-eabcdc60-74a2-4c85-aa83-f1b0d10542f7 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:32.543020 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-eabcdc60-74a2-4c85-aa83-f1b0d10542f7 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:32.549909 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-eabcdc60-74a2-4c85-aa83-f1b0d10542f7 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:32.549909 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-eabcdc60-74a2-4c85-aa83-f1b0d10542f7 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de" status: 200 len: 1408 microversion: 2.20 time: 0.180941 Aug 24 11:32:32.549909 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 78/165] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:32:32 2022] GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de => generated 1408 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:32:32.647523 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-4953b961-a513-4b02-a17f-e5ebf99cc78e tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:32.647920 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-21e01059-3524-41d5-adb0-fb02b4d5b6a7 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:32.648605 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-21e01059-3524-41d5-adb0-fb02b4d5b6a7 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:32.655257 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-21e01059-3524-41d5-adb0-fb02b4d5b6a7 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:32.656601 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-21e01059-3524-41d5-adb0-fb02b4d5b6a7 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:32.657696 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-21e01059-3524-41d5-adb0-fb02b4d5b6a7 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:32.658735 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-21e01059-3524-41d5-adb0-fb02b4d5b6a7 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:32.659394 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-21e01059-3524-41d5-adb0-fb02b4d5b6a7 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:32.660701 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-21e01059-3524-41d5-adb0-fb02b4d5b6a7 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:32.671085 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-4953b961-a513-4b02-a17f-e5ebf99cc78e tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee" status: 200 len: 1322 microversion: 2.1 time: 0.181248 Aug 24 11:32:32.673204 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 88/166] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:32 2022] GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee => generated 1322 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:32:32.790830 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-28ffb040-b7c3-471f-b790-a855b8153717 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:32.791456 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-28ffb040-b7c3-471f-b790-a855b8153717 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] [instance: 15d4a46e-9504-4897-918d-39aafc20d22a] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:32.797794 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-28ffb040-b7c3-471f-b790-a855b8153717 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:32.804376 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-28ffb040-b7c3-471f-b790-a855b8153717 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:32.804376 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-28ffb040-b7c3-471f-b790-a855b8153717 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:32.804376 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-28ffb040-b7c3-471f-b790-a855b8153717 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:32.804376 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-28ffb040-b7c3-471f-b790-a855b8153717 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:32.805113 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-28ffb040-b7c3-471f-b790-a855b8153717 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:32.805269 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-21e01059-3524-41d5-adb0-fb02b4d5b6a7 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2715cf2a5129439c83a5347bb963f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4159dc366f41bc9e4057a079f6fb5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:32.815660 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-21e01059-3524-41d5-adb0-fb02b4d5b6a7 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "GET /compute/v2.1/servers/e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311" status: 200 len: 1367 microversion: 2.1 time: 0.171663 Aug 24 11:32:32.816346 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 79/167] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:32 2022] GET /compute/v2.1/servers/e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311 => generated 1367 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:32:32.934584 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-28ffb040-b7c3-471f-b790-a855b8153717 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031939e16194f63b99e6f27f700fa8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecec6d0c155f4d658197c4779ab9ffce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:32.943910 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-28ffb040-b7c3-471f-b790-a855b8153717 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] 10.222.0.84 "GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a" status: 200 len: 1363 microversion: 2.1 time: 0.157107 Aug 24 11:32:32.944494 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 89/168] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:32 2022] GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:32:32.974405 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-c24ba8ac-d16e-4cad-8d8d-dbd5fa03c36e tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:32.975073 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-c24ba8ac-d16e-4cad-8d8d-dbd5fa03c36e tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] [instance: 07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:32.980965 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c24ba8ac-d16e-4cad-8d8d-dbd5fa03c36e tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:32.981529 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c24ba8ac-d16e-4cad-8d8d-dbd5fa03c36e tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:32.981861 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c24ba8ac-d16e-4cad-8d8d-dbd5fa03c36e tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:32.982538 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c24ba8ac-d16e-4cad-8d8d-dbd5fa03c36e tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:32.982988 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c24ba8ac-d16e-4cad-8d8d-dbd5fa03c36e tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:32.983404 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c24ba8ac-d16e-4cad-8d8d-dbd5fa03c36e tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:33.113226 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-c24ba8ac-d16e-4cad-8d8d-dbd5fa03c36e tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cef1a9e6a241ac8401b88f4a0f69fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901780013b03485a83261796f69e1b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:33.120437 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-c24ba8ac-d16e-4cad-8d8d-dbd5fa03c36e tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] 10.222.0.84 "GET /compute/v2.1/servers/07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0" status: 200 len: 1314 microversion: 2.1 time: 0.149823 Aug 24 11:32:33.121043 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 80/169] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:32 2022] GET /compute/v2.1/servers/07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:33.568440 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-d7fc1d84-e557-4411-b545-39c4a68421c3 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:33.569260 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-d7fc1d84-e557-4411-b545-39c4a68421c3 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: 2e661217-fb1a-48ad-9f1b-47985a4074de] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:33.575334 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-d7fc1d84-e557-4411-b545-39c4a68421c3 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:33.575888 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-d7fc1d84-e557-4411-b545-39c4a68421c3 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:33.576417 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-d7fc1d84-e557-4411-b545-39c4a68421c3 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:33.577191 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-d7fc1d84-e557-4411-b545-39c4a68421c3 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:33.578348 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-d7fc1d84-e557-4411-b545-39c4a68421c3 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:33.578949 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-d7fc1d84-e557-4411-b545-39c4a68421c3 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:33.697671 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-2ae23e93-2f89-4d30-977a-d7aad4b98d06 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:33.698767 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-2ae23e93-2f89-4d30-977a-d7aad4b98d06 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: 2d4527c9-c18c-4028-a452-d23423d9c4ee] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:33.710710 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-2ae23e93-2f89-4d30-977a-d7aad4b98d06 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:33.711537 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-2ae23e93-2f89-4d30-977a-d7aad4b98d06 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:33.712274 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-2ae23e93-2f89-4d30-977a-d7aad4b98d06 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:33.713484 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-2ae23e93-2f89-4d30-977a-d7aad4b98d06 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:33.714261 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-2ae23e93-2f89-4d30-977a-d7aad4b98d06 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:33.714985 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-2ae23e93-2f89-4d30-977a-d7aad4b98d06 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:33.729412 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-d7fc1d84-e557-4411-b545-39c4a68421c3 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:33.738394 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-d7fc1d84-e557-4411-b545-39c4a68421c3 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:33.740204 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-d7fc1d84-e557-4411-b545-39c4a68421c3 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:33.741588 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-d7fc1d84-e557-4411-b545-39c4a68421c3 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de" status: 200 len: 1408 microversion: 2.20 time: 0.177179 Aug 24 11:32:33.742328 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 90/170] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:32:33 2022] GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de => generated 1408 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:32:33.835448 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-159c51b3-5076-4dc1-98fd-61fa36c5f0bb tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:33.836187 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-159c51b3-5076-4dc1-98fd-61fa36c5f0bb tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:33.842305 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-159c51b3-5076-4dc1-98fd-61fa36c5f0bb tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:33.842789 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-159c51b3-5076-4dc1-98fd-61fa36c5f0bb tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:33.843260 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-159c51b3-5076-4dc1-98fd-61fa36c5f0bb tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:33.843982 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-159c51b3-5076-4dc1-98fd-61fa36c5f0bb tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:33.844436 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-159c51b3-5076-4dc1-98fd-61fa36c5f0bb tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:33.844909 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-159c51b3-5076-4dc1-98fd-61fa36c5f0bb tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:33.854203 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-2ae23e93-2f89-4d30-977a-d7aad4b98d06 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:33.862124 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-2ae23e93-2f89-4d30-977a-d7aad4b98d06 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee" status: 200 len: 1322 microversion: 2.1 time: 0.171996 Aug 24 11:32:33.862692 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 81/171] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:33 2022] GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee => generated 1322 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:33.964785 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-cc5127df-68e8-49ec-b89b-19e839d0429f tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:33.965541 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-cc5127df-68e8-49ec-b89b-19e839d0429f tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] [instance: 15d4a46e-9504-4897-918d-39aafc20d22a] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:33.971664 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-cc5127df-68e8-49ec-b89b-19e839d0429f tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:33.972185 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-cc5127df-68e8-49ec-b89b-19e839d0429f tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:33.972621 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-cc5127df-68e8-49ec-b89b-19e839d0429f tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:33.973432 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-cc5127df-68e8-49ec-b89b-19e839d0429f tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:33.974065 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-cc5127df-68e8-49ec-b89b-19e839d0429f tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:33.974593 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-cc5127df-68e8-49ec-b89b-19e839d0429f tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:33.976959 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-159c51b3-5076-4dc1-98fd-61fa36c5f0bb tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2715cf2a5129439c83a5347bb963f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4159dc366f41bc9e4057a079f6fb5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:33.986100 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-159c51b3-5076-4dc1-98fd-61fa36c5f0bb tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "GET /compute/v2.1/servers/e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311" status: 200 len: 1367 microversion: 2.1 time: 0.154436 Aug 24 11:32:33.986903 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 91/172] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:33 2022] GET /compute/v2.1/servers/e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:32:34.106692 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-cc5127df-68e8-49ec-b89b-19e839d0429f tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031939e16194f63b99e6f27f700fa8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecec6d0c155f4d658197c4779ab9ffce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:34.114491 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-cc5127df-68e8-49ec-b89b-19e839d0429f tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] 10.222.0.84 "GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a" status: 200 len: 1363 microversion: 2.1 time: 0.153747 Aug 24 11:32:34.115053 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 82/173] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:33 2022] GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:32:34.142714 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-58013c4c-412b-4977-90a6-c1cd372afdfe tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:34.143356 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-58013c4c-412b-4977-90a6-c1cd372afdfe tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] [instance: 07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:34.149555 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-58013c4c-412b-4977-90a6-c1cd372afdfe tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:34.150027 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-58013c4c-412b-4977-90a6-c1cd372afdfe tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:34.150455 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-58013c4c-412b-4977-90a6-c1cd372afdfe tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:34.151208 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-58013c4c-412b-4977-90a6-c1cd372afdfe tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:34.151618 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-58013c4c-412b-4977-90a6-c1cd372afdfe tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:34.152038 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-58013c4c-412b-4977-90a6-c1cd372afdfe tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:34.282110 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-58013c4c-412b-4977-90a6-c1cd372afdfe tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cef1a9e6a241ac8401b88f4a0f69fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901780013b03485a83261796f69e1b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:34.290211 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-58013c4c-412b-4977-90a6-c1cd372afdfe tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] 10.222.0.84 "GET /compute/v2.1/servers/07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0" status: 200 len: 1314 microversion: 2.1 time: 0.152095 Aug 24 11:32:34.290770 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 92/174] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:34 2022] GET /compute/v2.1/servers/07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:34.767599 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-33c134f3-b9d6-4158-a539-01025426749b tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:34.768230 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-33c134f3-b9d6-4158-a539-01025426749b tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: 2e661217-fb1a-48ad-9f1b-47985a4074de] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:34.774176 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-33c134f3-b9d6-4158-a539-01025426749b tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:34.774646 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-33c134f3-b9d6-4158-a539-01025426749b tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:34.777350 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-33c134f3-b9d6-4158-a539-01025426749b tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:34.777350 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-33c134f3-b9d6-4158-a539-01025426749b tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:34.777350 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-33c134f3-b9d6-4158-a539-01025426749b tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:34.777350 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-33c134f3-b9d6-4158-a539-01025426749b tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:34.780599 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_cell1:SELECT=100 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:34.884964 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-f42d61de-b2e6-4542-b45f-797f05c8939d tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:34.885581 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-f42d61de-b2e6-4542-b45f-797f05c8939d tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: 2d4527c9-c18c-4028-a452-d23423d9c4ee] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:34.892385 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f42d61de-b2e6-4542-b45f-797f05c8939d tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:34.892899 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f42d61de-b2e6-4542-b45f-797f05c8939d tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:34.893341 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f42d61de-b2e6-4542-b45f-797f05c8939d tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:34.894468 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f42d61de-b2e6-4542-b45f-797f05c8939d tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:34.894468 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f42d61de-b2e6-4542-b45f-797f05c8939d tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:34.894898 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f42d61de-b2e6-4542-b45f-797f05c8939d tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:34.915995 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-33c134f3-b9d6-4158-a539-01025426749b tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:34.925476 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-33c134f3-b9d6-4158-a539-01025426749b tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:34.926965 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-33c134f3-b9d6-4158-a539-01025426749b tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:34.928135 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-33c134f3-b9d6-4158-a539-01025426749b tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de" status: 200 len: 1408 microversion: 2.20 time: 0.164680 Aug 24 11:32:34.928685 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 83/175] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:32:34 2022] GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de => generated 1408 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 11:32:35.007131 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-fe00b30a-0a0c-4574-a72a-c1342ef1e96b tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:35.007865 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-fe00b30a-0a0c-4574-a72a-c1342ef1e96b tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:35.018233 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-fe00b30a-0a0c-4574-a72a-c1342ef1e96b tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:35.018974 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-fe00b30a-0a0c-4574-a72a-c1342ef1e96b tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:35.019522 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-fe00b30a-0a0c-4574-a72a-c1342ef1e96b tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:35.020401 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-fe00b30a-0a0c-4574-a72a-c1342ef1e96b tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:35.021070 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-fe00b30a-0a0c-4574-a72a-c1342ef1e96b tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:35.021590 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-fe00b30a-0a0c-4574-a72a-c1342ef1e96b tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:35.034557 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-f42d61de-b2e6-4542-b45f-797f05c8939d tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:35.042386 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-f42d61de-b2e6-4542-b45f-797f05c8939d tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee" status: 200 len: 1322 microversion: 2.1 time: 0.161511 Aug 24 11:32:35.043068 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 93/176] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:34 2022] GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee => generated 1322 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:32:35.135774 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-02796359-d28c-4b44-a80e-490e1681c4ce tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:35.136385 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-02796359-d28c-4b44-a80e-490e1681c4ce tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] [instance: 15d4a46e-9504-4897-918d-39aafc20d22a] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:35.142930 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-02796359-d28c-4b44-a80e-490e1681c4ce tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:35.143417 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-02796359-d28c-4b44-a80e-490e1681c4ce tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:35.143851 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-02796359-d28c-4b44-a80e-490e1681c4ce tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:35.144549 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-02796359-d28c-4b44-a80e-490e1681c4ce tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:35.145028 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-02796359-d28c-4b44-a80e-490e1681c4ce tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:35.145570 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-02796359-d28c-4b44-a80e-490e1681c4ce tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:35.157376 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-fe00b30a-0a0c-4574-a72a-c1342ef1e96b tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2715cf2a5129439c83a5347bb963f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4159dc366f41bc9e4057a079f6fb5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:35.165728 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-fe00b30a-0a0c-4574-a72a-c1342ef1e96b tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "GET /compute/v2.1/servers/e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311" status: 200 len: 1367 microversion: 2.1 time: 0.162407 Aug 24 11:32:35.166382 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 84/177] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:35 2022] GET /compute/v2.1/servers/e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311 => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:32:35.279719 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-02796359-d28c-4b44-a80e-490e1681c4ce tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031939e16194f63b99e6f27f700fa8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecec6d0c155f4d658197c4779ab9ffce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:35.288304 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-02796359-d28c-4b44-a80e-490e1681c4ce tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] 10.222.0.84 "GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a" status: 200 len: 1363 microversion: 2.1 time: 0.156626 Aug 24 11:32:35.288912 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 94/178] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:35 2022] GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:32:35.311668 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-4faa0dc2-9945-4e87-a988-d0a83c6e4884 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:35.312369 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-4faa0dc2-9945-4e87-a988-d0a83c6e4884 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] [instance: 07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:35.318934 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4faa0dc2-9945-4e87-a988-d0a83c6e4884 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:35.319423 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4faa0dc2-9945-4e87-a988-d0a83c6e4884 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:35.319861 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4faa0dc2-9945-4e87-a988-d0a83c6e4884 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:35.320558 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4faa0dc2-9945-4e87-a988-d0a83c6e4884 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:35.321048 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4faa0dc2-9945-4e87-a988-d0a83c6e4884 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:35.321474 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4faa0dc2-9945-4e87-a988-d0a83c6e4884 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:35.461938 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-4faa0dc2-9945-4e87-a988-d0a83c6e4884 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cef1a9e6a241ac8401b88f4a0f69fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901780013b03485a83261796f69e1b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:35.470409 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-4faa0dc2-9945-4e87-a988-d0a83c6e4884 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] 10.222.0.84 "GET /compute/v2.1/servers/07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0" status: 200 len: 1314 microversion: 2.1 time: 0.162514 Aug 24 11:32:35.471000 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 85/179] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:35 2022] GET /compute/v2.1/servers/07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:35.951423 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-8c54f128-67d7-4eb6-9a9d-2aba7a264ef7 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:35.952038 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-8c54f128-67d7-4eb6-9a9d-2aba7a264ef7 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: 2e661217-fb1a-48ad-9f1b-47985a4074de] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:35.959050 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-8c54f128-67d7-4eb6-9a9d-2aba7a264ef7 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:35.959538 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-8c54f128-67d7-4eb6-9a9d-2aba7a264ef7 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:35.959970 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-8c54f128-67d7-4eb6-9a9d-2aba7a264ef7 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:35.960672 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-8c54f128-67d7-4eb6-9a9d-2aba7a264ef7 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:35.961157 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-8c54f128-67d7-4eb6-9a9d-2aba7a264ef7 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:35.961576 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-8c54f128-67d7-4eb6-9a9d-2aba7a264ef7 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:36.064904 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-4e0f5c5e-6d6d-44a0-9a69-63fbc48549a7 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:36.065564 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-4e0f5c5e-6d6d-44a0-9a69-63fbc48549a7 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: 2d4527c9-c18c-4028-a452-d23423d9c4ee] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:36.071114 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4e0f5c5e-6d6d-44a0-9a69-63fbc48549a7 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:36.071639 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4e0f5c5e-6d6d-44a0-9a69-63fbc48549a7 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:36.072297 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4e0f5c5e-6d6d-44a0-9a69-63fbc48549a7 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:36.073037 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4e0f5c5e-6d6d-44a0-9a69-63fbc48549a7 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:36.073494 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4e0f5c5e-6d6d-44a0-9a69-63fbc48549a7 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:36.073918 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4e0f5c5e-6d6d-44a0-9a69-63fbc48549a7 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:36.099822 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-8c54f128-67d7-4eb6-9a9d-2aba7a264ef7 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:36.108416 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-8c54f128-67d7-4eb6-9a9d-2aba7a264ef7 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:36.110005 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-8c54f128-67d7-4eb6-9a9d-2aba7a264ef7 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:36.111277 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-8c54f128-67d7-4eb6-9a9d-2aba7a264ef7 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de" status: 200 len: 1408 microversion: 2.20 time: 0.163728 Aug 24 11:32:36.111995 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 95/180] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:32:35 2022] GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de => generated 1408 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:32:36.188682 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-cf6ece74-21d8-4158-bc16-3444c3b275b8 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:36.189331 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-cf6ece74-21d8-4158-bc16-3444c3b275b8 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:36.195504 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-cf6ece74-21d8-4158-bc16-3444c3b275b8 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:36.195995 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-cf6ece74-21d8-4158-bc16-3444c3b275b8 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:36.196433 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-cf6ece74-21d8-4158-bc16-3444c3b275b8 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:36.197157 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-cf6ece74-21d8-4158-bc16-3444c3b275b8 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:36.197611 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-cf6ece74-21d8-4158-bc16-3444c3b275b8 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:36.198036 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-cf6ece74-21d8-4158-bc16-3444c3b275b8 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:36.211666 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-4e0f5c5e-6d6d-44a0-9a69-63fbc48549a7 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:36.220347 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-4e0f5c5e-6d6d-44a0-9a69-63fbc48549a7 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee" status: 200 len: 1322 microversion: 2.1 time: 0.160500 Aug 24 11:32:36.220961 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 86/181] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:36 2022] GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:32:36.314573 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-c32fcd19-710f-410c-9693-a6160d027ab0 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:36.315242 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-c32fcd19-710f-410c-9693-a6160d027ab0 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] [instance: 15d4a46e-9504-4897-918d-39aafc20d22a] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:36.321378 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c32fcd19-710f-410c-9693-a6160d027ab0 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:36.321869 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c32fcd19-710f-410c-9693-a6160d027ab0 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:36.322308 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c32fcd19-710f-410c-9693-a6160d027ab0 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:36.323037 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c32fcd19-710f-410c-9693-a6160d027ab0 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:36.323496 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c32fcd19-710f-410c-9693-a6160d027ab0 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:36.323921 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c32fcd19-710f-410c-9693-a6160d027ab0 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:36.352237 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-cf6ece74-21d8-4158-bc16-3444c3b275b8 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2715cf2a5129439c83a5347bb963f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4159dc366f41bc9e4057a079f6fb5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:36.361040 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-cf6ece74-21d8-4158-bc16-3444c3b275b8 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "GET /compute/v2.1/servers/e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311" status: 200 len: 1367 microversion: 2.1 time: 0.176175 Aug 24 11:32:36.361684 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 96/182] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:36 2022] GET /compute/v2.1/servers/e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311 => generated 1367 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:32:36.472959 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-c32fcd19-710f-410c-9693-a6160d027ab0 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031939e16194f63b99e6f27f700fa8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecec6d0c155f4d658197c4779ab9ffce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:36.481297 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-c32fcd19-710f-410c-9693-a6160d027ab0 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] 10.222.0.84 "GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a" status: 200 len: 1363 microversion: 2.1 time: 0.172769 Aug 24 11:32:36.481874 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 87/183] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:36 2022] GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a => generated 1363 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:32:36.503439 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-369b435b-362d-48d7-98dd-3f173a5a7aa7 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:36.504593 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-369b435b-362d-48d7-98dd-3f173a5a7aa7 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] [instance: 07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:36.510919 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-369b435b-362d-48d7-98dd-3f173a5a7aa7 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:36.511408 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-369b435b-362d-48d7-98dd-3f173a5a7aa7 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:36.511930 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-369b435b-362d-48d7-98dd-3f173a5a7aa7 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:36.512570 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-369b435b-362d-48d7-98dd-3f173a5a7aa7 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:36.513062 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-369b435b-362d-48d7-98dd-3f173a5a7aa7 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:36.513488 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-369b435b-362d-48d7-98dd-3f173a5a7aa7 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:36.664144 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-369b435b-362d-48d7-98dd-3f173a5a7aa7 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cef1a9e6a241ac8401b88f4a0f69fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901780013b03485a83261796f69e1b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:36.672574 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-369b435b-362d-48d7-98dd-3f173a5a7aa7 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] 10.222.0.84 "GET /compute/v2.1/servers/07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0" status: 200 len: 1314 microversion: 2.1 time: 0.177676 Aug 24 11:32:36.673173 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 97/184] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:36 2022] GET /compute/v2.1/servers/07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0 => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:37.133984 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-4b905698-40b1-4150-b94e-f8f0bc2eb38f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:37.134537 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-4b905698-40b1-4150-b94e-f8f0bc2eb38f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: 2e661217-fb1a-48ad-9f1b-47985a4074de] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:37.141230 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4b905698-40b1-4150-b94e-f8f0bc2eb38f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:37.141705 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4b905698-40b1-4150-b94e-f8f0bc2eb38f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:37.142138 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4b905698-40b1-4150-b94e-f8f0bc2eb38f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:37.142813 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4b905698-40b1-4150-b94e-f8f0bc2eb38f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:37.143264 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4b905698-40b1-4150-b94e-f8f0bc2eb38f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:37.143683 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4b905698-40b1-4150-b94e-f8f0bc2eb38f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:37.242083 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-b252edf7-088c-420f-a409-c76c93648f8a tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:37.242693 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-b252edf7-088c-420f-a409-c76c93648f8a tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: 2d4527c9-c18c-4028-a452-d23423d9c4ee] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:37.248902 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-b252edf7-088c-420f-a409-c76c93648f8a tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:37.249390 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-b252edf7-088c-420f-a409-c76c93648f8a tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:37.249826 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-b252edf7-088c-420f-a409-c76c93648f8a tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:37.250515 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-b252edf7-088c-420f-a409-c76c93648f8a tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:37.250971 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-b252edf7-088c-420f-a409-c76c93648f8a tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:37.251392 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-b252edf7-088c-420f-a409-c76c93648f8a tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:37.272922 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-4b905698-40b1-4150-b94e-f8f0bc2eb38f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:37.282042 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-4b905698-40b1-4150-b94e-f8f0bc2eb38f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:37.283541 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-4b905698-40b1-4150-b94e-f8f0bc2eb38f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:37.284633 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-4b905698-40b1-4150-b94e-f8f0bc2eb38f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de" status: 200 len: 1408 microversion: 2.20 time: 0.154634 Aug 24 11:32:37.285219 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 88/185] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:32:37 2022] GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de => generated 1408 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:32:37.385040 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-20f37868-93ea-49c9-8697-682c08c5a334 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:37.385598 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-20f37868-93ea-49c9-8697-682c08c5a334 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:37.394163 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-20f37868-93ea-49c9-8697-682c08c5a334 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:37.394897 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-20f37868-93ea-49c9-8697-682c08c5a334 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:37.395708 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-20f37868-93ea-49c9-8697-682c08c5a334 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:37.396985 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-20f37868-93ea-49c9-8697-682c08c5a334 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:37.397676 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-20f37868-93ea-49c9-8697-682c08c5a334 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:37.398275 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-20f37868-93ea-49c9-8697-682c08c5a334 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:37.416711 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-b252edf7-088c-420f-a409-c76c93648f8a tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:37.426085 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-b252edf7-088c-420f-a409-c76c93648f8a tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee" status: 200 len: 1322 microversion: 2.1 time: 0.187823 Aug 24 11:32:37.427391 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 98/186] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:37 2022] GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee => generated 1322 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:32:37.512383 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-991c058f-68b6-4560-a3d8-9311c687995b tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:37.513144 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-991c058f-68b6-4560-a3d8-9311c687995b tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] [instance: 15d4a46e-9504-4897-918d-39aafc20d22a] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:37.521454 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-991c058f-68b6-4560-a3d8-9311c687995b tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:37.521956 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-991c058f-68b6-4560-a3d8-9311c687995b tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:37.522380 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-991c058f-68b6-4560-a3d8-9311c687995b tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:37.525984 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-991c058f-68b6-4560-a3d8-9311c687995b tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:37.525984 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-991c058f-68b6-4560-a3d8-9311c687995b tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:37.525984 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-991c058f-68b6-4560-a3d8-9311c687995b tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:37.564570 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-20f37868-93ea-49c9-8697-682c08c5a334 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2715cf2a5129439c83a5347bb963f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4159dc366f41bc9e4057a079f6fb5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:37.576696 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-20f37868-93ea-49c9-8697-682c08c5a334 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "GET /compute/v2.1/servers/e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311" status: 200 len: 1367 microversion: 2.1 time: 0.197806 Aug 24 11:32:37.581395 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 89/187] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:37 2022] GET /compute/v2.1/servers/e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311 => generated 1367 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:37.694146 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-c96c8756-7c45-47a5-906c-e9298599c949 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:37.694697 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-c96c8756-7c45-47a5-906c-e9298599c949 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] [instance: 07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:37.699614 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-991c058f-68b6-4560-a3d8-9311c687995b tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031939e16194f63b99e6f27f700fa8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecec6d0c155f4d658197c4779ab9ffce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:37.701076 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c96c8756-7c45-47a5-906c-e9298599c949 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:37.702163 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c96c8756-7c45-47a5-906c-e9298599c949 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:37.702664 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c96c8756-7c45-47a5-906c-e9298599c949 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:37.703363 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c96c8756-7c45-47a5-906c-e9298599c949 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:37.703923 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c96c8756-7c45-47a5-906c-e9298599c949 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:37.704349 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c96c8756-7c45-47a5-906c-e9298599c949 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:37.708880 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-991c058f-68b6-4560-a3d8-9311c687995b tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] 10.222.0.84 "GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a" status: 200 len: 1363 microversion: 2.1 time: 0.199587 Aug 24 11:32:37.709545 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 99/188] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:37 2022] GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a => generated 1363 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:32:37.848482 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-c96c8756-7c45-47a5-906c-e9298599c949 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cef1a9e6a241ac8401b88f4a0f69fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901780013b03485a83261796f69e1b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:37.858061 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-c96c8756-7c45-47a5-906c-e9298599c949 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] 10.222.0.84 "GET /compute/v2.1/servers/07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0" status: 200 len: 1314 microversion: 2.1 time: 0.167072 Aug 24 11:32:37.858061 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 90/189] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:37 2022] GET /compute/v2.1/servers/07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:32:38.306811 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-dcb77348-8351-491a-8a34-18ce69308d5f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:38.307385 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-dcb77348-8351-491a-8a34-18ce69308d5f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: 2e661217-fb1a-48ad-9f1b-47985a4074de] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:38.313785 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-dcb77348-8351-491a-8a34-18ce69308d5f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:38.314276 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-dcb77348-8351-491a-8a34-18ce69308d5f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:38.314715 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-dcb77348-8351-491a-8a34-18ce69308d5f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:38.315410 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-dcb77348-8351-491a-8a34-18ce69308d5f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:38.315865 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-dcb77348-8351-491a-8a34-18ce69308d5f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:38.316288 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-dcb77348-8351-491a-8a34-18ce69308d5f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:38.448778 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-5eaaa238-bd6d-4b81-a676-0dda8a88c25b tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:38.449750 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-5eaaa238-bd6d-4b81-a676-0dda8a88c25b tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: 2d4527c9-c18c-4028-a452-d23423d9c4ee] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:38.457257 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5eaaa238-bd6d-4b81-a676-0dda8a88c25b tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:38.458113 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5eaaa238-bd6d-4b81-a676-0dda8a88c25b tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:38.458755 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5eaaa238-bd6d-4b81-a676-0dda8a88c25b tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:38.458755 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5eaaa238-bd6d-4b81-a676-0dda8a88c25b tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:38.460154 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5eaaa238-bd6d-4b81-a676-0dda8a88c25b tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:38.460673 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5eaaa238-bd6d-4b81-a676-0dda8a88c25b tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:38.464117 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-dcb77348-8351-491a-8a34-18ce69308d5f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:38.476367 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-dcb77348-8351-491a-8a34-18ce69308d5f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:38.478018 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-dcb77348-8351-491a-8a34-18ce69308d5f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:38.479126 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-dcb77348-8351-491a-8a34-18ce69308d5f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de" status: 200 len: 1408 microversion: 2.20 time: 0.176367 Aug 24 11:32:38.480063 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 100/190] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:32:38 2022] GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de => generated 1408 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:32:38.605206 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-03904254-c0ab-4f85-8fbe-ee3b9278df21 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:38.612891 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-03904254-c0ab-4f85-8fbe-ee3b9278df21 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:38.613973 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-03904254-c0ab-4f85-8fbe-ee3b9278df21 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:38.614469 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-03904254-c0ab-4f85-8fbe-ee3b9278df21 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:38.614901 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-03904254-c0ab-4f85-8fbe-ee3b9278df21 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:38.615628 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-03904254-c0ab-4f85-8fbe-ee3b9278df21 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:38.616077 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-03904254-c0ab-4f85-8fbe-ee3b9278df21 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:38.616523 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-03904254-c0ab-4f85-8fbe-ee3b9278df21 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:38.623438 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-5eaaa238-bd6d-4b81-a676-0dda8a88c25b tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:38.631464 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-5eaaa238-bd6d-4b81-a676-0dda8a88c25b tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee" status: 200 len: 1322 microversion: 2.1 time: 0.187650 Aug 24 11:32:38.632388 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 91/191] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:38 2022] GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee => generated 1322 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:38.740988 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-abb0b2da-8bf1-4c2c-af2f-b051b052eb62 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:38.741605 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-abb0b2da-8bf1-4c2c-af2f-b051b052eb62 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] [instance: 15d4a46e-9504-4897-918d-39aafc20d22a] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:38.747856 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-abb0b2da-8bf1-4c2c-af2f-b051b052eb62 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:38.748337 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-abb0b2da-8bf1-4c2c-af2f-b051b052eb62 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:38.748780 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-abb0b2da-8bf1-4c2c-af2f-b051b052eb62 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:38.749806 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-abb0b2da-8bf1-4c2c-af2f-b051b052eb62 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:38.750825 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-abb0b2da-8bf1-4c2c-af2f-b051b052eb62 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:38.751142 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-abb0b2da-8bf1-4c2c-af2f-b051b052eb62 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:38.753288 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-03904254-c0ab-4f85-8fbe-ee3b9278df21 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2715cf2a5129439c83a5347bb963f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4159dc366f41bc9e4057a079f6fb5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:38.761190 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-03904254-c0ab-4f85-8fbe-ee3b9278df21 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "GET /compute/v2.1/servers/e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311" status: 200 len: 1367 microversion: 2.1 time: 0.161176 Aug 24 11:32:38.762472 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 101/192] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:38 2022] GET /compute/v2.1/servers/e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:32:38.883765 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-9a5006eb-46e8-4772-ae27-8953f1440a2b tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:38.884561 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-9a5006eb-46e8-4772-ae27-8953f1440a2b tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] [instance: 07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:38.891904 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-9a5006eb-46e8-4772-ae27-8953f1440a2b tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:38.893532 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-9a5006eb-46e8-4772-ae27-8953f1440a2b tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:38.893532 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-9a5006eb-46e8-4772-ae27-8953f1440a2b tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:38.893920 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-9a5006eb-46e8-4772-ae27-8953f1440a2b tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:38.894029 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-9a5006eb-46e8-4772-ae27-8953f1440a2b tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:38.894451 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-9a5006eb-46e8-4772-ae27-8953f1440a2b tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:39.071731 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-9a5006eb-46e8-4772-ae27-8953f1440a2b tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cef1a9e6a241ac8401b88f4a0f69fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901780013b03485a83261796f69e1b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:39.079541 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-9a5006eb-46e8-4772-ae27-8953f1440a2b tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] 10.222.0.84 "GET /compute/v2.1/servers/07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0" status: 200 len: 1314 microversion: 2.1 time: 0.202479 Aug 24 11:32:39.094471 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 102/193] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:38 2022] GET /compute/v2.1/servers/07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0 => generated 1314 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:39.151504 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-abb0b2da-8bf1-4c2c-af2f-b051b052eb62 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031939e16194f63b99e6f27f700fa8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecec6d0c155f4d658197c4779ab9ffce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:39.160266 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-abb0b2da-8bf1-4c2c-af2f-b051b052eb62 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] 10.222.0.84 "GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a" status: 200 len: 1363 microversion: 2.1 time: 0.423176 Aug 24 11:32:39.160877 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 92/194] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:38 2022] GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a => generated 1363 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:32:39.511772 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-928bf105-96be-4434-a1bc-33c56d7f00cb tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:39.512387 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-928bf105-96be-4434-a1bc-33c56d7f00cb tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: 2e661217-fb1a-48ad-9f1b-47985a4074de] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:39.523124 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-928bf105-96be-4434-a1bc-33c56d7f00cb tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:39.524815 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-928bf105-96be-4434-a1bc-33c56d7f00cb tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:39.524815 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-928bf105-96be-4434-a1bc-33c56d7f00cb tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:39.525126 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-928bf105-96be-4434-a1bc-33c56d7f00cb tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:39.525536 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-928bf105-96be-4434-a1bc-33c56d7f00cb tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:39.525851 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-928bf105-96be-4434-a1bc-33c56d7f00cb tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:39.547550 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG dbcounter [-] [124769] Writing DB stats nova_cell1:SELECT=100 {{(pid=124769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:39.656715 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-8f985b2e-84bb-4e8b-b8bf-46daa5b96421 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:39.662297 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-8f985b2e-84bb-4e8b-b8bf-46daa5b96421 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: 2d4527c9-c18c-4028-a452-d23423d9c4ee] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:39.669480 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8f985b2e-84bb-4e8b-b8bf-46daa5b96421 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:39.669988 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8f985b2e-84bb-4e8b-b8bf-46daa5b96421 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:39.670403 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8f985b2e-84bb-4e8b-b8bf-46daa5b96421 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:39.671175 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8f985b2e-84bb-4e8b-b8bf-46daa5b96421 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:39.671628 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8f985b2e-84bb-4e8b-b8bf-46daa5b96421 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:39.672046 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8f985b2e-84bb-4e8b-b8bf-46daa5b96421 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:39.719919 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-928bf105-96be-4434-a1bc-33c56d7f00cb tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:39.730017 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-928bf105-96be-4434-a1bc-33c56d7f00cb tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:39.731554 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-928bf105-96be-4434-a1bc-33c56d7f00cb tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:39.732720 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-928bf105-96be-4434-a1bc-33c56d7f00cb tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de" status: 200 len: 1408 microversion: 2.20 time: 0.224934 Aug 24 11:32:39.733818 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 103/195] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:32:39 2022] GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de => generated 1408 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:32:39.784912 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-305f1639-6258-4b42-ab2e-aa728a903b07 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:39.785676 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-305f1639-6258-4b42-ab2e-aa728a903b07 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:39.792372 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-305f1639-6258-4b42-ab2e-aa728a903b07 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:39.792886 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-305f1639-6258-4b42-ab2e-aa728a903b07 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:39.793324 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-305f1639-6258-4b42-ab2e-aa728a903b07 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:39.794039 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-305f1639-6258-4b42-ab2e-aa728a903b07 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:39.794497 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-305f1639-6258-4b42-ab2e-aa728a903b07 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:39.794919 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-305f1639-6258-4b42-ab2e-aa728a903b07 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:39.862975 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-8f985b2e-84bb-4e8b-b8bf-46daa5b96421 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:39.874091 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-8f985b2e-84bb-4e8b-b8bf-46daa5b96421 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee" status: 200 len: 1322 microversion: 2.1 time: 0.224176 Aug 24 11:32:39.887515 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 93/196] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:39 2022] GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee => generated 1322 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:40.006484 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-5de3a521-0cb0-47b3-9091-621d5f9058ad tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1644181422", "imageRef": "028cad80-8f50-4139-b345-dfdca694dc6b", "flavorRef": "452", "networks": [{"uuid": "9b54afbf-84a1-4ef9-8659-c712d6618144"}]}} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:32:40.021668 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-305f1639-6258-4b42-ab2e-aa728a903b07 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2715cf2a5129439c83a5347bb963f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4159dc366f41bc9e4057a079f6fb5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:40.036058 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-305f1639-6258-4b42-ab2e-aa728a903b07 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "GET /compute/v2.1/servers/e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311" status: 200 len: 1367 microversion: 2.1 time: 0.255858 Aug 24 11:32:40.049081 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 104/197] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:39 2022] GET /compute/v2.1/servers/e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311 => generated 1367 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:32:40.104564 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-ca24badd-423c-4975-87ba-a7e5dc8806c1 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:40.106667 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-ca24badd-423c-4975-87ba-a7e5dc8806c1 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] [instance: 07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:40.121085 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-ca24badd-423c-4975-87ba-a7e5dc8806c1 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:40.121647 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-ca24badd-423c-4975-87ba-a7e5dc8806c1 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:40.121995 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-ca24badd-423c-4975-87ba-a7e5dc8806c1 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:40.122756 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-ca24badd-423c-4975-87ba-a7e5dc8806c1 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:40.123240 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-ca24badd-423c-4975-87ba-a7e5dc8806c1 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:40.123803 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-ca24badd-423c-4975-87ba-a7e5dc8806c1 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:40.138060 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.network.neutron [None req-5de3a521-0cb0-47b3-9091-621d5f9058ad tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] validate_networks() for [('9b54afbf-84a1-4ef9-8659-c712d6618144', None, None, None, None, None)] {{(pid=124770) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 11:32:40.352286 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-ca24badd-423c-4975-87ba-a7e5dc8806c1 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cef1a9e6a241ac8401b88f4a0f69fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901780013b03485a83261796f69e1b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:40.363853 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-ca24badd-423c-4975-87ba-a7e5dc8806c1 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] 10.222.0.84 "GET /compute/v2.1/servers/07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0" status: 200 len: 1314 microversion: 2.1 time: 0.265584 Aug 24 11:32:40.380654 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 105/198] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:40 2022] GET /compute/v2.1/servers/07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0 => generated 1314 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:40.391504 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-6dd67ae0-6d14-4832-9b58-77f77decd1a2 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:40.392526 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-6dd67ae0-6d14-4832-9b58-77f77decd1a2 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] [instance: 15d4a46e-9504-4897-918d-39aafc20d22a] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:40.401769 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-6dd67ae0-6d14-4832-9b58-77f77decd1a2 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:40.402624 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-6dd67ae0-6d14-4832-9b58-77f77decd1a2 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:40.403532 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-6dd67ae0-6d14-4832-9b58-77f77decd1a2 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:40.404412 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-6dd67ae0-6d14-4832-9b58-77f77decd1a2 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:40.405120 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-6dd67ae0-6d14-4832-9b58-77f77decd1a2 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:40.406741 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-6dd67ae0-6d14-4832-9b58-77f77decd1a2 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:40.607190 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-6dd67ae0-6d14-4832-9b58-77f77decd1a2 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031939e16194f63b99e6f27f700fa8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecec6d0c155f4d658197c4779ab9ffce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:40.621284 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-6dd67ae0-6d14-4832-9b58-77f77decd1a2 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] 10.222.0.84 "GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a" status: 200 len: 1363 microversion: 2.1 time: 0.238591 Aug 24 11:32:40.623078 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 106/199] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:40 2022] GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a => generated 1363 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:40.761351 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-c1c233ec-d287-43b5-998b-2e27e29ffc10 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:40.762852 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-c1c233ec-d287-43b5-998b-2e27e29ffc10 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: 2e661217-fb1a-48ad-9f1b-47985a4074de] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:40.784486 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-c1c233ec-d287-43b5-998b-2e27e29ffc10 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:40.785805 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-c1c233ec-d287-43b5-998b-2e27e29ffc10 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:40.786383 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-c1c233ec-d287-43b5-998b-2e27e29ffc10 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:40.786986 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-c1c233ec-d287-43b5-998b-2e27e29ffc10 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:40.788891 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-c1c233ec-d287-43b5-998b-2e27e29ffc10 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:40.789356 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-c1c233ec-d287-43b5-998b-2e27e29ffc10 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:41.008194 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.virt.hardware [None req-5de3a521-0cb0-47b3-9091-621d5f9058ad tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Flavor limits 0:0:0 {{(pid=124770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 11:32:41.008968 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.virt.hardware [None req-5de3a521-0cb0-47b3-9091-621d5f9058ad tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Image limits 0:0:0 {{(pid=124770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 11:32:41.009124 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.virt.hardware [None req-5de3a521-0cb0-47b3-9091-621d5f9058ad tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Flavor pref 0:0:0 {{(pid=124770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 11:32:41.009622 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.virt.hardware [None req-5de3a521-0cb0-47b3-9091-621d5f9058ad tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Image pref 0:0:0 {{(pid=124770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 11:32:41.009942 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.virt.hardware [None req-5de3a521-0cb0-47b3-9091-621d5f9058ad tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 11:32:41.027155 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-c1c233ec-d287-43b5-998b-2e27e29ffc10 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:41.038603 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5de3a521-0cb0-47b3-9091-621d5f9058ad tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:41.039736 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5de3a521-0cb0-47b3-9091-621d5f9058ad tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:41.040355 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5de3a521-0cb0-47b3-9091-621d5f9058ad tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:41.047232 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5de3a521-0cb0-47b3-9091-621d5f9058ad tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:41.047980 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5de3a521-0cb0-47b3-9091-621d5f9058ad tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:41.048771 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5de3a521-0cb0-47b3-9091-621d5f9058ad tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:41.051590 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-c1c233ec-d287-43b5-998b-2e27e29ffc10 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:41.066479 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-c1c233ec-d287-43b5-998b-2e27e29ffc10 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:41.070930 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-c1c233ec-d287-43b5-998b-2e27e29ffc10 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de" status: 200 len: 1408 microversion: 2.20 time: 0.312793 Aug 24 11:32:41.085384 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.quota [None req-5de3a521-0cb0-47b3-9091-621d5f9058ad tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Getting quotas for project f910065fc9da40798c7f3d4366dab7c6. Resources: {'ram', 'cores', 'instances'} {{(pid=124770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:32:41.086704 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 107/200] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:32:40 2022] GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de => generated 1408 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 11:32:41.090603 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.quota [None req-5de3a521-0cb0-47b3-9091-621d5f9058ad tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Getting quotas for user 5055ddeab8314c93bb2a664f9d1a7f3a and project f910065fc9da40798c7f3d4366dab7c6. Resources: {'ram', 'cores', 'instances'} {{(pid=124770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:32:41.105572 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [req-5c3cfc75-fd9f-4670-a158-a59f632e6647 req-ad598ed9-fb72-4b2e-9203-d77461204b0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311", "name": "network-vif-plugged", "status": "completed", "tag": "d810e173-346a-4d91-84f8-11fc2af8528a"}]} {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:32:41.105991 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-5de3a521-0cb0-47b3-9091-621d5f9058ad tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Going to run 1 instances... {{(pid=124770) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 11:32:41.110739 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-5de3a521-0cb0-47b3-9091-621d5f9058ad tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] [instance: 0402b684-55db-4c63-8142-de3fd0cc1503] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='028cad80-8f50-4139-b345-dfdca694dc6b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124770) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 11:32:41.137989 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [req-5c3cfc75-fd9f-4670-a158-a59f632e6647 req-ad598ed9-fb72-4b2e-9203-d77461204b0d service nova] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:41.138966 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [req-5c3cfc75-fd9f-4670-a158-a59f632e6647 req-ad598ed9-fb72-4b2e-9203-d77461204b0d service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:41.139703 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [req-5c3cfc75-fd9f-4670-a158-a59f632e6647 req-ad598ed9-fb72-4b2e-9203-d77461204b0d service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:41.178106 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.compute.server_external_events [req-5c3cfc75-fd9f-4670-a158-a59f632e6647 req-ad598ed9-fb72-4b2e-9203-d77461204b0d service nova] Creating event network-vif-plugged:d810e173-346a-4d91-84f8-11fc2af8528a for instance e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311 on hv-cinder-85427 Aug 24 11:32:41.189642 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [req-5c3cfc75-fd9f-4670-a158-a59f632e6647 req-ad598ed9-fb72-4b2e-9203-d77461204b0d service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100660 Aug 24 11:32:41.190695 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 108/201] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Aug 24 11:32:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:32:41.200633 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-e5c738ab-4be3-4250-bf68-107709584d2e tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:41.202053 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-e5c738ab-4be3-4250-bf68-107709584d2e tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: 2d4527c9-c18c-4028-a452-d23423d9c4ee] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:41.213058 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-e5c738ab-4be3-4250-bf68-107709584d2e tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:41.213723 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-e5c738ab-4be3-4250-bf68-107709584d2e tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:41.214185 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-e5c738ab-4be3-4250-bf68-107709584d2e tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:41.214925 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-e5c738ab-4be3-4250-bf68-107709584d2e tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:41.215390 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-e5c738ab-4be3-4250-bf68-107709584d2e tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:41.215818 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-e5c738ab-4be3-4250-bf68-107709584d2e tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:41.399589 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-e5c738ab-4be3-4250-bf68-107709584d2e tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:41.412106 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-e5c738ab-4be3-4250-bf68-107709584d2e tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee" status: 200 len: 1322 microversion: 2.1 time: 0.219120 Aug 24 11:32:41.412731 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 109/202] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:41 2022] GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee => generated 1322 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:41.417369 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-213aac42-a066-4fb4-a71e-f3a804d47622 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:41.418013 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-213aac42-a066-4fb4-a71e-f3a804d47622 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:41.426834 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-213aac42-a066-4fb4-a71e-f3a804d47622 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:41.427693 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-213aac42-a066-4fb4-a71e-f3a804d47622 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:41.428473 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-213aac42-a066-4fb4-a71e-f3a804d47622 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:41.429732 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-213aac42-a066-4fb4-a71e-f3a804d47622 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:41.430544 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-213aac42-a066-4fb4-a71e-f3a804d47622 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:41.431441 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-213aac42-a066-4fb4-a71e-f3a804d47622 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:41.598966 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-213aac42-a066-4fb4-a71e-f3a804d47622 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2715cf2a5129439c83a5347bb963f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4159dc366f41bc9e4057a079f6fb5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:41.598966 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-213aac42-a066-4fb4-a71e-f3a804d47622 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "GET /compute/v2.1/servers/e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311" status: 200 len: 1367 microversion: 2.1 time: 0.174620 Aug 24 11:32:41.598966 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 110/203] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:41 2022] GET /compute/v2.1/servers/e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311 => generated 1367 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:41.598966 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-f0af9e88-f2cc-4493-957a-5d2b626dfad5 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:41.673258 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-f0af9e88-f2cc-4493-957a-5d2b626dfad5 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] [instance: 07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:41.673258 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f0af9e88-f2cc-4493-957a-5d2b626dfad5 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:41.673258 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f0af9e88-f2cc-4493-957a-5d2b626dfad5 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:41.673258 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f0af9e88-f2cc-4493-957a-5d2b626dfad5 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:41.674651 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f0af9e88-f2cc-4493-957a-5d2b626dfad5 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:41.674651 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f0af9e88-f2cc-4493-957a-5d2b626dfad5 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:41.674651 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f0af9e88-f2cc-4493-957a-5d2b626dfad5 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:41.775380 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-f0af9e88-f2cc-4493-957a-5d2b626dfad5 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cef1a9e6a241ac8401b88f4a0f69fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901780013b03485a83261796f69e1b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:41.784365 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-f0af9e88-f2cc-4493-957a-5d2b626dfad5 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] 10.222.0.84 "GET /compute/v2.1/servers/07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0" status: 200 len: 1314 microversion: 2.1 time: 0.194245 Aug 24 11:32:41.785014 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 111/204] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:41 2022] GET /compute/v2.1/servers/07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0 => generated 1314 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:41.789833 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-01e1141f-2343-47d2-a1d2-097598cf8b45 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:41.790449 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-01e1141f-2343-47d2-a1d2-097598cf8b45 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] [instance: 15d4a46e-9504-4897-918d-39aafc20d22a] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:41.798668 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-01e1141f-2343-47d2-a1d2-097598cf8b45 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:41.798668 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-01e1141f-2343-47d2-a1d2-097598cf8b45 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:41.799224 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-01e1141f-2343-47d2-a1d2-097598cf8b45 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:41.800512 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-01e1141f-2343-47d2-a1d2-097598cf8b45 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:41.801334 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-01e1141f-2343-47d2-a1d2-097598cf8b45 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:41.802124 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-01e1141f-2343-47d2-a1d2-097598cf8b45 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:41.975313 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-01e1141f-2343-47d2-a1d2-097598cf8b45 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031939e16194f63b99e6f27f700fa8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecec6d0c155f4d658197c4779ab9ffce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:41.991660 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-01e1141f-2343-47d2-a1d2-097598cf8b45 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] 10.222.0.84 "GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a" status: 200 len: 1363 microversion: 2.1 time: 0.205241 Aug 24 11:32:41.992110 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-5de3a521-0cb0-47b3-9091-621d5f9058ad tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] 10.222.0.84 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.995860 Aug 24 11:32:41.993013 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 94/205] 10.222.0.84 () {60 vars in 1147 bytes} [Wed Aug 24 11:32:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 1998 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 11:32:42.005460 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 112/206] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:41 2022] GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a => generated 1363 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:42.019459 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-14b052f7-554b-434d-a92f-280bfc7a0c0c tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:42.022454 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-14b052f7-554b-434d-a92f-280bfc7a0c0c tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] [instance: 0402b684-55db-4c63-8142-de3fd0cc1503] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:42.107942 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-d9c02778-06c5-4c1b-b8d7-5b7394681385 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:42.108637 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-d9c02778-06c5-4c1b-b8d7-5b7394681385 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: 2e661217-fb1a-48ad-9f1b-47985a4074de] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:42.116384 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-d9c02778-06c5-4c1b-b8d7-5b7394681385 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:42.116384 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-d9c02778-06c5-4c1b-b8d7-5b7394681385 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:42.116679 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-d9c02778-06c5-4c1b-b8d7-5b7394681385 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:42.117213 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-d9c02778-06c5-4c1b-b8d7-5b7394681385 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:42.117670 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-d9c02778-06c5-4c1b-b8d7-5b7394681385 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:42.118098 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-d9c02778-06c5-4c1b-b8d7-5b7394681385 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:42.126696 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-14b052f7-554b-434d-a92f-280bfc7a0c0c tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5055ddeab8314c93bb2a664f9d1a7f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f910065fc9da40798c7f3d4366dab7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:42.145961 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-14b052f7-554b-434d-a92f-280bfc7a0c0c tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] 10.222.0.84 "GET /compute/v2.1/servers/0402b684-55db-4c63-8142-de3fd0cc1503" status: 200 len: 1219 microversion: 2.1 time: 0.132654 Aug 24 11:32:42.146706 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 95/207] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:42 2022] GET /compute/v2.1/servers/0402b684-55db-4c63-8142-de3fd0cc1503 => generated 1219 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:42.318555 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-d9c02778-06c5-4c1b-b8d7-5b7394681385 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:42.327649 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-d9c02778-06c5-4c1b-b8d7-5b7394681385 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:42.329309 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-d9c02778-06c5-4c1b-b8d7-5b7394681385 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:42.330466 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-d9c02778-06c5-4c1b-b8d7-5b7394681385 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de" status: 200 len: 1408 microversion: 2.20 time: 0.226683 Aug 24 11:32:42.331050 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 113/208] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:32:42 2022] GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de => generated 1408 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:32:42.435730 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-27fd694b-b085-4619-a21d-09e596154452 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:42.436420 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-27fd694b-b085-4619-a21d-09e596154452 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: 2d4527c9-c18c-4028-a452-d23423d9c4ee] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:42.444039 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-27fd694b-b085-4619-a21d-09e596154452 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:42.444519 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-27fd694b-b085-4619-a21d-09e596154452 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:42.444988 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-27fd694b-b085-4619-a21d-09e596154452 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:42.445673 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-27fd694b-b085-4619-a21d-09e596154452 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:42.446116 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-27fd694b-b085-4619-a21d-09e596154452 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:42.446530 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-27fd694b-b085-4619-a21d-09e596154452 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:42.603290 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-27fd694b-b085-4619-a21d-09e596154452 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:42.613415 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-27fd694b-b085-4619-a21d-09e596154452 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee" status: 200 len: 1322 microversion: 2.1 time: 0.181938 Aug 24 11:32:42.628177 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 96/209] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:42 2022] GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee => generated 1322 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:42.628433 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-f6f99df9-1186-4f15-9c0f-b093e7da1d03 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:42.628433 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-f6f99df9-1186-4f15-9c0f-b093e7da1d03 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:42.628433 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f6f99df9-1186-4f15-9c0f-b093e7da1d03 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:42.628818 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f6f99df9-1186-4f15-9c0f-b093e7da1d03 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:42.629254 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f6f99df9-1186-4f15-9c0f-b093e7da1d03 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:42.630004 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f6f99df9-1186-4f15-9c0f-b093e7da1d03 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:42.630451 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f6f99df9-1186-4f15-9c0f-b093e7da1d03 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:42.630948 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f6f99df9-1186-4f15-9c0f-b093e7da1d03 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:42.785553 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-f6f99df9-1186-4f15-9c0f-b093e7da1d03 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2715cf2a5129439c83a5347bb963f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4159dc366f41bc9e4057a079f6fb5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:42.794607 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-f6f99df9-1186-4f15-9c0f-b093e7da1d03 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "GET /compute/v2.1/servers/e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311" status: 200 len: 1367 microversion: 2.1 time: 0.180191 Aug 24 11:32:42.795204 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 114/210] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:42 2022] GET /compute/v2.1/servers/e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311 => generated 1367 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:32:42.811173 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-ae546b25-39c4-4ffb-8b3f-ecf17844afe6 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:42.811964 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-ae546b25-39c4-4ffb-8b3f-ecf17844afe6 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] [instance: 07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:42.822717 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ae546b25-39c4-4ffb-8b3f-ecf17844afe6 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:42.826494 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ae546b25-39c4-4ffb-8b3f-ecf17844afe6 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:42.826494 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ae546b25-39c4-4ffb-8b3f-ecf17844afe6 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:42.826494 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ae546b25-39c4-4ffb-8b3f-ecf17844afe6 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:42.826494 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ae546b25-39c4-4ffb-8b3f-ecf17844afe6 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:42.827157 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ae546b25-39c4-4ffb-8b3f-ecf17844afe6 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:43.004374 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-ae546b25-39c4-4ffb-8b3f-ecf17844afe6 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cef1a9e6a241ac8401b88f4a0f69fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901780013b03485a83261796f69e1b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:43.012548 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-ae546b25-39c4-4ffb-8b3f-ecf17844afe6 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] 10.222.0.84 "GET /compute/v2.1/servers/07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0" status: 200 len: 1314 microversion: 2.1 time: 0.206434 Aug 24 11:32:43.013168 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 97/211] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:42 2022] GET /compute/v2.1/servers/07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0 => generated 1314 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:43.036607 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-545175d3-fff4-4f87-b253-90a92477e288 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:43.037519 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-545175d3-fff4-4f87-b253-90a92477e288 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] [instance: 15d4a46e-9504-4897-918d-39aafc20d22a] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:43.044652 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-545175d3-fff4-4f87-b253-90a92477e288 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:43.046881 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-545175d3-fff4-4f87-b253-90a92477e288 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:43.046881 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-545175d3-fff4-4f87-b253-90a92477e288 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:43.047247 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-545175d3-fff4-4f87-b253-90a92477e288 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:43.047623 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-545175d3-fff4-4f87-b253-90a92477e288 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:43.048296 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-545175d3-fff4-4f87-b253-90a92477e288 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:43.167993 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-7ead24b9-c048-435b-9af8-481e385d168f tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:43.168618 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-7ead24b9-c048-435b-9af8-481e385d168f tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] [instance: 0402b684-55db-4c63-8142-de3fd0cc1503] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:43.208779 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-545175d3-fff4-4f87-b253-90a92477e288 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031939e16194f63b99e6f27f700fa8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecec6d0c155f4d658197c4779ab9ffce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:43.220292 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-545175d3-fff4-4f87-b253-90a92477e288 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] 10.222.0.84 "GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a" status: 200 len: 1363 microversion: 2.1 time: 0.187712 Aug 24 11:32:43.221429 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 115/212] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:43 2022] GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a => generated 1363 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:43.235449 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-7ead24b9-c048-435b-9af8-481e385d168f tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5055ddeab8314c93bb2a664f9d1a7f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f910065fc9da40798c7f3d4366dab7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:43.243493 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-7ead24b9-c048-435b-9af8-481e385d168f tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] 10.222.0.84 "GET /compute/v2.1/servers/0402b684-55db-4c63-8142-de3fd0cc1503" status: 200 len: 1219 microversion: 2.1 time: 0.079615 Aug 24 11:32:43.255114 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 98/213] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:43 2022] GET /compute/v2.1/servers/0402b684-55db-4c63-8142-de3fd0cc1503 => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:32:43.359862 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-f1b4f681-9bda-4bb2-a3b4-18ec130d3ee1 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:43.360782 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-f1b4f681-9bda-4bb2-a3b4-18ec130d3ee1 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: 2e661217-fb1a-48ad-9f1b-47985a4074de] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:43.372366 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f1b4f681-9bda-4bb2-a3b4-18ec130d3ee1 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:43.373558 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f1b4f681-9bda-4bb2-a3b4-18ec130d3ee1 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:43.374444 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f1b4f681-9bda-4bb2-a3b4-18ec130d3ee1 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:43.375933 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f1b4f681-9bda-4bb2-a3b4-18ec130d3ee1 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:43.376416 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f1b4f681-9bda-4bb2-a3b4-18ec130d3ee1 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:43.376995 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f1b4f681-9bda-4bb2-a3b4-18ec130d3ee1 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:43.544896 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-f1b4f681-9bda-4bb2-a3b4-18ec130d3ee1 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:43.559795 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-f1b4f681-9bda-4bb2-a3b4-18ec130d3ee1 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:43.563008 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-f1b4f681-9bda-4bb2-a3b4-18ec130d3ee1 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:43.564611 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-f1b4f681-9bda-4bb2-a3b4-18ec130d3ee1 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de" status: 200 len: 1408 microversion: 2.20 time: 0.212866 Aug 24 11:32:43.565761 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 116/214] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:32:43 2022] GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de => generated 1408 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 11:32:43.640459 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-4f7c63fa-e870-4d45-a2db-974f4341f3d4 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:43.641408 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-4f7c63fa-e870-4d45-a2db-974f4341f3d4 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: 2d4527c9-c18c-4028-a452-d23423d9c4ee] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:43.651169 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4f7c63fa-e870-4d45-a2db-974f4341f3d4 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:43.651914 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4f7c63fa-e870-4d45-a2db-974f4341f3d4 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:43.652548 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4f7c63fa-e870-4d45-a2db-974f4341f3d4 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:43.653648 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4f7c63fa-e870-4d45-a2db-974f4341f3d4 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:43.654380 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4f7c63fa-e870-4d45-a2db-974f4341f3d4 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:43.656063 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4f7c63fa-e870-4d45-a2db-974f4341f3d4 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:43.812078 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-4f7c63fa-e870-4d45-a2db-974f4341f3d4 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:43.818254 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-1b795f99-2e08-423b-8ea9-8a028a0c399f tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:43.819217 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-1b795f99-2e08-423b-8ea9-8a028a0c399f tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:43.821797 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-4f7c63fa-e870-4d45-a2db-974f4341f3d4 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee" status: 200 len: 1322 microversion: 2.1 time: 0.189050 Aug 24 11:32:43.822478 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 99/215] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:43 2022] GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee => generated 1322 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:43.828864 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-1b795f99-2e08-423b-8ea9-8a028a0c399f tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:43.829374 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-1b795f99-2e08-423b-8ea9-8a028a0c399f tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:43.834386 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-1b795f99-2e08-423b-8ea9-8a028a0c399f tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:43.834386 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-1b795f99-2e08-423b-8ea9-8a028a0c399f tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:43.834386 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-1b795f99-2e08-423b-8ea9-8a028a0c399f tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:43.834386 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-1b795f99-2e08-423b-8ea9-8a028a0c399f tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:44.000598 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-1b795f99-2e08-423b-8ea9-8a028a0c399f tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2715cf2a5129439c83a5347bb963f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4159dc366f41bc9e4057a079f6fb5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:44.009210 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-1b795f99-2e08-423b-8ea9-8a028a0c399f tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "GET /compute/v2.1/servers/e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311" status: 200 len: 1367 microversion: 2.1 time: 0.196688 Aug 24 11:32:44.009803 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 117/216] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:43 2022] GET /compute/v2.1/servers/e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311 => generated 1367 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:32:44.036987 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-ec0c8bfb-8137-4235-9e95-8c352450bf0f tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:44.037901 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-ec0c8bfb-8137-4235-9e95-8c352450bf0f tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] [instance: 07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:44.046086 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ec0c8bfb-8137-4235-9e95-8c352450bf0f tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:44.052208 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ec0c8bfb-8137-4235-9e95-8c352450bf0f tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:44.052208 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ec0c8bfb-8137-4235-9e95-8c352450bf0f tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:44.052208 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ec0c8bfb-8137-4235-9e95-8c352450bf0f tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:44.052208 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ec0c8bfb-8137-4235-9e95-8c352450bf0f tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:44.052894 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ec0c8bfb-8137-4235-9e95-8c352450bf0f tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:44.216683 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-ec0c8bfb-8137-4235-9e95-8c352450bf0f tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cef1a9e6a241ac8401b88f4a0f69fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901780013b03485a83261796f69e1b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:44.232111 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-ec0c8bfb-8137-4235-9e95-8c352450bf0f tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] 10.222.0.84 "GET /compute/v2.1/servers/07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0" status: 200 len: 1314 microversion: 2.1 time: 0.199112 Aug 24 11:32:44.233197 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 100/217] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:44 2022] GET /compute/v2.1/servers/07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0 => generated 1314 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:32:44.253476 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-abd65fec-d300-4759-a48d-a279338e7027 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:44.254470 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-abd65fec-d300-4759-a48d-a279338e7027 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] [instance: 15d4a46e-9504-4897-918d-39aafc20d22a] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:44.262626 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-abd65fec-d300-4759-a48d-a279338e7027 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:44.263221 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-abd65fec-d300-4759-a48d-a279338e7027 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:44.263863 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-abd65fec-d300-4759-a48d-a279338e7027 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:44.265209 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-abd65fec-d300-4759-a48d-a279338e7027 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:44.266328 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-abd65fec-d300-4759-a48d-a279338e7027 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:44.267147 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-abd65fec-d300-4759-a48d-a279338e7027 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:44.287273 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-a958afea-3626-466d-a0e7-9d59dbf32da7 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:44.288136 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-a958afea-3626-466d-a0e7-9d59dbf32da7 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] [instance: 0402b684-55db-4c63-8142-de3fd0cc1503] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:44.299760 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a958afea-3626-466d-a0e7-9d59dbf32da7 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:44.300074 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a958afea-3626-466d-a0e7-9d59dbf32da7 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:44.301444 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a958afea-3626-466d-a0e7-9d59dbf32da7 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:44.302460 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a958afea-3626-466d-a0e7-9d59dbf32da7 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:44.303158 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a958afea-3626-466d-a0e7-9d59dbf32da7 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:44.309239 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a958afea-3626-466d-a0e7-9d59dbf32da7 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:44.434738 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-a958afea-3626-466d-a0e7-9d59dbf32da7 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5055ddeab8314c93bb2a664f9d1a7f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f910065fc9da40798c7f3d4366dab7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:44.449120 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-a958afea-3626-466d-a0e7-9d59dbf32da7 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] 10.222.0.84 "GET /compute/v2.1/servers/0402b684-55db-4c63-8142-de3fd0cc1503" status: 200 len: 1223 microversion: 2.1 time: 0.162524 Aug 24 11:32:44.449366 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 101/218] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:44 2022] GET /compute/v2.1/servers/0402b684-55db-4c63-8142-de3fd0cc1503 => generated 1223 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:44.474561 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-abd65fec-d300-4759-a48d-a279338e7027 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031939e16194f63b99e6f27f700fa8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecec6d0c155f4d658197c4779ab9ffce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:44.489601 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-abd65fec-d300-4759-a48d-a279338e7027 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] 10.222.0.84 "GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a" status: 200 len: 1363 microversion: 2.1 time: 0.240697 Aug 24 11:32:44.491397 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 118/219] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:44 2022] GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a => generated 1363 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:32:44.514134 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [req-a5a94d56-f0a9-459d-9553-ba81c00180e7 req-76d45bd0-871f-4092-9bb6-220c56f531a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e661217-fb1a-48ad-9f1b-47985a4074de", "name": "network-vif-plugged", "status": "completed", "tag": "e82d60e7-8369-4554-9da0-a0a3a25fe586"}]} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:32:44.525140 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-a5a94d56-f0a9-459d-9553-ba81c00180e7 req-76d45bd0-871f-4092-9bb6-220c56f531a5 service nova] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:44.525622 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-a5a94d56-f0a9-459d-9553-ba81c00180e7 req-76d45bd0-871f-4092-9bb6-220c56f531a5 service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:44.526055 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-a5a94d56-f0a9-459d-9553-ba81c00180e7 req-76d45bd0-871f-4092-9bb6-220c56f531a5 service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:44.539004 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.compute.server_external_events [req-a5a94d56-f0a9-459d-9553-ba81c00180e7 req-76d45bd0-871f-4092-9bb6-220c56f531a5 service nova] Creating event network-vif-plugged:e82d60e7-8369-4554-9da0-a0a3a25fe586 for instance 2e661217-fb1a-48ad-9f1b-47985a4074de on hv-cinder-85427 Aug 24 11:32:44.547674 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [req-a5a94d56-f0a9-459d-9553-ba81c00180e7 req-76d45bd0-871f-4092-9bb6-220c56f531a5 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041614 Aug 24 11:32:44.548483 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 102/220] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Aug 24 11:32:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:32:44.591606 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-4b9bcb27-5af1-4759-92b2-f381538b3adf tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:44.594686 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-4b9bcb27-5af1-4759-92b2-f381538b3adf tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: 2e661217-fb1a-48ad-9f1b-47985a4074de] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:44.602648 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-4b9bcb27-5af1-4759-92b2-f381538b3adf tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:44.603459 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-4b9bcb27-5af1-4759-92b2-f381538b3adf tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:44.603894 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-4b9bcb27-5af1-4759-92b2-f381538b3adf tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:44.604845 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-4b9bcb27-5af1-4759-92b2-f381538b3adf tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:44.605525 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-4b9bcb27-5af1-4759-92b2-f381538b3adf tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:44.605960 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-4b9bcb27-5af1-4759-92b2-f381538b3adf tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:44.848613 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-4b9bcb27-5af1-4759-92b2-f381538b3adf tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:44.856539 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-67a4a0a6-f15a-4aaf-a42c-edb005d29c3a tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:44.860058 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-67a4a0a6-f15a-4aaf-a42c-edb005d29c3a tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: 2d4527c9-c18c-4028-a452-d23423d9c4ee] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:44.871639 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-4b9bcb27-5af1-4759-92b2-f381538b3adf tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:44.873682 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-4b9bcb27-5af1-4759-92b2-f381538b3adf tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:44.875829 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-4b9bcb27-5af1-4759-92b2-f381538b3adf tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de" status: 200 len: 1408 microversion: 2.20 time: 0.290590 Aug 24 11:32:44.876038 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-67a4a0a6-f15a-4aaf-a42c-edb005d29c3a tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:44.876737 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 119/221] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:32:44 2022] GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de => generated 1408 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:32:44.887384 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-67a4a0a6-f15a-4aaf-a42c-edb005d29c3a tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:44.887384 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-67a4a0a6-f15a-4aaf-a42c-edb005d29c3a tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:44.887384 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-67a4a0a6-f15a-4aaf-a42c-edb005d29c3a tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:44.887384 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-67a4a0a6-f15a-4aaf-a42c-edb005d29c3a tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:44.887858 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-67a4a0a6-f15a-4aaf-a42c-edb005d29c3a tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:44.891738 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_cell1:SELECT=100 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:45.033758 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-a8b7eaec-90d3-498b-b8a9-1a7a37afb342 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:45.034526 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-a8b7eaec-90d3-498b-b8a9-1a7a37afb342 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:45.052478 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-a8b7eaec-90d3-498b-b8a9-1a7a37afb342 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:45.055863 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-a8b7eaec-90d3-498b-b8a9-1a7a37afb342 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:45.061406 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-a8b7eaec-90d3-498b-b8a9-1a7a37afb342 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:45.066102 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-a8b7eaec-90d3-498b-b8a9-1a7a37afb342 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:45.094117 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-a8b7eaec-90d3-498b-b8a9-1a7a37afb342 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.029s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:45.095392 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-a8b7eaec-90d3-498b-b8a9-1a7a37afb342 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:45.400622 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-67a4a0a6-f15a-4aaf-a42c-edb005d29c3a tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:45.422281 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-67a4a0a6-f15a-4aaf-a42c-edb005d29c3a tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee" status: 200 len: 1322 microversion: 2.1 time: 0.579518 Aug 24 11:32:45.423357 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 103/222] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:44 2022] GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee => generated 1322 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:45.428725 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-d7f1938a-6fd4-408f-a26e-91fa32ef75c1 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:45.429979 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-d7f1938a-6fd4-408f-a26e-91fa32ef75c1 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] [instance: 07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:45.434834 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:45.440362 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d7f1938a-6fd4-408f-a26e-91fa32ef75c1 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:45.441214 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d7f1938a-6fd4-408f-a26e-91fa32ef75c1 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:45.441922 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d7f1938a-6fd4-408f-a26e-91fa32ef75c1 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:45.443290 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d7f1938a-6fd4-408f-a26e-91fa32ef75c1 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:45.444019 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d7f1938a-6fd4-408f-a26e-91fa32ef75c1 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:45.444578 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d7f1938a-6fd4-408f-a26e-91fa32ef75c1 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:45.485841 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-a8b7eaec-90d3-498b-b8a9-1a7a37afb342 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2715cf2a5129439c83a5347bb963f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4159dc366f41bc9e4057a079f6fb5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:45.492199 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG dbcounter [-] [124769] Writing DB stats nova_cell1:SELECT=100 {{(pid=124769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:45.495338 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-a8b7eaec-90d3-498b-b8a9-1a7a37afb342 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "GET /compute/v2.1/servers/e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311" status: 200 len: 1367 microversion: 2.1 time: 0.467276 Aug 24 11:32:45.500157 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 120/223] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:45 2022] GET /compute/v2.1/servers/e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311 => generated 1367 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:32:45.503299 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-031f340e-19db-4bf3-9fbf-6bbd7c8b04fd tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:45.504268 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-031f340e-19db-4bf3-9fbf-6bbd7c8b04fd tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] [instance: 0402b684-55db-4c63-8142-de3fd0cc1503] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:45.515754 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-031f340e-19db-4bf3-9fbf-6bbd7c8b04fd tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:45.516593 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-031f340e-19db-4bf3-9fbf-6bbd7c8b04fd tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:45.517380 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-031f340e-19db-4bf3-9fbf-6bbd7c8b04fd tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:45.522676 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-031f340e-19db-4bf3-9fbf-6bbd7c8b04fd tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:45.522676 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-031f340e-19db-4bf3-9fbf-6bbd7c8b04fd tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:45.522676 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-031f340e-19db-4bf3-9fbf-6bbd7c8b04fd tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:45.600188 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-031f340e-19db-4bf3-9fbf-6bbd7c8b04fd tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5055ddeab8314c93bb2a664f9d1a7f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f910065fc9da40798c7f3d4366dab7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:45.615476 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-031f340e-19db-4bf3-9fbf-6bbd7c8b04fd tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] 10.222.0.84 "GET /compute/v2.1/servers/0402b684-55db-4c63-8142-de3fd0cc1503" status: 200 len: 1215 microversion: 2.1 time: 0.117390 Aug 24 11:32:45.616619 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 121/224] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:45 2022] GET /compute/v2.1/servers/0402b684-55db-4c63-8142-de3fd0cc1503 => generated 1215 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:45.626549 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-22f70f19-a5ef-44c1-b900-10b0544a30e4 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:45.628021 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-22f70f19-a5ef-44c1-b900-10b0544a30e4 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] [instance: 15d4a46e-9504-4897-918d-39aafc20d22a] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:45.643036 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-22f70f19-a5ef-44c1-b900-10b0544a30e4 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:45.644179 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-22f70f19-a5ef-44c1-b900-10b0544a30e4 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:45.645302 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-22f70f19-a5ef-44c1-b900-10b0544a30e4 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:45.646201 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-22f70f19-a5ef-44c1-b900-10b0544a30e4 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:45.646863 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-22f70f19-a5ef-44c1-b900-10b0544a30e4 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:45.654668 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-22f70f19-a5ef-44c1-b900-10b0544a30e4 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:45.752220 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-d7f1938a-6fd4-408f-a26e-91fa32ef75c1 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cef1a9e6a241ac8401b88f4a0f69fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901780013b03485a83261796f69e1b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:45.775021 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-d7f1938a-6fd4-408f-a26e-91fa32ef75c1 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] 10.222.0.84 "GET /compute/v2.1/servers/07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0" status: 200 len: 1314 microversion: 2.1 time: 0.350135 Aug 24 11:32:45.776054 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 104/225] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:45 2022] GET /compute/v2.1/servers/07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0 => generated 1314 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:45.910224 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-254a3fac-60af-4e11-876c-ed48047cdffb tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:45.911848 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-254a3fac-60af-4e11-876c-ed48047cdffb tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: 2e661217-fb1a-48ad-9f1b-47985a4074de] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:45.923854 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-254a3fac-60af-4e11-876c-ed48047cdffb tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:45.925354 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-254a3fac-60af-4e11-876c-ed48047cdffb tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:45.926463 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-254a3fac-60af-4e11-876c-ed48047cdffb tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:45.929677 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-254a3fac-60af-4e11-876c-ed48047cdffb tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:45.931118 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-254a3fac-60af-4e11-876c-ed48047cdffb tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:45.934504 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-254a3fac-60af-4e11-876c-ed48047cdffb tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:46.007178 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-22f70f19-a5ef-44c1-b900-10b0544a30e4 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031939e16194f63b99e6f27f700fa8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecec6d0c155f4d658197c4779ab9ffce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:46.022892 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-22f70f19-a5ef-44c1-b900-10b0544a30e4 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] 10.222.0.84 "GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a" status: 200 len: 1363 microversion: 2.1 time: 0.404241 Aug 24 11:32:46.025065 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 122/226] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:45 2022] GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a => generated 1363 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:46.133997 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-254a3fac-60af-4e11-876c-ed48047cdffb tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:46.154670 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-254a3fac-60af-4e11-876c-ed48047cdffb tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:46.157824 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-254a3fac-60af-4e11-876c-ed48047cdffb tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:46.159216 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-254a3fac-60af-4e11-876c-ed48047cdffb tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de" status: 200 len: 1408 microversion: 2.20 time: 0.257260 Aug 24 11:32:46.159797 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 105/227] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:32:45 2022] GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de => generated 1408 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:32:46.464695 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-fe4a4900-61e2-4927-b8fd-0337ea5e1640 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:46.466160 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-fe4a4900-61e2-4927-b8fd-0337ea5e1640 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: 2d4527c9-c18c-4028-a452-d23423d9c4ee] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:46.478004 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-fe4a4900-61e2-4927-b8fd-0337ea5e1640 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:46.478891 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-fe4a4900-61e2-4927-b8fd-0337ea5e1640 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:46.479628 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-fe4a4900-61e2-4927-b8fd-0337ea5e1640 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:46.480789 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-fe4a4900-61e2-4927-b8fd-0337ea5e1640 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:46.481594 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-fe4a4900-61e2-4927-b8fd-0337ea5e1640 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:46.482544 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-fe4a4900-61e2-4927-b8fd-0337ea5e1640 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:46.518470 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-7ea3d10b-30f4-4811-ac3a-ed9149763135 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:46.519085 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-7ea3d10b-30f4-4811-ac3a-ed9149763135 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:46.525353 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-7ea3d10b-30f4-4811-ac3a-ed9149763135 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:46.525844 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-7ea3d10b-30f4-4811-ac3a-ed9149763135 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:46.526291 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-7ea3d10b-30f4-4811-ac3a-ed9149763135 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:46.527166 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-7ea3d10b-30f4-4811-ac3a-ed9149763135 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:46.527623 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-7ea3d10b-30f4-4811-ac3a-ed9149763135 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:46.528096 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-7ea3d10b-30f4-4811-ac3a-ed9149763135 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:46.678197 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-fe4a4900-61e2-4927-b8fd-0337ea5e1640 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:46.686238 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-fe4a4900-61e2-4927-b8fd-0337ea5e1640 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee" status: 200 len: 1322 microversion: 2.1 time: 0.228109 Aug 24 11:32:46.686959 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 123/228] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:46 2022] GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee => generated 1322 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:46.701140 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-abf1bd1f-1ae8-416d-a76c-e8d79412d88a tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:46.702650 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-abf1bd1f-1ae8-416d-a76c-e8d79412d88a tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] [instance: 0402b684-55db-4c63-8142-de3fd0cc1503] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:46.709041 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-abf1bd1f-1ae8-416d-a76c-e8d79412d88a tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:46.709926 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-abf1bd1f-1ae8-416d-a76c-e8d79412d88a tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:46.710998 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-abf1bd1f-1ae8-416d-a76c-e8d79412d88a tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:46.711935 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-abf1bd1f-1ae8-416d-a76c-e8d79412d88a tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:46.713447 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-abf1bd1f-1ae8-416d-a76c-e8d79412d88a tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:46.713932 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-abf1bd1f-1ae8-416d-a76c-e8d79412d88a tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:46.716275 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-7ea3d10b-30f4-4811-ac3a-ed9149763135 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2715cf2a5129439c83a5347bb963f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4159dc366f41bc9e4057a079f6fb5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:46.728666 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-7ea3d10b-30f4-4811-ac3a-ed9149763135 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "GET /compute/v2.1/servers/e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311" status: 200 len: 1367 microversion: 2.1 time: 0.214775 Aug 24 11:32:46.730338 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 106/229] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:46 2022] GET /compute/v2.1/servers/e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311 => generated 1367 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:32:46.791438 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-abf1bd1f-1ae8-416d-a76c-e8d79412d88a tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5055ddeab8314c93bb2a664f9d1a7f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f910065fc9da40798c7f3d4366dab7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:46.799388 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-65a5dd5a-e013-43cc-9f35-a41963a705dd tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:46.799616 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-abf1bd1f-1ae8-416d-a76c-e8d79412d88a tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] 10.222.0.84 "GET /compute/v2.1/servers/0402b684-55db-4c63-8142-de3fd0cc1503" status: 200 len: 1215 microversion: 2.1 time: 0.111165 Aug 24 11:32:46.800031 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 124/230] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:46 2022] GET /compute/v2.1/servers/0402b684-55db-4c63-8142-de3fd0cc1503 => generated 1215 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:46.800688 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-65a5dd5a-e013-43cc-9f35-a41963a705dd tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] [instance: 07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:46.807504 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-65a5dd5a-e013-43cc-9f35-a41963a705dd tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:46.808208 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-65a5dd5a-e013-43cc-9f35-a41963a705dd tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:46.808871 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-65a5dd5a-e013-43cc-9f35-a41963a705dd tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:46.809726 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-65a5dd5a-e013-43cc-9f35-a41963a705dd tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:46.810261 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-65a5dd5a-e013-43cc-9f35-a41963a705dd tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:46.810746 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-65a5dd5a-e013-43cc-9f35-a41963a705dd tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:46.993279 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-65a5dd5a-e013-43cc-9f35-a41963a705dd tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cef1a9e6a241ac8401b88f4a0f69fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901780013b03485a83261796f69e1b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:47.003333 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-65a5dd5a-e013-43cc-9f35-a41963a705dd tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] 10.222.0.84 "GET /compute/v2.1/servers/07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0" status: 200 len: 1314 microversion: 2.1 time: 0.209198 Aug 24 11:32:47.006270 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 107/231] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:46 2022] GET /compute/v2.1/servers/07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0 => generated 1314 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:47.047859 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-e699bcd3-1ae5-4814-827c-dc3ff029afd9 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:47.047859 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-e699bcd3-1ae5-4814-827c-dc3ff029afd9 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] [instance: 15d4a46e-9504-4897-918d-39aafc20d22a] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:47.057131 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-e699bcd3-1ae5-4814-827c-dc3ff029afd9 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:47.059001 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-e699bcd3-1ae5-4814-827c-dc3ff029afd9 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:47.059527 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-e699bcd3-1ae5-4814-827c-dc3ff029afd9 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:47.060407 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-e699bcd3-1ae5-4814-827c-dc3ff029afd9 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:47.060895 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-e699bcd3-1ae5-4814-827c-dc3ff029afd9 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:47.061651 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-e699bcd3-1ae5-4814-827c-dc3ff029afd9 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:47.151150 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [req-6f31cdf8-c5ae-4ba3-b2e3-610f7b2a3779 req-b2b98a3d-487c-4c4b-bc7f-d94d68452c80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15d4a46e-9504-4897-918d-39aafc20d22a", "name": "network-vif-plugged", "status": "completed", "tag": "a6afa636-0862-4c9f-9c7f-a90a8c528daa"}]} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:32:47.165164 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-6f31cdf8-c5ae-4ba3-b2e3-610f7b2a3779 req-b2b98a3d-487c-4c4b-bc7f-d94d68452c80 service nova] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:47.168019 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-6f31cdf8-c5ae-4ba3-b2e3-610f7b2a3779 req-b2b98a3d-487c-4c4b-bc7f-d94d68452c80 service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:47.168019 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-6f31cdf8-c5ae-4ba3-b2e3-610f7b2a3779 req-b2b98a3d-487c-4c4b-bc7f-d94d68452c80 service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:47.181828 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.compute.server_external_events [req-6f31cdf8-c5ae-4ba3-b2e3-610f7b2a3779 req-b2b98a3d-487c-4c4b-bc7f-d94d68452c80 service nova] Creating event network-vif-plugged:a6afa636-0862-4c9f-9c7f-a90a8c528daa for instance 15d4a46e-9504-4897-918d-39aafc20d22a on hv-cinder-85427 Aug 24 11:32:47.188098 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [req-6f31cdf8-c5ae-4ba3-b2e3-610f7b2a3779 req-b2b98a3d-487c-4c4b-bc7f-d94d68452c80 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040548 Aug 24 11:32:47.189219 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 108/232] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Aug 24 11:32:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:32:47.204152 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-6c9178df-500a-437c-bcf7-6267cf613a2f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:47.205165 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-6c9178df-500a-437c-bcf7-6267cf613a2f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: 2e661217-fb1a-48ad-9f1b-47985a4074de] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:47.215073 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6c9178df-500a-437c-bcf7-6267cf613a2f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:47.215555 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6c9178df-500a-437c-bcf7-6267cf613a2f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:47.216389 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6c9178df-500a-437c-bcf7-6267cf613a2f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:47.218351 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6c9178df-500a-437c-bcf7-6267cf613a2f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:47.219372 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6c9178df-500a-437c-bcf7-6267cf613a2f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:47.220202 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6c9178df-500a-437c-bcf7-6267cf613a2f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:47.268731 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-e699bcd3-1ae5-4814-827c-dc3ff029afd9 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031939e16194f63b99e6f27f700fa8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecec6d0c155f4d658197c4779ab9ffce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:47.282809 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-e699bcd3-1ae5-4814-827c-dc3ff029afd9 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] 10.222.0.84 "GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a" status: 200 len: 1363 microversion: 2.1 time: 0.240411 Aug 24 11:32:47.283430 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 125/233] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:47 2022] GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a => generated 1363 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:47.493383 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-6c9178df-500a-437c-bcf7-6267cf613a2f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:47.502405 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-6c9178df-500a-437c-bcf7-6267cf613a2f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:47.503905 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-6c9178df-500a-437c-bcf7-6267cf613a2f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:47.505196 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-6c9178df-500a-437c-bcf7-6267cf613a2f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de" status: 200 len: 1408 microversion: 2.20 time: 0.308858 Aug 24 11:32:47.506323 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 109/234] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:32:47 2022] GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de => generated 1408 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:32:47.713126 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-f7673dd3-357c-4536-a447-e639a954ad47 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:47.714127 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-f7673dd3-357c-4536-a447-e639a954ad47 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: 2d4527c9-c18c-4028-a452-d23423d9c4ee] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:47.724340 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f7673dd3-357c-4536-a447-e639a954ad47 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:47.724857 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f7673dd3-357c-4536-a447-e639a954ad47 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:47.725306 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f7673dd3-357c-4536-a447-e639a954ad47 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:47.726016 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f7673dd3-357c-4536-a447-e639a954ad47 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:47.726477 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f7673dd3-357c-4536-a447-e639a954ad47 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:47.726915 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f7673dd3-357c-4536-a447-e639a954ad47 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:47.765595 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-5bc1aad8-49b6-4065-81ec-2612afcd457c tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:47.768158 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-5bc1aad8-49b6-4065-81ec-2612afcd457c tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:47.786563 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5bc1aad8-49b6-4065-81ec-2612afcd457c tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:47.787230 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5bc1aad8-49b6-4065-81ec-2612afcd457c tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:47.787759 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5bc1aad8-49b6-4065-81ec-2612afcd457c tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:47.793047 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5bc1aad8-49b6-4065-81ec-2612afcd457c tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:47.793913 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5bc1aad8-49b6-4065-81ec-2612afcd457c tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:47.794663 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5bc1aad8-49b6-4065-81ec-2612afcd457c tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:47.935929 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-f7673dd3-357c-4536-a447-e639a954ad47 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:47.956398 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-f7673dd3-357c-4536-a447-e639a954ad47 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee" status: 200 len: 1322 microversion: 2.1 time: 0.249471 Aug 24 11:32:47.957047 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 126/235] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:47 2022] GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee => generated 1322 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:47.962336 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-97095307-1652-49ca-b678-9b722629d4fc tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:47.963078 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-97095307-1652-49ca-b678-9b722629d4fc tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] [instance: 0402b684-55db-4c63-8142-de3fd0cc1503] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:47.973945 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-97095307-1652-49ca-b678-9b722629d4fc tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:47.974534 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-97095307-1652-49ca-b678-9b722629d4fc tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:47.974974 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-97095307-1652-49ca-b678-9b722629d4fc tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:47.976331 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-97095307-1652-49ca-b678-9b722629d4fc tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:47.976817 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-97095307-1652-49ca-b678-9b722629d4fc tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:47.977294 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-97095307-1652-49ca-b678-9b722629d4fc tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:47.988026 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-5bc1aad8-49b6-4065-81ec-2612afcd457c tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2715cf2a5129439c83a5347bb963f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4159dc366f41bc9e4057a079f6fb5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:47.997599 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-5bc1aad8-49b6-4065-81ec-2612afcd457c tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "GET /compute/v2.1/servers/e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311" status: 200 len: 1367 microversion: 2.1 time: 0.249552 Aug 24 11:32:48.001260 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 110/236] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:47 2022] GET /compute/v2.1/servers/e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311 => generated 1367 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:48.032348 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-dec98ee2-5493-4c91-8a09-7b50cc502890 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:48.033467 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-dec98ee2-5493-4c91-8a09-7b50cc502890 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] [instance: 07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:48.042939 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-dec98ee2-5493-4c91-8a09-7b50cc502890 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:48.043445 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-dec98ee2-5493-4c91-8a09-7b50cc502890 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:48.043882 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-dec98ee2-5493-4c91-8a09-7b50cc502890 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:48.044576 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-dec98ee2-5493-4c91-8a09-7b50cc502890 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:48.045057 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-dec98ee2-5493-4c91-8a09-7b50cc502890 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:48.045475 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-dec98ee2-5493-4c91-8a09-7b50cc502890 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:48.053940 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-97095307-1652-49ca-b678-9b722629d4fc tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5055ddeab8314c93bb2a664f9d1a7f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f910065fc9da40798c7f3d4366dab7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:48.063841 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-97095307-1652-49ca-b678-9b722629d4fc tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] 10.222.0.84 "GET /compute/v2.1/servers/0402b684-55db-4c63-8142-de3fd0cc1503" status: 200 len: 1215 microversion: 2.1 time: 0.105695 Aug 24 11:32:48.064570 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 127/237] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:47 2022] GET /compute/v2.1/servers/0402b684-55db-4c63-8142-de3fd0cc1503 => generated 1215 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:48.203385 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-dec98ee2-5493-4c91-8a09-7b50cc502890 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cef1a9e6a241ac8401b88f4a0f69fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901780013b03485a83261796f69e1b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:48.214965 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-dec98ee2-5493-4c91-8a09-7b50cc502890 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] 10.222.0.84 "GET /compute/v2.1/servers/07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0" status: 200 len: 1314 microversion: 2.1 time: 0.191518 Aug 24 11:32:48.214965 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 111/238] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:48 2022] GET /compute/v2.1/servers/07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0 => generated 1314 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:48.308309 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-d6ccf046-f788-40fb-8c9a-42516a8484b0 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:48.308983 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-d6ccf046-f788-40fb-8c9a-42516a8484b0 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] [instance: 15d4a46e-9504-4897-918d-39aafc20d22a] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:48.316445 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-d6ccf046-f788-40fb-8c9a-42516a8484b0 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:48.316953 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-d6ccf046-f788-40fb-8c9a-42516a8484b0 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:48.317391 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-d6ccf046-f788-40fb-8c9a-42516a8484b0 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:48.318090 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-d6ccf046-f788-40fb-8c9a-42516a8484b0 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:48.318557 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-d6ccf046-f788-40fb-8c9a-42516a8484b0 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:48.318978 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-d6ccf046-f788-40fb-8c9a-42516a8484b0 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:48.469041 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-d6ccf046-f788-40fb-8c9a-42516a8484b0 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031939e16194f63b99e6f27f700fa8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecec6d0c155f4d658197c4779ab9ffce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:48.477064 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-d6ccf046-f788-40fb-8c9a-42516a8484b0 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] 10.222.0.84 "GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a" status: 200 len: 1363 microversion: 2.1 time: 0.172989 Aug 24 11:32:48.478082 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 128/239] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:48 2022] GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a => generated 1363 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:48.532191 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-043d061f-93be-4952-91d3-0a87c449e0d6 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:48.536653 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-043d061f-93be-4952-91d3-0a87c449e0d6 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: 2e661217-fb1a-48ad-9f1b-47985a4074de] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:48.539534 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-043d061f-93be-4952-91d3-0a87c449e0d6 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:48.540021 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-043d061f-93be-4952-91d3-0a87c449e0d6 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:48.540490 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-043d061f-93be-4952-91d3-0a87c449e0d6 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:48.541238 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-043d061f-93be-4952-91d3-0a87c449e0d6 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:48.541687 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-043d061f-93be-4952-91d3-0a87c449e0d6 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:48.542113 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-043d061f-93be-4952-91d3-0a87c449e0d6 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:48.708700 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-043d061f-93be-4952-91d3-0a87c449e0d6 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:48.721714 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-043d061f-93be-4952-91d3-0a87c449e0d6 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:48.723778 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-043d061f-93be-4952-91d3-0a87c449e0d6 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:48.725765 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-043d061f-93be-4952-91d3-0a87c449e0d6 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de" status: 200 len: 1408 microversion: 2.20 time: 0.198052 Aug 24 11:32:48.727061 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 112/240] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:32:48 2022] GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de => generated 1408 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:32:48.988464 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-c734239c-0976-49e1-b590-fa824a761e60 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:48.988945 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-c734239c-0976-49e1-b590-fa824a761e60 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: 2d4527c9-c18c-4028-a452-d23423d9c4ee] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:48.997215 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-c734239c-0976-49e1-b590-fa824a761e60 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:48.998084 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-c734239c-0976-49e1-b590-fa824a761e60 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:48.998533 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-c734239c-0976-49e1-b590-fa824a761e60 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:48.999893 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-c734239c-0976-49e1-b590-fa824a761e60 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:49.000517 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-c734239c-0976-49e1-b590-fa824a761e60 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:49.001149 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-c734239c-0976-49e1-b590-fa824a761e60 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:49.020268 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-476f1469-2221-45aa-a96f-c357d1d3b11d tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:49.021063 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-476f1469-2221-45aa-a96f-c357d1d3b11d tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:49.036354 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-476f1469-2221-45aa-a96f-c357d1d3b11d tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:49.037464 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-476f1469-2221-45aa-a96f-c357d1d3b11d tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:49.038190 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-476f1469-2221-45aa-a96f-c357d1d3b11d tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:49.039435 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-476f1469-2221-45aa-a96f-c357d1d3b11d tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:49.040326 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-476f1469-2221-45aa-a96f-c357d1d3b11d tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:49.040326 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-476f1469-2221-45aa-a96f-c357d1d3b11d tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:49.175064 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-c734239c-0976-49e1-b590-fa824a761e60 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:49.191033 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-c734239c-0976-49e1-b590-fa824a761e60 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee" status: 200 len: 1322 microversion: 2.1 time: 0.204625 Aug 24 11:32:49.191033 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 129/241] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:48 2022] GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee => generated 1322 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:49.194594 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-57a15fe9-9f89-4d71-ae97-a8bef2e5a5d2 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:49.195208 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-57a15fe9-9f89-4d71-ae97-a8bef2e5a5d2 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] [instance: 0402b684-55db-4c63-8142-de3fd0cc1503] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:49.209824 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-57a15fe9-9f89-4d71-ae97-a8bef2e5a5d2 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:49.214434 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-57a15fe9-9f89-4d71-ae97-a8bef2e5a5d2 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:49.216071 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-57a15fe9-9f89-4d71-ae97-a8bef2e5a5d2 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:49.216846 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-57a15fe9-9f89-4d71-ae97-a8bef2e5a5d2 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:49.217326 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-57a15fe9-9f89-4d71-ae97-a8bef2e5a5d2 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:49.218408 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-57a15fe9-9f89-4d71-ae97-a8bef2e5a5d2 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:49.231631 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-476f1469-2221-45aa-a96f-c357d1d3b11d tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2715cf2a5129439c83a5347bb963f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4159dc366f41bc9e4057a079f6fb5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:49.240235 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-476f1469-2221-45aa-a96f-c357d1d3b11d tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "GET /compute/v2.1/servers/e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311" status: 200 len: 1367 microversion: 2.1 time: 0.225215 Aug 24 11:32:49.248864 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 113/242] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:49 2022] GET /compute/v2.1/servers/e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311 => generated 1367 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:49.248864 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-58568018-51d7-420b-a589-8fa46b4117c1 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:49.248864 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-58568018-51d7-420b-a589-8fa46b4117c1 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] [instance: 07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:49.254165 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-58568018-51d7-420b-a589-8fa46b4117c1 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:49.254857 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-58568018-51d7-420b-a589-8fa46b4117c1 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:49.255428 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-58568018-51d7-420b-a589-8fa46b4117c1 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:49.256370 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-58568018-51d7-420b-a589-8fa46b4117c1 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:49.257092 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-58568018-51d7-420b-a589-8fa46b4117c1 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:49.257729 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-58568018-51d7-420b-a589-8fa46b4117c1 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:49.321624 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-57a15fe9-9f89-4d71-ae97-a8bef2e5a5d2 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5055ddeab8314c93bb2a664f9d1a7f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f910065fc9da40798c7f3d4366dab7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:49.343472 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-57a15fe9-9f89-4d71-ae97-a8bef2e5a5d2 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] 10.222.0.84 "GET /compute/v2.1/servers/0402b684-55db-4c63-8142-de3fd0cc1503" status: 200 len: 1215 microversion: 2.1 time: 0.152068 Aug 24 11:32:49.345208 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 130/243] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:49 2022] GET /compute/v2.1/servers/0402b684-55db-4c63-8142-de3fd0cc1503 => generated 1215 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:49.431503 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-58568018-51d7-420b-a589-8fa46b4117c1 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cef1a9e6a241ac8401b88f4a0f69fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901780013b03485a83261796f69e1b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:49.441175 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-58568018-51d7-420b-a589-8fa46b4117c1 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] 10.222.0.84 "GET /compute/v2.1/servers/07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0" status: 200 len: 1314 microversion: 2.1 time: 0.198190 Aug 24 11:32:49.442146 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 114/244] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:49 2022] GET /compute/v2.1/servers/07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0 => generated 1314 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:49.501304 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-9ae0f561-51db-4208-8a96-1b0fa0f43cd6 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:49.501981 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-9ae0f561-51db-4208-8a96-1b0fa0f43cd6 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] [instance: 15d4a46e-9504-4897-918d-39aafc20d22a] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:49.510044 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-9ae0f561-51db-4208-8a96-1b0fa0f43cd6 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:49.513295 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-9ae0f561-51db-4208-8a96-1b0fa0f43cd6 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:49.513295 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-9ae0f561-51db-4208-8a96-1b0fa0f43cd6 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:49.513610 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-9ae0f561-51db-4208-8a96-1b0fa0f43cd6 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:49.514315 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-9ae0f561-51db-4208-8a96-1b0fa0f43cd6 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:49.515636 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-9ae0f561-51db-4208-8a96-1b0fa0f43cd6 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:49.725014 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-9ae0f561-51db-4208-8a96-1b0fa0f43cd6 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031939e16194f63b99e6f27f700fa8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecec6d0c155f4d658197c4779ab9ffce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:49.737970 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-9ae0f561-51db-4208-8a96-1b0fa0f43cd6 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] 10.222.0.84 "GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a" status: 200 len: 1363 microversion: 2.1 time: 0.241328 Aug 24 11:32:49.739356 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 131/245] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:49 2022] GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a => generated 1363 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:49.749643 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-1fffb5f1-2abd-400b-a6d3-849cd017fe23 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:49.750160 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-1fffb5f1-2abd-400b-a6d3-849cd017fe23 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: 2e661217-fb1a-48ad-9f1b-47985a4074de] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:49.758410 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1fffb5f1-2abd-400b-a6d3-849cd017fe23 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:49.759227 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1fffb5f1-2abd-400b-a6d3-849cd017fe23 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:49.759896 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1fffb5f1-2abd-400b-a6d3-849cd017fe23 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:49.760871 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1fffb5f1-2abd-400b-a6d3-849cd017fe23 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:49.761539 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1fffb5f1-2abd-400b-a6d3-849cd017fe23 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:49.762232 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1fffb5f1-2abd-400b-a6d3-849cd017fe23 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:49.939722 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-1fffb5f1-2abd-400b-a6d3-849cd017fe23 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:49.949033 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-1fffb5f1-2abd-400b-a6d3-849cd017fe23 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:49.950529 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-1fffb5f1-2abd-400b-a6d3-849cd017fe23 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:49.951647 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-1fffb5f1-2abd-400b-a6d3-849cd017fe23 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de" status: 200 len: 1408 microversion: 2.20 time: 0.206253 Aug 24 11:32:49.954697 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 115/246] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:32:49 2022] GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de => generated 1408 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:32:50.219533 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-8dc5320e-710b-42d2-93aa-83bcec374ec5 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:50.221301 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-8dc5320e-710b-42d2-93aa-83bcec374ec5 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: 2d4527c9-c18c-4028-a452-d23423d9c4ee] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:50.227612 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-8dc5320e-710b-42d2-93aa-83bcec374ec5 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:50.228101 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-8dc5320e-710b-42d2-93aa-83bcec374ec5 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:50.228561 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-8dc5320e-710b-42d2-93aa-83bcec374ec5 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:50.229277 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-8dc5320e-710b-42d2-93aa-83bcec374ec5 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:50.229773 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-8dc5320e-710b-42d2-93aa-83bcec374ec5 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:50.230201 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-8dc5320e-710b-42d2-93aa-83bcec374ec5 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:50.270090 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-1693e3c8-2cac-4986-9d6b-5bbb40c91331 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:50.271130 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-1693e3c8-2cac-4986-9d6b-5bbb40c91331 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:50.282735 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1693e3c8-2cac-4986-9d6b-5bbb40c91331 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:50.283984 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1693e3c8-2cac-4986-9d6b-5bbb40c91331 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:50.284729 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1693e3c8-2cac-4986-9d6b-5bbb40c91331 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:50.286669 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1693e3c8-2cac-4986-9d6b-5bbb40c91331 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:50.287450 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1693e3c8-2cac-4986-9d6b-5bbb40c91331 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:50.288168 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1693e3c8-2cac-4986-9d6b-5bbb40c91331 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:50.493869 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-8dc5320e-710b-42d2-93aa-83bcec374ec5 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:50.508098 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-8dc5320e-710b-42d2-93aa-83bcec374ec5 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee" status: 200 len: 1322 microversion: 2.1 time: 0.295069 Aug 24 11:32:50.508695 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 132/247] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:50 2022] GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee => generated 1322 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:32:50.526093 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-8d8388b2-d1e8-4bf9-a338-294717cd8426 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:50.526093 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-8d8388b2-d1e8-4bf9-a338-294717cd8426 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] [instance: 0402b684-55db-4c63-8142-de3fd0cc1503] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:50.540952 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-8d8388b2-d1e8-4bf9-a338-294717cd8426 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:50.542295 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-8d8388b2-d1e8-4bf9-a338-294717cd8426 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:50.543717 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-8d8388b2-d1e8-4bf9-a338-294717cd8426 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:50.545141 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-8d8388b2-d1e8-4bf9-a338-294717cd8426 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:50.546682 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-8d8388b2-d1e8-4bf9-a338-294717cd8426 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:50.547224 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-1693e3c8-2cac-4986-9d6b-5bbb40c91331 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2715cf2a5129439c83a5347bb963f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4159dc366f41bc9e4057a079f6fb5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:50.547778 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-8d8388b2-d1e8-4bf9-a338-294717cd8426 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:50.567517 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-1693e3c8-2cac-4986-9d6b-5bbb40c91331 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "GET /compute/v2.1/servers/e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311" status: 200 len: 1367 microversion: 2.1 time: 0.297260 Aug 24 11:32:50.567517 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 116/248] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:50 2022] GET /compute/v2.1/servers/e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311 => generated 1367 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:32:50.570479 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-ca5f63f6-8bd1-4f47-8978-b582f0fd99ec tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:50.571476 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-ca5f63f6-8bd1-4f47-8978-b582f0fd99ec tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] [instance: 07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:50.601410 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ca5f63f6-8bd1-4f47-8978-b582f0fd99ec tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:50.602484 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ca5f63f6-8bd1-4f47-8978-b582f0fd99ec tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:50.606434 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ca5f63f6-8bd1-4f47-8978-b582f0fd99ec tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:50.606434 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ca5f63f6-8bd1-4f47-8978-b582f0fd99ec tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:50.606434 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ca5f63f6-8bd1-4f47-8978-b582f0fd99ec tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:50.606434 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ca5f63f6-8bd1-4f47-8978-b582f0fd99ec tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:50.668159 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-8d8388b2-d1e8-4bf9-a338-294717cd8426 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5055ddeab8314c93bb2a664f9d1a7f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f910065fc9da40798c7f3d4366dab7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:50.699478 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-8d8388b2-d1e8-4bf9-a338-294717cd8426 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] 10.222.0.84 "GET /compute/v2.1/servers/0402b684-55db-4c63-8142-de3fd0cc1503" status: 200 len: 1215 microversion: 2.1 time: 0.189655 Aug 24 11:32:50.700282 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 133/249] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:50 2022] GET /compute/v2.1/servers/0402b684-55db-4c63-8142-de3fd0cc1503 => generated 1215 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:50.766145 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-0a313a47-7430-4705-889f-6a2a4cbc41e4 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:50.767320 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-0a313a47-7430-4705-889f-6a2a4cbc41e4 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] [instance: 15d4a46e-9504-4897-918d-39aafc20d22a] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:50.788476 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-0a313a47-7430-4705-889f-6a2a4cbc41e4 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:50.788476 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-0a313a47-7430-4705-889f-6a2a4cbc41e4 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:50.788476 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-0a313a47-7430-4705-889f-6a2a4cbc41e4 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:50.788476 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-0a313a47-7430-4705-889f-6a2a4cbc41e4 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:50.789493 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-0a313a47-7430-4705-889f-6a2a4cbc41e4 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:50.789493 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-0a313a47-7430-4705-889f-6a2a4cbc41e4 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:50.928943 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-ca5f63f6-8bd1-4f47-8978-b582f0fd99ec tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cef1a9e6a241ac8401b88f4a0f69fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901780013b03485a83261796f69e1b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:50.943298 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-ca5f63f6-8bd1-4f47-8978-b582f0fd99ec tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] 10.222.0.84 "GET /compute/v2.1/servers/07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0" status: 200 len: 1501 microversion: 2.1 time: 0.378293 Aug 24 11:32:50.944492 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 117/250] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:50 2022] GET /compute/v2.1/servers/07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0 => generated 1501 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:51.000430 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-bba99ba1-8307-427e-a96f-253f5f33a843 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:51.001599 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-bba99ba1-8307-427e-a96f-253f5f33a843 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: 2e661217-fb1a-48ad-9f1b-47985a4074de] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:51.021654 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-bba99ba1-8307-427e-a96f-253f5f33a843 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:51.022190 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-bba99ba1-8307-427e-a96f-253f5f33a843 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:51.022632 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-bba99ba1-8307-427e-a96f-253f5f33a843 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:51.023348 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-bba99ba1-8307-427e-a96f-253f5f33a843 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:51.023929 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-bba99ba1-8307-427e-a96f-253f5f33a843 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:51.033448 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-bba99ba1-8307-427e-a96f-253f5f33a843 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:51.083566 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_cell0:SELECT=2 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:51.150528 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-0a313a47-7430-4705-889f-6a2a4cbc41e4 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031939e16194f63b99e6f27f700fa8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecec6d0c155f4d658197c4779ab9ffce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:51.159700 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-0a313a47-7430-4705-889f-6a2a4cbc41e4 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] 10.222.0.84 "GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a" status: 200 len: 1363 microversion: 2.1 time: 0.401994 Aug 24 11:32:51.160284 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 134/251] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:50 2022] GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a => generated 1363 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:32:51.321733 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-bba99ba1-8307-427e-a96f-253f5f33a843 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:51.338293 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-bba99ba1-8307-427e-a96f-253f5f33a843 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:51.339755 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-bba99ba1-8307-427e-a96f-253f5f33a843 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:51.340940 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-bba99ba1-8307-427e-a96f-253f5f33a843 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de" status: 200 len: 1408 microversion: 2.20 time: 0.366913 Aug 24 11:32:51.342136 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 118/252] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:32:50 2022] GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de => generated 1408 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 11:32:51.535010 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-90fba86f-f426-4ba4-8d6b-eb07b1500e32 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:51.535988 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-90fba86f-f426-4ba4-8d6b-eb07b1500e32 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: 2d4527c9-c18c-4028-a452-d23423d9c4ee] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:51.550873 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-90fba86f-f426-4ba4-8d6b-eb07b1500e32 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:51.554529 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-90fba86f-f426-4ba4-8d6b-eb07b1500e32 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:51.554529 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-90fba86f-f426-4ba4-8d6b-eb07b1500e32 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:51.554529 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-90fba86f-f426-4ba4-8d6b-eb07b1500e32 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:51.554529 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-90fba86f-f426-4ba4-8d6b-eb07b1500e32 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:51.555138 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-90fba86f-f426-4ba4-8d6b-eb07b1500e32 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:51.592422 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-5a151e4e-a3b1-4121-ab93-77893e5da98f tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:51.593810 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-5a151e4e-a3b1-4121-ab93-77893e5da98f tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:51.603827 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5a151e4e-a3b1-4121-ab93-77893e5da98f tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:51.604504 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5a151e4e-a3b1-4121-ab93-77893e5da98f tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:51.605141 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5a151e4e-a3b1-4121-ab93-77893e5da98f tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:51.606015 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5a151e4e-a3b1-4121-ab93-77893e5da98f tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:51.606792 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5a151e4e-a3b1-4121-ab93-77893e5da98f tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:51.607493 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5a151e4e-a3b1-4121-ab93-77893e5da98f tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:51.826343 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-90fba86f-f426-4ba4-8d6b-eb07b1500e32 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:51.852188 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-90fba86f-f426-4ba4-8d6b-eb07b1500e32 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee" status: 200 len: 1515 microversion: 2.1 time: 0.321369 Aug 24 11:32:51.853457 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 135/253] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:51 2022] GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee => generated 1515 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:51.868575 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-6bd1b5f8-3bbf-4b7b-8b77-6bacc16c0e3b tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:51.871855 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-6bd1b5f8-3bbf-4b7b-8b77-6bacc16c0e3b tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] [instance: 0402b684-55db-4c63-8142-de3fd0cc1503] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:51.897588 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG dbcounter [-] [124769] Writing DB stats nova_api:SELECT=100 {{(pid=124769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:51.902225 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-6bd1b5f8-3bbf-4b7b-8b77-6bacc16c0e3b tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:51.902690 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-6bd1b5f8-3bbf-4b7b-8b77-6bacc16c0e3b tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:51.908334 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-6bd1b5f8-3bbf-4b7b-8b77-6bacc16c0e3b tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:51.909622 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-6bd1b5f8-3bbf-4b7b-8b77-6bacc16c0e3b tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:51.910432 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-6bd1b5f8-3bbf-4b7b-8b77-6bacc16c0e3b tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:51.919256 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-6bd1b5f8-3bbf-4b7b-8b77-6bacc16c0e3b tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:52.009692 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-5a151e4e-a3b1-4121-ab93-77893e5da98f tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2715cf2a5129439c83a5347bb963f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4159dc366f41bc9e4057a079f6fb5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:52.050959 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-5a151e4e-a3b1-4121-ab93-77893e5da98f tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "GET /compute/v2.1/servers/e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311" status: 200 len: 1367 microversion: 2.1 time: 0.462940 Aug 24 11:32:52.059437 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 119/254] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:51 2022] GET /compute/v2.1/servers/e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311 => generated 1367 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:52.099918 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-81c22e23-8e2c-4922-b1a6-6b2c4a8e251f tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:32:52.113467 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-81c22e23-8e2c-4922-b1a6-6b2c4a8e251f tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: 2d4527c9-c18c-4028-a452-d23423d9c4ee] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:52.144084 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-6bd1b5f8-3bbf-4b7b-8b77-6bacc16c0e3b tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5055ddeab8314c93bb2a664f9d1a7f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f910065fc9da40798c7f3d4366dab7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:52.144950 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-81c22e23-8e2c-4922-b1a6-6b2c4a8e251f tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:52.155250 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-81c22e23-8e2c-4922-b1a6-6b2c4a8e251f tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:52.157928 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-6bd1b5f8-3bbf-4b7b-8b77-6bacc16c0e3b tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] 10.222.0.84 "GET /compute/v2.1/servers/0402b684-55db-4c63-8142-de3fd0cc1503" status: 200 len: 1215 microversion: 2.1 time: 0.303092 Aug 24 11:32:52.158316 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-81c22e23-8e2c-4922-b1a6-6b2c4a8e251f tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:52.159542 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-81c22e23-8e2c-4922-b1a6-6b2c4a8e251f tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:52.160066 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 136/255] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:51 2022] GET /compute/v2.1/servers/0402b684-55db-4c63-8142-de3fd0cc1503 => generated 1215 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:52.160253 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-81c22e23-8e2c-4922-b1a6-6b2c4a8e251f tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:52.161038 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-81c22e23-8e2c-4922-b1a6-6b2c4a8e251f tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:52.191353 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-2aa78c40-f227-44e7-94c7-3da997d22033 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:52.192424 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-2aa78c40-f227-44e7-94c7-3da997d22033 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] [instance: 15d4a46e-9504-4897-918d-39aafc20d22a] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:52.199994 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-2aa78c40-f227-44e7-94c7-3da997d22033 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:52.200466 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-2aa78c40-f227-44e7-94c7-3da997d22033 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:52.200934 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-2aa78c40-f227-44e7-94c7-3da997d22033 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:52.208032 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-2aa78c40-f227-44e7-94c7-3da997d22033 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:52.208032 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-2aa78c40-f227-44e7-94c7-3da997d22033 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:52.208032 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-2aa78c40-f227-44e7-94c7-3da997d22033 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:52.226925 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG dbcounter [-] [124769] Writing DB stats nova_cell1:SELECT=100 {{(pid=124769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:52.261391 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_cell1:SELECT=100 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:52.281617 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.objects.instance [None req-81c22e23-8e2c-4922-b1a6-6b2c4a8e251f tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lazy-loading 'flavor' on Instance uuid 2d4527c9-c18c-4028-a452-d23423d9c4ee {{(pid=124770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:32:52.477084 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-2aa78c40-f227-44e7-94c7-3da997d22033 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031939e16194f63b99e6f27f700fa8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecec6d0c155f4d658197c4779ab9ffce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:52.486988 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-2aa78c40-f227-44e7-94c7-3da997d22033 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] 10.222.0.84 "GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a" status: 200 len: 1363 microversion: 2.1 time: 0.305309 Aug 24 11:32:52.487688 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 137/256] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:52 2022] GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a => generated 1363 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:52.492743 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-ff602fc3-de48-45c2-bcbb-74165bed1401 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:52.493378 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-ff602fc3-de48-45c2-bcbb-74165bed1401 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: 2e661217-fb1a-48ad-9f1b-47985a4074de] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:52.503958 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-ff602fc3-de48-45c2-bcbb-74165bed1401 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:52.505038 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-ff602fc3-de48-45c2-bcbb-74165bed1401 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:52.505641 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-ff602fc3-de48-45c2-bcbb-74165bed1401 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:52.506543 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-ff602fc3-de48-45c2-bcbb-74165bed1401 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:52.507146 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-ff602fc3-de48-45c2-bcbb-74165bed1401 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:52.507751 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-ff602fc3-de48-45c2-bcbb-74165bed1401 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:52.768949 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-ff602fc3-de48-45c2-bcbb-74165bed1401 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:52.781966 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-ff602fc3-de48-45c2-bcbb-74165bed1401 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:52.784405 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-ff602fc3-de48-45c2-bcbb-74165bed1401 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:52.786083 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-ff602fc3-de48-45c2-bcbb-74165bed1401 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de" status: 200 len: 1408 microversion: 2.20 time: 0.296930 Aug 24 11:32:52.787092 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 138/257] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:32:52 2022] GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de => generated 1408 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:32:52.868416 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-81c22e23-8e2c-4922-b1a6-6b2c4a8e251f tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "POST /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee/action" status: 200 len: 32 microversion: 2.1 time: 0.803577 Aug 24 11:32:52.873362 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 120/258] 10.222.0.84 () {60 vars in 1278 bytes} [Wed Aug 24 11:32:52 2022] POST /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee/action => generated 32 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 11:32:52.883810 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-fa11ab9f-1ae2-4ff1-b624-4b1d5b446669 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:52.884697 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-fa11ab9f-1ae2-4ff1-b624-4b1d5b446669 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: 2d4527c9-c18c-4028-a452-d23423d9c4ee] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:52.893967 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-fa11ab9f-1ae2-4ff1-b624-4b1d5b446669 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:52.895058 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-fa11ab9f-1ae2-4ff1-b624-4b1d5b446669 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:52.895767 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-fa11ab9f-1ae2-4ff1-b624-4b1d5b446669 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:52.896635 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-fa11ab9f-1ae2-4ff1-b624-4b1d5b446669 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:52.897263 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-fa11ab9f-1ae2-4ff1-b624-4b1d5b446669 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:52.897893 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-fa11ab9f-1ae2-4ff1-b624-4b1d5b446669 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:53.104612 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-19aa778c-9874-4c75-be73-c311e98a02f8 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:53.106120 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-19aa778c-9874-4c75-be73-c311e98a02f8 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:53.119989 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-19aa778c-9874-4c75-be73-c311e98a02f8 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:53.121008 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-19aa778c-9874-4c75-be73-c311e98a02f8 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:53.121899 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-19aa778c-9874-4c75-be73-c311e98a02f8 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:53.123288 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-19aa778c-9874-4c75-be73-c311e98a02f8 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:53.124810 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-19aa778c-9874-4c75-be73-c311e98a02f8 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:53.125741 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-19aa778c-9874-4c75-be73-c311e98a02f8 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:53.240982 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_cell0:SELECT=10 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:53.398869 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-fa11ab9f-1ae2-4ff1-b624-4b1d5b446669 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:53.402991 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-19aa778c-9874-4c75-be73-c311e98a02f8 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2715cf2a5129439c83a5347bb963f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4159dc366f41bc9e4057a079f6fb5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:53.431104 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-fa11ab9f-1ae2-4ff1-b624-4b1d5b446669 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee" status: 200 len: 1521 microversion: 2.1 time: 0.551040 Aug 24 11:32:53.431992 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 139/259] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:52 2022] GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee => generated 1521 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:32:53.434703 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-19aa778c-9874-4c75-be73-c311e98a02f8 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "GET /compute/v2.1/servers/e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311" status: 200 len: 1367 microversion: 2.1 time: 0.338624 Aug 24 11:32:53.436232 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 121/260] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:53 2022] GET /compute/v2.1/servers/e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311 => generated 1367 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:53.444097 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-c805f54a-5424-44d8-a31f-576df2cef5d7 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:53.445068 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-c805f54a-5424-44d8-a31f-576df2cef5d7 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] [instance: 0402b684-55db-4c63-8142-de3fd0cc1503] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:53.458615 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c805f54a-5424-44d8-a31f-576df2cef5d7 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:53.462744 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c805f54a-5424-44d8-a31f-576df2cef5d7 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:53.463494 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c805f54a-5424-44d8-a31f-576df2cef5d7 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:53.464443 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c805f54a-5424-44d8-a31f-576df2cef5d7 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:53.471228 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c805f54a-5424-44d8-a31f-576df2cef5d7 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:53.471228 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c805f54a-5424-44d8-a31f-576df2cef5d7 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:53.524100 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-32372ab7-42e1-4e6e-8fa6-aa031c4ac759 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:53.524844 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-32372ab7-42e1-4e6e-8fa6-aa031c4ac759 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] [instance: 15d4a46e-9504-4897-918d-39aafc20d22a] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:53.533234 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-32372ab7-42e1-4e6e-8fa6-aa031c4ac759 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:53.533990 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-32372ab7-42e1-4e6e-8fa6-aa031c4ac759 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:53.540021 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-32372ab7-42e1-4e6e-8fa6-aa031c4ac759 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:53.540021 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-32372ab7-42e1-4e6e-8fa6-aa031c4ac759 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:53.540021 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-32372ab7-42e1-4e6e-8fa6-aa031c4ac759 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:53.540021 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-32372ab7-42e1-4e6e-8fa6-aa031c4ac759 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:53.626825 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-c805f54a-5424-44d8-a31f-576df2cef5d7 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5055ddeab8314c93bb2a664f9d1a7f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f910065fc9da40798c7f3d4366dab7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:53.642707 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-c805f54a-5424-44d8-a31f-576df2cef5d7 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] 10.222.0.84 "GET /compute/v2.1/servers/0402b684-55db-4c63-8142-de3fd0cc1503" status: 200 len: 1215 microversion: 2.1 time: 0.204147 Aug 24 11:32:53.657429 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 122/261] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:53 2022] GET /compute/v2.1/servers/0402b684-55db-4c63-8142-de3fd0cc1503 => generated 1215 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:53.759074 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-32372ab7-42e1-4e6e-8fa6-aa031c4ac759 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031939e16194f63b99e6f27f700fa8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecec6d0c155f4d658197c4779ab9ffce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:53.771514 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-32372ab7-42e1-4e6e-8fa6-aa031c4ac759 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] 10.222.0.84 "GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a" status: 200 len: 1363 microversion: 2.1 time: 0.253039 Aug 24 11:32:53.772753 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 140/262] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:53 2022] GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a => generated 1363 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:32:53.838417 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-6bb2d712-d1cd-42f6-aafa-ac97fa348ed8 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:53.839129 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-6bb2d712-d1cd-42f6-aafa-ac97fa348ed8 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: 2e661217-fb1a-48ad-9f1b-47985a4074de] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:53.845628 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6bb2d712-d1cd-42f6-aafa-ac97fa348ed8 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:53.846147 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6bb2d712-d1cd-42f6-aafa-ac97fa348ed8 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:53.846618 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6bb2d712-d1cd-42f6-aafa-ac97fa348ed8 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:53.847344 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6bb2d712-d1cd-42f6-aafa-ac97fa348ed8 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:53.847886 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6bb2d712-d1cd-42f6-aafa-ac97fa348ed8 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:53.848429 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6bb2d712-d1cd-42f6-aafa-ac97fa348ed8 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:54.080023 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-6bb2d712-d1cd-42f6-aafa-ac97fa348ed8 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:54.089044 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-6bb2d712-d1cd-42f6-aafa-ac97fa348ed8 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:54.092310 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-6bb2d712-d1cd-42f6-aafa-ac97fa348ed8 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:54.092310 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-6bb2d712-d1cd-42f6-aafa-ac97fa348ed8 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de" status: 200 len: 1601 microversion: 2.20 time: 0.257398 Aug 24 11:32:54.092310 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 123/263] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:32:53 2022] GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de => generated 1601 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 11:32:54.136197 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-f622120a-b566-40be-bffa-15923603b21d tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:54.137075 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-f622120a-b566-40be-bffa-15923603b21d tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: 2e661217-fb1a-48ad-9f1b-47985a4074de] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:54.145074 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f622120a-b566-40be-bffa-15923603b21d tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:54.145562 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f622120a-b566-40be-bffa-15923603b21d tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:54.146227 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f622120a-b566-40be-bffa-15923603b21d tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:54.147241 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f622120a-b566-40be-bffa-15923603b21d tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:54.147866 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f622120a-b566-40be-bffa-15923603b21d tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:54.148452 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f622120a-b566-40be-bffa-15923603b21d tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:54.267295 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-8b36d621-94cf-4eed-9566-18b84047b1f6 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "89ea8d42-6bd2-4d72-9255-ea45328d006b"}} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:32:54.272127 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-8b36d621-94cf-4eed-9566-18b84047b1f6 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] [instance: 07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:54.285522 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8b36d621-94cf-4eed-9566-18b84047b1f6 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:54.286611 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8b36d621-94cf-4eed-9566-18b84047b1f6 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:54.287762 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8b36d621-94cf-4eed-9566-18b84047b1f6 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:54.290383 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8b36d621-94cf-4eed-9566-18b84047b1f6 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:54.291658 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8b36d621-94cf-4eed-9566-18b84047b1f6 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:54.292650 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8b36d621-94cf-4eed-9566-18b84047b1f6 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:54.406929 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-f622120a-b566-40be-bffa-15923603b21d tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.276230 Aug 24 11:32:54.406929 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 141/264] 10.222.0.84 () {60 vars in 1316 bytes} [Wed Aug 24 11:32:54 2022] GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de/os-interface => generated 285 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 11:32:54.467037 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-3bad1c5c-ac99-435c-aa56-80fd45e7655c tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:54.467689 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-3bad1c5c-ac99-435c-aa56-80fd45e7655c tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:54.477724 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-3bad1c5c-ac99-435c-aa56-80fd45e7655c tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:54.479452 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-3bad1c5c-ac99-435c-aa56-80fd45e7655c tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:54.479898 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-3bad1c5c-ac99-435c-aa56-80fd45e7655c tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:54.480612 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-3bad1c5c-ac99-435c-aa56-80fd45e7655c tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:54.486943 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-3bad1c5c-ac99-435c-aa56-80fd45e7655c tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:54.487512 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-3bad1c5c-ac99-435c-aa56-80fd45e7655c tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:54.850467 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-3bad1c5c-ac99-435c-aa56-80fd45e7655c tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2715cf2a5129439c83a5347bb963f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4159dc366f41bc9e4057a079f6fb5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:54.862851 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-3bad1c5c-ac99-435c-aa56-80fd45e7655c tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "GET /compute/v2.1/servers/e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311" status: 200 len: 1367 microversion: 2.1 time: 0.400332 Aug 24 11:32:54.864569 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 142/265] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:54 2022] GET /compute/v2.1/servers/e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311 => generated 1367 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:32:54.872207 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-230a34a1-0a78-4b39-860e-04c53a7c6451 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:54.873169 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-230a34a1-0a78-4b39-860e-04c53a7c6451 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: 2d4527c9-c18c-4028-a452-d23423d9c4ee] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:54.886023 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-230a34a1-0a78-4b39-860e-04c53a7c6451 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:54.886830 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-230a34a1-0a78-4b39-860e-04c53a7c6451 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:54.887595 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-230a34a1-0a78-4b39-860e-04c53a7c6451 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:54.889215 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-230a34a1-0a78-4b39-860e-04c53a7c6451 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:54.890868 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-230a34a1-0a78-4b39-860e-04c53a7c6451 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:54.891624 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-230a34a1-0a78-4b39-860e-04c53a7c6451 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:55.093457 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-230a34a1-0a78-4b39-860e-04c53a7c6451 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:55.101704 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-230a34a1-0a78-4b39-860e-04c53a7c6451 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee" status: 200 len: 1521 microversion: 2.1 time: 0.235828 Aug 24 11:32:55.116256 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 143/266] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:54 2022] GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee => generated 1521 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:55.120764 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-e2759245-734d-4b57-9d3d-4a15939a5794 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:55.121403 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-e2759245-734d-4b57-9d3d-4a15939a5794 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] [instance: 0402b684-55db-4c63-8142-de3fd0cc1503] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:55.131157 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-e2759245-734d-4b57-9d3d-4a15939a5794 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:55.131846 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-e2759245-734d-4b57-9d3d-4a15939a5794 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:55.132400 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-e2759245-734d-4b57-9d3d-4a15939a5794 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:55.133226 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-e2759245-734d-4b57-9d3d-4a15939a5794 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:55.134185 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-e2759245-734d-4b57-9d3d-4a15939a5794 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:55.134362 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-e2759245-734d-4b57-9d3d-4a15939a5794 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:55.258692 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-e2759245-734d-4b57-9d3d-4a15939a5794 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5055ddeab8314c93bb2a664f9d1a7f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f910065fc9da40798c7f3d4366dab7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:55.279100 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-e2759245-734d-4b57-9d3d-4a15939a5794 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] 10.222.0.84 "GET /compute/v2.1/servers/0402b684-55db-4c63-8142-de3fd0cc1503" status: 200 len: 1271 microversion: 2.1 time: 0.161708 Aug 24 11:32:55.297709 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 144/267] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:55 2022] GET /compute/v2.1/servers/0402b684-55db-4c63-8142-de3fd0cc1503 => generated 1271 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:55.303798 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-abdb9fea-9d95-457c-bb46-442912756be1 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:55.306042 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-abdb9fea-9d95-457c-bb46-442912756be1 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] [instance: 15d4a46e-9504-4897-918d-39aafc20d22a] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:55.321072 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-abdb9fea-9d95-457c-bb46-442912756be1 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:55.321902 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-abdb9fea-9d95-457c-bb46-442912756be1 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:55.322879 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-abdb9fea-9d95-457c-bb46-442912756be1 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:55.325001 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-abdb9fea-9d95-457c-bb46-442912756be1 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:55.326133 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-abdb9fea-9d95-457c-bb46-442912756be1 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:55.328283 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-abdb9fea-9d95-457c-bb46-442912756be1 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:55.614582 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-abdb9fea-9d95-457c-bb46-442912756be1 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031939e16194f63b99e6f27f700fa8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecec6d0c155f4d658197c4779ab9ffce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:55.628971 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-abdb9fea-9d95-457c-bb46-442912756be1 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] 10.222.0.84 "GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a" status: 200 len: 1363 microversion: 2.1 time: 0.335884 Aug 24 11:32:55.629647 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 145/268] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:55 2022] GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a => generated 1363 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:55.895519 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-8ad4dccc-b821-410d-89e2-5b71de6236f4 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:55.896578 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-8ad4dccc-b821-410d-89e2-5b71de6236f4 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:55.910012 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-8ad4dccc-b821-410d-89e2-5b71de6236f4 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:55.911522 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-8ad4dccc-b821-410d-89e2-5b71de6236f4 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:55.912652 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-8ad4dccc-b821-410d-89e2-5b71de6236f4 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:55.914008 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-8ad4dccc-b821-410d-89e2-5b71de6236f4 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:55.915071 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-8ad4dccc-b821-410d-89e2-5b71de6236f4 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:55.915842 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-8ad4dccc-b821-410d-89e2-5b71de6236f4 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:56.220979 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-8ad4dccc-b821-410d-89e2-5b71de6236f4 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2715cf2a5129439c83a5347bb963f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4159dc366f41bc9e4057a079f6fb5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:56.237591 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-8ad4dccc-b821-410d-89e2-5b71de6236f4 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "GET /compute/v2.1/servers/e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311" status: 200 len: 1367 microversion: 2.1 time: 0.348434 Aug 24 11:32:56.239484 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 146/269] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:55 2022] GET /compute/v2.1/servers/e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311 => generated 1367 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:56.249688 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-e2c22b3e-a21a-4c68-b9d6-ee760fcfd1c9 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:56.251497 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-e2c22b3e-a21a-4c68-b9d6-ee760fcfd1c9 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: 2d4527c9-c18c-4028-a452-d23423d9c4ee] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:56.263324 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-e2c22b3e-a21a-4c68-b9d6-ee760fcfd1c9 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:56.264497 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-e2c22b3e-a21a-4c68-b9d6-ee760fcfd1c9 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:56.265741 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-e2c22b3e-a21a-4c68-b9d6-ee760fcfd1c9 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:56.270150 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-e2c22b3e-a21a-4c68-b9d6-ee760fcfd1c9 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:56.270150 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-e2c22b3e-a21a-4c68-b9d6-ee760fcfd1c9 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:56.270150 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-e2c22b3e-a21a-4c68-b9d6-ee760fcfd1c9 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:56.479793 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-e2c22b3e-a21a-4c68-b9d6-ee760fcfd1c9 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:56.489000 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-e2c22b3e-a21a-4c68-b9d6-ee760fcfd1c9 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee" status: 200 len: 1521 microversion: 2.1 time: 0.247407 Aug 24 11:32:56.489944 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 147/270] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:56 2022] GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee => generated 1521 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:56.508787 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-1d7247cf-1dc6-44a8-9715-f002ca772714 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:56.509983 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-1d7247cf-1dc6-44a8-9715-f002ca772714 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] [instance: 0402b684-55db-4c63-8142-de3fd0cc1503] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:56.522874 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-1d7247cf-1dc6-44a8-9715-f002ca772714 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:56.522874 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-1d7247cf-1dc6-44a8-9715-f002ca772714 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:56.522874 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-1d7247cf-1dc6-44a8-9715-f002ca772714 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:56.523630 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-1d7247cf-1dc6-44a8-9715-f002ca772714 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:56.524586 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-1d7247cf-1dc6-44a8-9715-f002ca772714 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:56.525414 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-1d7247cf-1dc6-44a8-9715-f002ca772714 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:56.639698 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-1d7247cf-1dc6-44a8-9715-f002ca772714 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5055ddeab8314c93bb2a664f9d1a7f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f910065fc9da40798c7f3d4366dab7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:56.648939 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-1d7247cf-1dc6-44a8-9715-f002ca772714 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] 10.222.0.84 "GET /compute/v2.1/servers/0402b684-55db-4c63-8142-de3fd0cc1503" status: 200 len: 1271 microversion: 2.1 time: 0.158091 Aug 24 11:32:56.662066 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 148/271] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:56 2022] GET /compute/v2.1/servers/0402b684-55db-4c63-8142-de3fd0cc1503 => generated 1271 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:56.684199 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-9a79089d-9efc-485b-bea4-7203a2ed507d tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:56.685436 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-9a79089d-9efc-485b-bea4-7203a2ed507d tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] [instance: 15d4a46e-9504-4897-918d-39aafc20d22a] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:56.696693 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-9a79089d-9efc-485b-bea4-7203a2ed507d tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:56.697998 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-9a79089d-9efc-485b-bea4-7203a2ed507d tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:56.698819 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-9a79089d-9efc-485b-bea4-7203a2ed507d tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:56.700350 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-9a79089d-9efc-485b-bea4-7203a2ed507d tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:56.701429 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-9a79089d-9efc-485b-bea4-7203a2ed507d tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:56.702455 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-9a79089d-9efc-485b-bea4-7203a2ed507d tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:56.977323 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-9a79089d-9efc-485b-bea4-7203a2ed507d tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031939e16194f63b99e6f27f700fa8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecec6d0c155f4d658197c4779ab9ffce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:57.029037 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-9a79089d-9efc-485b-bea4-7203a2ed507d tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] 10.222.0.84 "GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a" status: 200 len: 1363 microversion: 2.1 time: 0.359466 Aug 24 11:32:57.038415 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 149/272] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:56 2022] GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a => generated 1363 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:57.064034 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [req-2ec0658f-deee-44c6-9fdd-8541abd83357 req-69b07fd1-cd9b-40d3-8249-9a89ddd0a3b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e661217-fb1a-48ad-9f1b-47985a4074de", "tag": "e82d60e7-8369-4554-9da0-a0a3a25fe586"}]} {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:32:57.083421 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [req-2ec0658f-deee-44c6-9fdd-8541abd83357 req-69b07fd1-cd9b-40d3-8249-9a89ddd0a3b7 service nova] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:57.084305 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [req-2ec0658f-deee-44c6-9fdd-8541abd83357 req-69b07fd1-cd9b-40d3-8249-9a89ddd0a3b7 service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:57.085157 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [req-2ec0658f-deee-44c6-9fdd-8541abd83357 req-69b07fd1-cd9b-40d3-8249-9a89ddd0a3b7 service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:57.109784 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.compute.server_external_events [req-2ec0658f-deee-44c6-9fdd-8541abd83357 req-69b07fd1-cd9b-40d3-8249-9a89ddd0a3b7 service nova] Creating event network-changed:e82d60e7-8369-4554-9da0-a0a3a25fe586 for instance 2e661217-fb1a-48ad-9f1b-47985a4074de on hv-cinder-85427 Aug 24 11:32:57.135967 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [req-2ec0658f-deee-44c6-9fdd-8541abd83357 req-69b07fd1-cd9b-40d3-8249-9a89ddd0a3b7 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095438 Aug 24 11:32:57.137447 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 150/273] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Aug 24 11:32:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:32:57.279142 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-87a4d63d-b4e4-45f7-81a9-61061964daa1 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:57.281119 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-87a4d63d-b4e4-45f7-81a9-61061964daa1 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:57.288371 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-87a4d63d-b4e4-45f7-81a9-61061964daa1 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:57.288964 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-87a4d63d-b4e4-45f7-81a9-61061964daa1 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:57.289413 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-87a4d63d-b4e4-45f7-81a9-61061964daa1 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:57.291753 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-87a4d63d-b4e4-45f7-81a9-61061964daa1 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:57.291753 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-87a4d63d-b4e4-45f7-81a9-61061964daa1 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:57.291753 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-87a4d63d-b4e4-45f7-81a9-61061964daa1 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:57.567862 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-87a4d63d-b4e4-45f7-81a9-61061964daa1 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2715cf2a5129439c83a5347bb963f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4159dc366f41bc9e4057a079f6fb5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:57.579015 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-87a4d63d-b4e4-45f7-81a9-61061964daa1 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "GET /compute/v2.1/servers/e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311" status: 200 len: 1557 microversion: 2.1 time: 0.306724 Aug 24 11:32:57.590437 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 151/274] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:57 2022] GET /compute/v2.1/servers/e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311 => generated 1557 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:57.606751 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-a8ffcef2-8575-48dc-ae36-386eeb609a32 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:57.607791 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-a8ffcef2-8575-48dc-ae36-386eeb609a32 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: 2d4527c9-c18c-4028-a452-d23423d9c4ee] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:57.628284 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-a8ffcef2-8575-48dc-ae36-386eeb609a32 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:57.628670 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-a8ffcef2-8575-48dc-ae36-386eeb609a32 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:57.629144 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-a8ffcef2-8575-48dc-ae36-386eeb609a32 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:57.629842 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-a8ffcef2-8575-48dc-ae36-386eeb609a32 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:57.630295 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-a8ffcef2-8575-48dc-ae36-386eeb609a32 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:57.630706 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-a8ffcef2-8575-48dc-ae36-386eeb609a32 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:57.826432 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-a8ffcef2-8575-48dc-ae36-386eeb609a32 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:57.842042 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-a8ffcef2-8575-48dc-ae36-386eeb609a32 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee" status: 200 len: 1521 microversion: 2.1 time: 0.250318 Aug 24 11:32:57.843120 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 152/275] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:57 2022] GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee => generated 1521 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:57.855138 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-62922107-956c-470e-8f8c-ae4b42537de1 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:57.855830 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-62922107-956c-470e-8f8c-ae4b42537de1 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:57.866105 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-62922107-956c-470e-8f8c-ae4b42537de1 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:57.866809 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-62922107-956c-470e-8f8c-ae4b42537de1 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:57.867597 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-62922107-956c-470e-8f8c-ae4b42537de1 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:57.868883 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-62922107-956c-470e-8f8c-ae4b42537de1 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:57.869976 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-62922107-956c-470e-8f8c-ae4b42537de1 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:57.870750 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-62922107-956c-470e-8f8c-ae4b42537de1 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:58.010074 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-62922107-956c-470e-8f8c-ae4b42537de1 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "GET /compute/v2.1/servers/e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.158930 Aug 24 11:32:58.011109 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 153/276] 10.222.0.84 () {58 vars in 1275 bytes} [Wed Aug 24 11:32:57 2022] GET /compute/v2.1/servers/e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311/os-interface => generated 284 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:32:58.019835 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-c5b0ea8e-ee7f-473e-a58a-7d5175f64eea tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:58.020511 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-c5b0ea8e-ee7f-473e-a58a-7d5175f64eea tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] [instance: 0402b684-55db-4c63-8142-de3fd0cc1503] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:58.030588 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-c5b0ea8e-ee7f-473e-a58a-7d5175f64eea tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:58.032166 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-c5b0ea8e-ee7f-473e-a58a-7d5175f64eea tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:58.032166 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-c5b0ea8e-ee7f-473e-a58a-7d5175f64eea tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:58.033054 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-c5b0ea8e-ee7f-473e-a58a-7d5175f64eea tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:58.033734 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-c5b0ea8e-ee7f-473e-a58a-7d5175f64eea tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:58.034359 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-c5b0ea8e-ee7f-473e-a58a-7d5175f64eea tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:58.067994 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-8b36d621-94cf-4eed-9566-18b84047b1f6 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] 10.222.0.84 "POST /compute/v2.1/servers/07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.808005 Aug 24 11:32:58.069037 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 124/277] 10.222.0.84 () {60 vars in 1323 bytes} [Wed Aug 24 11:32:54 2022] POST /compute/v2.1/servers/07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0/os-volume_attachments => generated 194 bytes in 3810 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:32:58.073864 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-6268e12b-9188-4996-bbd4-a3d379757a73 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:58.078378 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-6268e12b-9188-4996-bbd4-a3d379757a73 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] [instance: 15d4a46e-9504-4897-918d-39aafc20d22a] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:58.095960 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6268e12b-9188-4996-bbd4-a3d379757a73 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:58.096461 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6268e12b-9188-4996-bbd4-a3d379757a73 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:58.096945 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6268e12b-9188-4996-bbd4-a3d379757a73 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:58.101937 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6268e12b-9188-4996-bbd4-a3d379757a73 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:58.101937 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6268e12b-9188-4996-bbd4-a3d379757a73 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:58.101937 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6268e12b-9188-4996-bbd4-a3d379757a73 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:58.212506 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-c5b0ea8e-ee7f-473e-a58a-7d5175f64eea tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5055ddeab8314c93bb2a664f9d1a7f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f910065fc9da40798c7f3d4366dab7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:58.244013 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-c5b0ea8e-ee7f-473e-a58a-7d5175f64eea tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] 10.222.0.84 "GET /compute/v2.1/servers/0402b684-55db-4c63-8142-de3fd0cc1503" status: 200 len: 1289 microversion: 2.1 time: 0.219904 Aug 24 11:32:58.245469 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 154/278] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:58 2022] GET /compute/v2.1/servers/0402b684-55db-4c63-8142-de3fd0cc1503 => generated 1289 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:58.889363 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-f1e4c2ce-b238-4846-9d12-ac9f9586b820 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:58.890385 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-f1e4c2ce-b238-4846-9d12-ac9f9586b820 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: 2d4527c9-c18c-4028-a452-d23423d9c4ee] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:58.900973 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f1e4c2ce-b238-4846-9d12-ac9f9586b820 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:58.902101 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f1e4c2ce-b238-4846-9d12-ac9f9586b820 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:58.903065 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f1e4c2ce-b238-4846-9d12-ac9f9586b820 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:58.904674 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f1e4c2ce-b238-4846-9d12-ac9f9586b820 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:58.905800 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f1e4c2ce-b238-4846-9d12-ac9f9586b820 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:58.906765 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f1e4c2ce-b238-4846-9d12-ac9f9586b820 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:58.957550 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG dbcounter [-] [124769] Writing DB stats nova_cell1:SELECT=100 {{(pid=124769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:59.086187 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-6268e12b-9188-4996-bbd4-a3d379757a73 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031939e16194f63b99e6f27f700fa8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecec6d0c155f4d658197c4779ab9ffce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:59.117568 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-6268e12b-9188-4996-bbd4-a3d379757a73 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] 10.222.0.84 "GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a" status: 200 len: 1363 microversion: 2.1 time: 1.046404 Aug 24 11:32:59.119767 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 125/279] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:58 2022] GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a => generated 1363 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:59.226108 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-f1e4c2ce-b238-4846-9d12-ac9f9586b820 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:59.244320 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-f1e4c2ce-b238-4846-9d12-ac9f9586b820 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee" status: 200 len: 1521 microversion: 2.1 time: 0.370781 Aug 24 11:32:59.274935 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 155/280] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:58 2022] GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee => generated 1521 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:59.290802 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-bd4dd7b4-1606-4d90-9aae-d5041598aabe tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:59.300511 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-bd4dd7b4-1606-4d90-9aae-d5041598aabe tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] [instance: 0402b684-55db-4c63-8142-de3fd0cc1503] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:59.320335 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-bd4dd7b4-1606-4d90-9aae-d5041598aabe tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:59.322062 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-bd4dd7b4-1606-4d90-9aae-d5041598aabe tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:59.322583 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-bd4dd7b4-1606-4d90-9aae-d5041598aabe tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:59.323373 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-bd4dd7b4-1606-4d90-9aae-d5041598aabe tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:59.323928 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-bd4dd7b4-1606-4d90-9aae-d5041598aabe tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:59.324237 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-bd4dd7b4-1606-4d90-9aae-d5041598aabe tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:59.554687 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-bd4dd7b4-1606-4d90-9aae-d5041598aabe tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5055ddeab8314c93bb2a664f9d1a7f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f910065fc9da40798c7f3d4366dab7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:59.579129 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-bd4dd7b4-1606-4d90-9aae-d5041598aabe tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] 10.222.0.84 "GET /compute/v2.1/servers/0402b684-55db-4c63-8142-de3fd0cc1503" status: 200 len: 1277 microversion: 2.1 time: 0.297710 Aug 24 11:32:59.581914 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 126/281] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:59 2022] GET /compute/v2.1/servers/0402b684-55db-4c63-8142-de3fd0cc1503 => generated 1277 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:33:00.149310 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-c52e7fa9-6c86-49a9-b284-f54f45a2ba22 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:00.149310 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-c52e7fa9-6c86-49a9-b284-f54f45a2ba22 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] [instance: 15d4a46e-9504-4897-918d-39aafc20d22a] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:00.156146 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-c52e7fa9-6c86-49a9-b284-f54f45a2ba22 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:00.156919 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-c52e7fa9-6c86-49a9-b284-f54f45a2ba22 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:00.157963 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-c52e7fa9-6c86-49a9-b284-f54f45a2ba22 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:00.159131 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-c52e7fa9-6c86-49a9-b284-f54f45a2ba22 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:00.159870 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-c52e7fa9-6c86-49a9-b284-f54f45a2ba22 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:00.160621 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-c52e7fa9-6c86-49a9-b284-f54f45a2ba22 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:00.303401 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-883f4fe5-f8bf-49dc-ae95-90ce657857d3 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:00.304362 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-883f4fe5-f8bf-49dc-ae95-90ce657857d3 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: 2d4527c9-c18c-4028-a452-d23423d9c4ee] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:00.318307 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-883f4fe5-f8bf-49dc-ae95-90ce657857d3 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:00.319454 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-883f4fe5-f8bf-49dc-ae95-90ce657857d3 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:00.320463 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-883f4fe5-f8bf-49dc-ae95-90ce657857d3 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:00.328697 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-883f4fe5-f8bf-49dc-ae95-90ce657857d3 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:00.328697 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-883f4fe5-f8bf-49dc-ae95-90ce657857d3 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:00.329519 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-883f4fe5-f8bf-49dc-ae95-90ce657857d3 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:00.388779 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-c52e7fa9-6c86-49a9-b284-f54f45a2ba22 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031939e16194f63b99e6f27f700fa8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecec6d0c155f4d658197c4779ab9ffce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:00.398652 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-c52e7fa9-6c86-49a9-b284-f54f45a2ba22 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] 10.222.0.84 "GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a" status: 200 len: 1363 microversion: 2.1 time: 0.260748 Aug 24 11:33:00.399619 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 156/282] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:00 2022] GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a => generated 1363 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:33:00.613277 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-6c3181ad-d257-414b-8eec-d2cf43ee8327 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:00.614232 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-6c3181ad-d257-414b-8eec-d2cf43ee8327 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] [instance: 0402b684-55db-4c63-8142-de3fd0cc1503] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:00.626424 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-6c3181ad-d257-414b-8eec-d2cf43ee8327 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:00.627273 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-6c3181ad-d257-414b-8eec-d2cf43ee8327 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:00.628517 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-6c3181ad-d257-414b-8eec-d2cf43ee8327 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:00.630405 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-6c3181ad-d257-414b-8eec-d2cf43ee8327 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:00.631450 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-6c3181ad-d257-414b-8eec-d2cf43ee8327 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:00.633286 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-6c3181ad-d257-414b-8eec-d2cf43ee8327 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:00.770963 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-883f4fe5-f8bf-49dc-ae95-90ce657857d3 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:00.787459 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-883f4fe5-f8bf-49dc-ae95-90ce657857d3 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee" status: 200 len: 1521 microversion: 2.1 time: 0.491889 Aug 24 11:33:00.788874 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 127/283] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:00 2022] GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee => generated 1521 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:33:00.880651 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-6c3181ad-d257-414b-8eec-d2cf43ee8327 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5055ddeab8314c93bb2a664f9d1a7f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f910065fc9da40798c7f3d4366dab7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:00.895903 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-6c3181ad-d257-414b-8eec-d2cf43ee8327 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] 10.222.0.84 "GET /compute/v2.1/servers/0402b684-55db-4c63-8142-de3fd0cc1503" status: 200 len: 1319 microversion: 2.1 time: 0.291844 Aug 24 11:33:00.896968 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 157/284] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:00 2022] GET /compute/v2.1/servers/0402b684-55db-4c63-8142-de3fd0cc1503 => generated 1319 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:33:01.060423 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [req-7ce1e431-ca42-41a5-a1b7-1b32964a36c8 req-8b908608-dddc-44bd-95f9-6bfc7a7a6873 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311", "tag": "d810e173-346a-4d91-84f8-11fc2af8528a"}]} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:33:01.075998 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-7ce1e431-ca42-41a5-a1b7-1b32964a36c8 req-8b908608-dddc-44bd-95f9-6bfc7a7a6873 service nova] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:01.077315 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-7ce1e431-ca42-41a5-a1b7-1b32964a36c8 req-8b908608-dddc-44bd-95f9-6bfc7a7a6873 service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:01.078472 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-7ce1e431-ca42-41a5-a1b7-1b32964a36c8 req-8b908608-dddc-44bd-95f9-6bfc7a7a6873 service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:01.092181 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.compute.server_external_events [req-7ce1e431-ca42-41a5-a1b7-1b32964a36c8 req-8b908608-dddc-44bd-95f9-6bfc7a7a6873 service nova] Creating event network-changed:d810e173-346a-4d91-84f8-11fc2af8528a for instance e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311 on hv-cinder-85427 Aug 24 11:33:01.099537 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [req-7ce1e431-ca42-41a5-a1b7-1b32964a36c8 req-8b908608-dddc-44bd-95f9-6bfc7a7a6873 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049567 Aug 24 11:33:01.102180 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 128/285] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Aug 24 11:33:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:33:01.443029 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-a9b59b1f-5115-41b3-ae44-0ed39b4b6833 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:01.445724 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-a9b59b1f-5115-41b3-ae44-0ed39b4b6833 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] [instance: 15d4a46e-9504-4897-918d-39aafc20d22a] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:01.457898 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-a9b59b1f-5115-41b3-ae44-0ed39b4b6833 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:01.458606 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-a9b59b1f-5115-41b3-ae44-0ed39b4b6833 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:01.459514 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-a9b59b1f-5115-41b3-ae44-0ed39b4b6833 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:01.460694 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-a9b59b1f-5115-41b3-ae44-0ed39b4b6833 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:01.461468 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-a9b59b1f-5115-41b3-ae44-0ed39b4b6833 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:01.462417 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-a9b59b1f-5115-41b3-ae44-0ed39b4b6833 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:01.828909 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-12593f74-4a90-4e6d-b7c2-4964fff77658 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:01.831477 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-12593f74-4a90-4e6d-b7c2-4964fff77658 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: 2d4527c9-c18c-4028-a452-d23423d9c4ee] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:01.851859 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-12593f74-4a90-4e6d-b7c2-4964fff77658 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:01.853167 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-12593f74-4a90-4e6d-b7c2-4964fff77658 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:01.854774 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-12593f74-4a90-4e6d-b7c2-4964fff77658 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:01.857616 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-12593f74-4a90-4e6d-b7c2-4964fff77658 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:01.861860 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-12593f74-4a90-4e6d-b7c2-4964fff77658 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:01.863054 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-12593f74-4a90-4e6d-b7c2-4964fff77658 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:01.909880 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-a9b59b1f-5115-41b3-ae44-0ed39b4b6833 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031939e16194f63b99e6f27f700fa8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecec6d0c155f4d658197c4779ab9ffce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:01.948042 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-a9b59b1f-5115-41b3-ae44-0ed39b4b6833 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] 10.222.0.84 "GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a" status: 200 len: 1548 microversion: 2.1 time: 0.509525 Aug 24 11:33:01.949709 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 158/286] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:01 2022] GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a => generated 1548 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:33:01.973711 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-9dcd2489-27c0-464e-8120-ff0e5190a350 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:01.977016 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-9dcd2489-27c0-464e-8120-ff0e5190a350 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] [instance: 0402b684-55db-4c63-8142-de3fd0cc1503] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:01.993680 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-9dcd2489-27c0-464e-8120-ff0e5190a350 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:01.996096 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-9dcd2489-27c0-464e-8120-ff0e5190a350 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:01.997497 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-9dcd2489-27c0-464e-8120-ff0e5190a350 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:02.000419 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-9dcd2489-27c0-464e-8120-ff0e5190a350 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:02.001594 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-9dcd2489-27c0-464e-8120-ff0e5190a350 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:02.002717 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-9dcd2489-27c0-464e-8120-ff0e5190a350 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:02.330662 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-9dcd2489-27c0-464e-8120-ff0e5190a350 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5055ddeab8314c93bb2a664f9d1a7f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f910065fc9da40798c7f3d4366dab7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:02.347464 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-9dcd2489-27c0-464e-8120-ff0e5190a350 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] 10.222.0.84 "GET /compute/v2.1/servers/0402b684-55db-4c63-8142-de3fd0cc1503" status: 200 len: 1319 microversion: 2.1 time: 0.392725 Aug 24 11:33:02.348157 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 159/287] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:01 2022] GET /compute/v2.1/servers/0402b684-55db-4c63-8142-de3fd0cc1503 => generated 1319 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:33:02.362747 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-55cbfcfe-82db-4456-bf5e-3dd5f34a1399 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:02.382908 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-55cbfcfe-82db-4456-bf5e-3dd5f34a1399 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] [instance: 15d4a46e-9504-4897-918d-39aafc20d22a] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:02.391907 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-55cbfcfe-82db-4456-bf5e-3dd5f34a1399 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:02.397848 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-55cbfcfe-82db-4456-bf5e-3dd5f34a1399 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:02.397848 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-55cbfcfe-82db-4456-bf5e-3dd5f34a1399 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:02.397848 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-55cbfcfe-82db-4456-bf5e-3dd5f34a1399 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:02.397848 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-55cbfcfe-82db-4456-bf5e-3dd5f34a1399 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:02.398386 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-55cbfcfe-82db-4456-bf5e-3dd5f34a1399 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:02.503406 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-55cbfcfe-82db-4456-bf5e-3dd5f34a1399 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] 10.222.0.84 "GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.153234 Aug 24 11:33:02.505055 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 160/288] 10.222.0.84 () {58 vars in 1275 bytes} [Wed Aug 24 11:33:02 2022] GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a/os-interface => generated 284 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:33:02.672676 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-12593f74-4a90-4e6d-b7c2-4964fff77658 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:02.699076 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-12593f74-4a90-4e6d-b7c2-4964fff77658 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee" status: 200 len: 1521 microversion: 2.1 time: 0.881737 Aug 24 11:33:02.718690 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 129/289] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:01 2022] GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee => generated 1521 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:33:03.388536 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-d173b85e-7adc-48cc-8c09-6791e5638f83 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:03.390617 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-d173b85e-7adc-48cc-8c09-6791e5638f83 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] [instance: 0402b684-55db-4c63-8142-de3fd0cc1503] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:03.403376 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-d173b85e-7adc-48cc-8c09-6791e5638f83 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:03.404391 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-d173b85e-7adc-48cc-8c09-6791e5638f83 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:03.405338 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-d173b85e-7adc-48cc-8c09-6791e5638f83 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:03.406708 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-d173b85e-7adc-48cc-8c09-6791e5638f83 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:03.407513 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-d173b85e-7adc-48cc-8c09-6791e5638f83 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:03.408412 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-d173b85e-7adc-48cc-8c09-6791e5638f83 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:03.644084 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [req-a11bcdf9-3744-4544-ae07-080357447aec req-8ee201ce-8248-44fc-b410-ccbf07f24f83 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0402b684-55db-4c63-8142-de3fd0cc1503", "tag": "e238f4c5-1b92-4a5f-873c-298914f522f1"}]} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:33:03.678955 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-a11bcdf9-3744-4544-ae07-080357447aec req-8ee201ce-8248-44fc-b410-ccbf07f24f83 service nova] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:03.684327 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-a11bcdf9-3744-4544-ae07-080357447aec req-8ee201ce-8248-44fc-b410-ccbf07f24f83 service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:03.684327 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-a11bcdf9-3744-4544-ae07-080357447aec req-8ee201ce-8248-44fc-b410-ccbf07f24f83 service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:03.697782 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.compute.server_external_events [req-a11bcdf9-3744-4544-ae07-080357447aec req-8ee201ce-8248-44fc-b410-ccbf07f24f83 service nova] Creating event network-changed:e238f4c5-1b92-4a5f-873c-298914f522f1 for instance 0402b684-55db-4c63-8142-de3fd0cc1503 on hv-cinder-85427 Aug 24 11:33:03.706311 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [req-a11bcdf9-3744-4544-ae07-080357447aec req-8ee201ce-8248-44fc-b410-ccbf07f24f83 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068892 Aug 24 11:33:03.707345 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 130/290] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Aug 24 11:33:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:33:03.737884 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-96dea300-cd2f-4423-9a76-881f20433ca7 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:03.739128 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-96dea300-cd2f-4423-9a76-881f20433ca7 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: 2d4527c9-c18c-4028-a452-d23423d9c4ee] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:03.759704 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-96dea300-cd2f-4423-9a76-881f20433ca7 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:03.760596 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-96dea300-cd2f-4423-9a76-881f20433ca7 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:03.762361 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-96dea300-cd2f-4423-9a76-881f20433ca7 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:03.766074 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-96dea300-cd2f-4423-9a76-881f20433ca7 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:03.767290 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-96dea300-cd2f-4423-9a76-881f20433ca7 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:03.776397 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-96dea300-cd2f-4423-9a76-881f20433ca7 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:04.016475 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-96dea300-cd2f-4423-9a76-881f20433ca7 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:04.028713 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-96dea300-cd2f-4423-9a76-881f20433ca7 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee" status: 200 len: 1521 microversion: 2.1 time: 0.299358 Aug 24 11:33:04.050785 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 131/291] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:03 2022] GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee => generated 1521 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:33:04.098982 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-d173b85e-7adc-48cc-8c09-6791e5638f83 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5055ddeab8314c93bb2a664f9d1a7f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f910065fc9da40798c7f3d4366dab7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:04.113770 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-d173b85e-7adc-48cc-8c09-6791e5638f83 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] 10.222.0.84 "GET /compute/v2.1/servers/0402b684-55db-4c63-8142-de3fd0cc1503" status: 200 len: 1319 microversion: 2.1 time: 0.731830 Aug 24 11:33:04.118334 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 161/292] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:03 2022] GET /compute/v2.1/servers/0402b684-55db-4c63-8142-de3fd0cc1503 => generated 1319 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:33:04.984904 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [req-eb199c72-6ae6-45be-91e6-54a0651ea9d3 req-0026859c-6110-4c8d-af01-8ab1b81eaafc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15d4a46e-9504-4897-918d-39aafc20d22a", "tag": "a6afa636-0862-4c9f-9c7f-a90a8c528daa"}]} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:33:04.996335 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-eb199c72-6ae6-45be-91e6-54a0651ea9d3 req-0026859c-6110-4c8d-af01-8ab1b81eaafc service nova] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:04.996938 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-eb199c72-6ae6-45be-91e6-54a0651ea9d3 req-0026859c-6110-4c8d-af01-8ab1b81eaafc service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:04.997258 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-eb199c72-6ae6-45be-91e6-54a0651ea9d3 req-0026859c-6110-4c8d-af01-8ab1b81eaafc service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:05.012364 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.compute.server_external_events [req-eb199c72-6ae6-45be-91e6-54a0651ea9d3 req-0026859c-6110-4c8d-af01-8ab1b81eaafc service nova] Creating event network-changed:a6afa636-0862-4c9f-9c7f-a90a8c528daa for instance 15d4a46e-9504-4897-918d-39aafc20d22a on hv-cinder-85427 Aug 24 11:33:05.022957 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [req-eb199c72-6ae6-45be-91e6-54a0651ea9d3 req-0026859c-6110-4c8d-af01-8ab1b81eaafc service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041855 Aug 24 11:33:05.024971 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 132/293] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Aug 24 11:33:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:33:05.063566 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-9f989b15-13b8-4a54-a4e0-74374e36e641 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:05.067618 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-9f989b15-13b8-4a54-a4e0-74374e36e641 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: 2d4527c9-c18c-4028-a452-d23423d9c4ee] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:05.091913 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-9f989b15-13b8-4a54-a4e0-74374e36e641 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:05.095042 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-9f989b15-13b8-4a54-a4e0-74374e36e641 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:05.096022 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-9f989b15-13b8-4a54-a4e0-74374e36e641 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:05.097422 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-9f989b15-13b8-4a54-a4e0-74374e36e641 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:05.098361 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-9f989b15-13b8-4a54-a4e0-74374e36e641 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:05.099489 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-9f989b15-13b8-4a54-a4e0-74374e36e641 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:05.171986 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-ba344160-67ff-41ee-9a88-c4f47bf7ddbd tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:05.173387 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-ba344160-67ff-41ee-9a88-c4f47bf7ddbd tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] [instance: 0402b684-55db-4c63-8142-de3fd0cc1503] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:05.190713 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ba344160-67ff-41ee-9a88-c4f47bf7ddbd tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:05.191577 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ba344160-67ff-41ee-9a88-c4f47bf7ddbd tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:05.193143 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ba344160-67ff-41ee-9a88-c4f47bf7ddbd tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:05.194561 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ba344160-67ff-41ee-9a88-c4f47bf7ddbd tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:05.196427 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ba344160-67ff-41ee-9a88-c4f47bf7ddbd tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:05.197711 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ba344160-67ff-41ee-9a88-c4f47bf7ddbd tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:05.367165 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-9f989b15-13b8-4a54-a4e0-74374e36e641 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:05.389521 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-9f989b15-13b8-4a54-a4e0-74374e36e641 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee" status: 200 len: 1521 microversion: 2.1 time: 0.337102 Aug 24 11:33:05.391436 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 162/294] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:05 2022] GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee => generated 1521 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:33:05.758547 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-ba344160-67ff-41ee-9a88-c4f47bf7ddbd tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5055ddeab8314c93bb2a664f9d1a7f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f910065fc9da40798c7f3d4366dab7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:05.775960 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-ba344160-67ff-41ee-9a88-c4f47bf7ddbd tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] 10.222.0.84 "GET /compute/v2.1/servers/0402b684-55db-4c63-8142-de3fd0cc1503" status: 200 len: 1319 microversion: 2.1 time: 0.638425 Aug 24 11:33:05.777930 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 133/295] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:05 2022] GET /compute/v2.1/servers/0402b684-55db-4c63-8142-de3fd0cc1503 => generated 1319 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:33:06.418982 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-a86fa1a5-41e0-44e4-b4b0-efd7605dc21f tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:06.421083 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-a86fa1a5-41e0-44e4-b4b0-efd7605dc21f tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: 2d4527c9-c18c-4028-a452-d23423d9c4ee] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:06.431770 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-a86fa1a5-41e0-44e4-b4b0-efd7605dc21f tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:06.432485 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-a86fa1a5-41e0-44e4-b4b0-efd7605dc21f tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:06.433274 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-a86fa1a5-41e0-44e4-b4b0-efd7605dc21f tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:06.434463 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-a86fa1a5-41e0-44e4-b4b0-efd7605dc21f tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:06.435229 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-a86fa1a5-41e0-44e4-b4b0-efd7605dc21f tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:06.435940 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-a86fa1a5-41e0-44e4-b4b0-efd7605dc21f tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:06.616923 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-a86fa1a5-41e0-44e4-b4b0-efd7605dc21f tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:06.632245 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-a86fa1a5-41e0-44e4-b4b0-efd7605dc21f tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee" status: 200 len: 1521 microversion: 2.1 time: 0.221959 Aug 24 11:33:06.633237 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 163/296] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:06 2022] GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee => generated 1521 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:33:06.811595 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-b3a60f91-37d3-405e-8296-2c0b46d6fe34 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:06.812600 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-b3a60f91-37d3-405e-8296-2c0b46d6fe34 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] [instance: 0402b684-55db-4c63-8142-de3fd0cc1503] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:06.820872 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b3a60f91-37d3-405e-8296-2c0b46d6fe34 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:06.821558 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b3a60f91-37d3-405e-8296-2c0b46d6fe34 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:06.822220 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b3a60f91-37d3-405e-8296-2c0b46d6fe34 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:06.823239 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b3a60f91-37d3-405e-8296-2c0b46d6fe34 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:06.823798 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b3a60f91-37d3-405e-8296-2c0b46d6fe34 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:06.824292 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b3a60f91-37d3-405e-8296-2c0b46d6fe34 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:07.252896 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-b3a60f91-37d3-405e-8296-2c0b46d6fe34 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5055ddeab8314c93bb2a664f9d1a7f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f910065fc9da40798c7f3d4366dab7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:07.260837 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-b3a60f91-37d3-405e-8296-2c0b46d6fe34 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] 10.222.0.84 "GET /compute/v2.1/servers/0402b684-55db-4c63-8142-de3fd0cc1503" status: 200 len: 1319 microversion: 2.1 time: 0.453362 Aug 24 11:33:07.261913 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 134/297] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:06 2022] GET /compute/v2.1/servers/0402b684-55db-4c63-8142-de3fd0cc1503 => generated 1319 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:33:07.668446 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-8ab7d5cc-7d1e-4fd8-9d6a-d1acba91321b tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:07.669758 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-8ab7d5cc-7d1e-4fd8-9d6a-d1acba91321b tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: 2d4527c9-c18c-4028-a452-d23423d9c4ee] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:07.680208 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-8ab7d5cc-7d1e-4fd8-9d6a-d1acba91321b tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:07.681109 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-8ab7d5cc-7d1e-4fd8-9d6a-d1acba91321b tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:07.681907 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-8ab7d5cc-7d1e-4fd8-9d6a-d1acba91321b tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:07.682704 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-8ab7d5cc-7d1e-4fd8-9d6a-d1acba91321b tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:07.683196 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-8ab7d5cc-7d1e-4fd8-9d6a-d1acba91321b tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:07.683739 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-8ab7d5cc-7d1e-4fd8-9d6a-d1acba91321b tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:07.876004 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-8ab7d5cc-7d1e-4fd8-9d6a-d1acba91321b tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:07.891480 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-8ab7d5cc-7d1e-4fd8-9d6a-d1acba91321b tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee" status: 200 len: 1521 microversion: 2.1 time: 0.230268 Aug 24 11:33:07.892393 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 164/298] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:07 2022] GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee => generated 1521 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:33:08.302862 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-45130444-659d-4cbd-9806-e36673ca3e4f tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:08.304979 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-45130444-659d-4cbd-9806-e36673ca3e4f tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] [instance: 0402b684-55db-4c63-8142-de3fd0cc1503] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:08.331232 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-45130444-659d-4cbd-9806-e36673ca3e4f tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:08.334687 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-45130444-659d-4cbd-9806-e36673ca3e4f tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:08.334687 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-45130444-659d-4cbd-9806-e36673ca3e4f tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:08.334687 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-45130444-659d-4cbd-9806-e36673ca3e4f tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:08.335556 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-45130444-659d-4cbd-9806-e36673ca3e4f tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:08.340682 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-45130444-659d-4cbd-9806-e36673ca3e4f tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:08.534935 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-45130444-659d-4cbd-9806-e36673ca3e4f tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5055ddeab8314c93bb2a664f9d1a7f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f910065fc9da40798c7f3d4366dab7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:08.537563 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:08.544646 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-45130444-659d-4cbd-9806-e36673ca3e4f tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] 10.222.0.84 "GET /compute/v2.1/servers/0402b684-55db-4c63-8142-de3fd0cc1503" status: 200 len: 1319 microversion: 2.1 time: 0.249656 Aug 24 11:33:08.546004 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 135/299] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:08 2022] GET /compute/v2.1/servers/0402b684-55db-4c63-8142-de3fd0cc1503 => generated 1319 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:33:08.915638 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-80c6b99d-7c4b-4d16-9dd0-5812bc605c55 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:08.916555 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-80c6b99d-7c4b-4d16-9dd0-5812bc605c55 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: 2d4527c9-c18c-4028-a452-d23423d9c4ee] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:08.923917 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-80c6b99d-7c4b-4d16-9dd0-5812bc605c55 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:08.924407 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-80c6b99d-7c4b-4d16-9dd0-5812bc605c55 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:08.924883 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-80c6b99d-7c4b-4d16-9dd0-5812bc605c55 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:08.925607 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-80c6b99d-7c4b-4d16-9dd0-5812bc605c55 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:08.926071 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-80c6b99d-7c4b-4d16-9dd0-5812bc605c55 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:08.926498 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-80c6b99d-7c4b-4d16-9dd0-5812bc605c55 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:09.112363 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-80c6b99d-7c4b-4d16-9dd0-5812bc605c55 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:09.121972 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-80c6b99d-7c4b-4d16-9dd0-5812bc605c55 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee" status: 200 len: 1521 microversion: 2.1 time: 0.210160 Aug 24 11:33:09.122568 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 165/300] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:08 2022] GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee => generated 1521 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:33:09.573314 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-fede3046-f081-4ae7-a253-99905098eb5f tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:09.574438 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-fede3046-f081-4ae7-a253-99905098eb5f tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] [instance: 0402b684-55db-4c63-8142-de3fd0cc1503] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:09.586136 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-fede3046-f081-4ae7-a253-99905098eb5f tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:09.586742 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-fede3046-f081-4ae7-a253-99905098eb5f tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:09.587203 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-fede3046-f081-4ae7-a253-99905098eb5f tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:09.588221 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-fede3046-f081-4ae7-a253-99905098eb5f tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:09.589131 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-fede3046-f081-4ae7-a253-99905098eb5f tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:09.589871 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-fede3046-f081-4ae7-a253-99905098eb5f tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:09.798577 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-fede3046-f081-4ae7-a253-99905098eb5f tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5055ddeab8314c93bb2a664f9d1a7f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f910065fc9da40798c7f3d4366dab7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:09.807495 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-fede3046-f081-4ae7-a253-99905098eb5f tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] 10.222.0.84 "GET /compute/v2.1/servers/0402b684-55db-4c63-8142-de3fd0cc1503" status: 200 len: 1319 microversion: 2.1 time: 0.241881 Aug 24 11:33:09.808161 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 136/301] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:09 2022] GET /compute/v2.1/servers/0402b684-55db-4c63-8142-de3fd0cc1503 => generated 1319 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:33:10.155186 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-5ecb003b-4dfc-45cc-a06d-6758cca93dca tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:10.156128 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-5ecb003b-4dfc-45cc-a06d-6758cca93dca tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: 2d4527c9-c18c-4028-a452-d23423d9c4ee] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:10.164836 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-5ecb003b-4dfc-45cc-a06d-6758cca93dca tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:10.165477 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-5ecb003b-4dfc-45cc-a06d-6758cca93dca tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:10.165909 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-5ecb003b-4dfc-45cc-a06d-6758cca93dca tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:10.166474 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-5ecb003b-4dfc-45cc-a06d-6758cca93dca tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:10.170621 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-5ecb003b-4dfc-45cc-a06d-6758cca93dca tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:10.170621 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-5ecb003b-4dfc-45cc-a06d-6758cca93dca tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:10.361086 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-5ecb003b-4dfc-45cc-a06d-6758cca93dca tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:10.369164 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-5ecb003b-4dfc-45cc-a06d-6758cca93dca tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee" status: 200 len: 1521 microversion: 2.1 time: 0.218561 Aug 24 11:33:10.370067 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 166/302] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:10 2022] GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee => generated 1521 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:33:10.834900 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-27a927bf-f5be-468f-baa9-244e4c7f765d tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:10.836036 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-27a927bf-f5be-468f-baa9-244e4c7f765d tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] [instance: 0402b684-55db-4c63-8142-de3fd0cc1503] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:10.848738 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-27a927bf-f5be-468f-baa9-244e4c7f765d tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:10.849540 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-27a927bf-f5be-468f-baa9-244e4c7f765d tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:10.850449 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-27a927bf-f5be-468f-baa9-244e4c7f765d tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:10.851514 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-27a927bf-f5be-468f-baa9-244e4c7f765d tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:10.852198 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-27a927bf-f5be-468f-baa9-244e4c7f765d tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:10.852837 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-27a927bf-f5be-468f-baa9-244e4c7f765d tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:11.072652 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-27a927bf-f5be-468f-baa9-244e4c7f765d tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5055ddeab8314c93bb2a664f9d1a7f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f910065fc9da40798c7f3d4366dab7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:11.086063 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-27a927bf-f5be-468f-baa9-244e4c7f765d tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] 10.222.0.84 "GET /compute/v2.1/servers/0402b684-55db-4c63-8142-de3fd0cc1503" status: 200 len: 1319 microversion: 2.1 time: 0.258207 Aug 24 11:33:11.087194 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 137/303] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:10 2022] GET /compute/v2.1/servers/0402b684-55db-4c63-8142-de3fd0cc1503 => generated 1319 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:33:11.394936 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-33972c32-36af-4478-8a03-fd38a21029c2 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:11.396118 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-33972c32-36af-4478-8a03-fd38a21029c2 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: 2d4527c9-c18c-4028-a452-d23423d9c4ee] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:11.403509 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-33972c32-36af-4478-8a03-fd38a21029c2 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:11.404305 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-33972c32-36af-4478-8a03-fd38a21029c2 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:11.404928 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-33972c32-36af-4478-8a03-fd38a21029c2 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:11.405826 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-33972c32-36af-4478-8a03-fd38a21029c2 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:11.406653 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-33972c32-36af-4478-8a03-fd38a21029c2 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:11.407332 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-33972c32-36af-4478-8a03-fd38a21029c2 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:11.605589 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-33972c32-36af-4478-8a03-fd38a21029c2 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:11.619142 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-33972c32-36af-4478-8a03-fd38a21029c2 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee" status: 200 len: 1521 microversion: 2.1 time: 0.230361 Aug 24 11:33:11.620262 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 167/304] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:11 2022] GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee => generated 1521 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:33:12.124604 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-9f6cf926-4c6d-45a1-986b-7c4b6a5f2079 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:12.125472 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-9f6cf926-4c6d-45a1-986b-7c4b6a5f2079 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] [instance: 0402b684-55db-4c63-8142-de3fd0cc1503] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:12.136744 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9f6cf926-4c6d-45a1-986b-7c4b6a5f2079 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:12.137673 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9f6cf926-4c6d-45a1-986b-7c4b6a5f2079 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:12.138395 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9f6cf926-4c6d-45a1-986b-7c4b6a5f2079 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:12.139576 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9f6cf926-4c6d-45a1-986b-7c4b6a5f2079 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:12.140418 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9f6cf926-4c6d-45a1-986b-7c4b6a5f2079 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:12.141165 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9f6cf926-4c6d-45a1-986b-7c4b6a5f2079 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:12.321074 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-9f6cf926-4c6d-45a1-986b-7c4b6a5f2079 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5055ddeab8314c93bb2a664f9d1a7f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f910065fc9da40798c7f3d4366dab7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:12.333444 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-9f6cf926-4c6d-45a1-986b-7c4b6a5f2079 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] 10.222.0.84 "GET /compute/v2.1/servers/0402b684-55db-4c63-8142-de3fd0cc1503" status: 200 len: 1319 microversion: 2.1 time: 0.217128 Aug 24 11:33:12.334370 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 138/305] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:12 2022] GET /compute/v2.1/servers/0402b684-55db-4c63-8142-de3fd0cc1503 => generated 1319 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:33:12.656422 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-f519f96b-47cd-4b2f-aad2-6f0bdfa56840 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:12.656422 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-f519f96b-47cd-4b2f-aad2-6f0bdfa56840 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: 2d4527c9-c18c-4028-a452-d23423d9c4ee] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:12.675090 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f519f96b-47cd-4b2f-aad2-6f0bdfa56840 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:12.675606 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f519f96b-47cd-4b2f-aad2-6f0bdfa56840 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:12.676053 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f519f96b-47cd-4b2f-aad2-6f0bdfa56840 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:12.676780 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f519f96b-47cd-4b2f-aad2-6f0bdfa56840 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:12.677269 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f519f96b-47cd-4b2f-aad2-6f0bdfa56840 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:12.677692 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f519f96b-47cd-4b2f-aad2-6f0bdfa56840 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:12.879747 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-f519f96b-47cd-4b2f-aad2-6f0bdfa56840 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:12.899789 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-f519f96b-47cd-4b2f-aad2-6f0bdfa56840 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee" status: 200 len: 1521 microversion: 2.1 time: 0.254385 Aug 24 11:33:12.903674 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 168/306] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:12 2022] GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee => generated 1521 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:33:13.370784 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-12ade730-2d73-4b41-b295-02958071d543 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:13.371818 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-12ade730-2d73-4b41-b295-02958071d543 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] [instance: 0402b684-55db-4c63-8142-de3fd0cc1503] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:13.381723 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-12ade730-2d73-4b41-b295-02958071d543 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:13.396919 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-12ade730-2d73-4b41-b295-02958071d543 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:13.396919 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-12ade730-2d73-4b41-b295-02958071d543 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:13.396919 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-12ade730-2d73-4b41-b295-02958071d543 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:13.396919 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-12ade730-2d73-4b41-b295-02958071d543 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:13.397362 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-12ade730-2d73-4b41-b295-02958071d543 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:13.554713 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-12ade730-2d73-4b41-b295-02958071d543 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5055ddeab8314c93bb2a664f9d1a7f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f910065fc9da40798c7f3d4366dab7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:13.566366 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-12ade730-2d73-4b41-b295-02958071d543 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] 10.222.0.84 "GET /compute/v2.1/servers/0402b684-55db-4c63-8142-de3fd0cc1503" status: 200 len: 1319 microversion: 2.1 time: 0.202957 Aug 24 11:33:13.566976 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 139/307] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:13 2022] GET /compute/v2.1/servers/0402b684-55db-4c63-8142-de3fd0cc1503 => generated 1319 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:33:13.925993 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-b209cb22-6d28-4a40-a3f9-60abd61c7b2a tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:13.926750 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-b209cb22-6d28-4a40-a3f9-60abd61c7b2a tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: 2d4527c9-c18c-4028-a452-d23423d9c4ee] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:13.947060 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-b209cb22-6d28-4a40-a3f9-60abd61c7b2a tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:13.947060 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-b209cb22-6d28-4a40-a3f9-60abd61c7b2a tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:13.947060 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-b209cb22-6d28-4a40-a3f9-60abd61c7b2a tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:13.947627 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-b209cb22-6d28-4a40-a3f9-60abd61c7b2a tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:13.948856 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-b209cb22-6d28-4a40-a3f9-60abd61c7b2a tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:13.949825 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-b209cb22-6d28-4a40-a3f9-60abd61c7b2a tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:14.141366 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-b209cb22-6d28-4a40-a3f9-60abd61c7b2a tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:14.150764 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-b209cb22-6d28-4a40-a3f9-60abd61c7b2a tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee" status: 200 len: 1521 microversion: 2.1 time: 0.230960 Aug 24 11:33:14.151633 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 169/308] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:13 2022] GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee => generated 1521 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:33:14.591580 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-590b304d-e21e-4c05-9858-111af70c1750 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:14.594175 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-590b304d-e21e-4c05-9858-111af70c1750 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] [instance: 0402b684-55db-4c63-8142-de3fd0cc1503] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:14.605491 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-590b304d-e21e-4c05-9858-111af70c1750 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:14.606340 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-590b304d-e21e-4c05-9858-111af70c1750 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:14.607436 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-590b304d-e21e-4c05-9858-111af70c1750 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:14.609559 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-590b304d-e21e-4c05-9858-111af70c1750 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:14.610231 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-590b304d-e21e-4c05-9858-111af70c1750 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:14.610819 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-590b304d-e21e-4c05-9858-111af70c1750 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:14.746595 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [req-286ab4b7-3d9c-4dfc-9d3b-7252ff11b4c1 req-9d29e538-6a14-437a-a62b-213a7aeafa9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0402b684-55db-4c63-8142-de3fd0cc1503", "name": "network-vif-plugged", "status": "completed", "tag": "e238f4c5-1b92-4a5f-873c-298914f522f1"}]} {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:33:14.766602 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [req-286ab4b7-3d9c-4dfc-9d3b-7252ff11b4c1 req-9d29e538-6a14-437a-a62b-213a7aeafa9c service nova] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:14.767406 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [req-286ab4b7-3d9c-4dfc-9d3b-7252ff11b4c1 req-9d29e538-6a14-437a-a62b-213a7aeafa9c service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:14.768205 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [req-286ab4b7-3d9c-4dfc-9d3b-7252ff11b4c1 req-9d29e538-6a14-437a-a62b-213a7aeafa9c service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:14.790930 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.compute.server_external_events [req-286ab4b7-3d9c-4dfc-9d3b-7252ff11b4c1 req-9d29e538-6a14-437a-a62b-213a7aeafa9c service nova] Creating event network-vif-plugged:e238f4c5-1b92-4a5f-873c-298914f522f1 for instance 0402b684-55db-4c63-8142-de3fd0cc1503 on hv-cinder-85427 Aug 24 11:33:14.797196 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [req-286ab4b7-3d9c-4dfc-9d3b-7252ff11b4c1 req-9d29e538-6a14-437a-a62b-213a7aeafa9c service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057965 Aug 24 11:33:14.798174 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 170/309] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Aug 24 11:33:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:33:14.822621 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-590b304d-e21e-4c05-9858-111af70c1750 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5055ddeab8314c93bb2a664f9d1a7f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f910065fc9da40798c7f3d4366dab7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:14.881285 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-590b304d-e21e-4c05-9858-111af70c1750 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] 10.222.0.84 "GET /compute/v2.1/servers/0402b684-55db-4c63-8142-de3fd0cc1503" status: 200 len: 1319 microversion: 2.1 time: 0.269488 Aug 24 11:33:14.881285 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 140/310] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:14 2022] GET /compute/v2.1/servers/0402b684-55db-4c63-8142-de3fd0cc1503 => generated 1319 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:33:14.985726 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-bebcec3b-9415-411d-9e0e-847a579f519f tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:14.990442 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-bebcec3b-9415-411d-9e0e-847a579f519f tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] [instance: 07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:14.997398 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-bebcec3b-9415-411d-9e0e-847a579f519f tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:14.998148 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-bebcec3b-9415-411d-9e0e-847a579f519f tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:14.998732 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-bebcec3b-9415-411d-9e0e-847a579f519f tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:14.999550 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-bebcec3b-9415-411d-9e0e-847a579f519f tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:15.000342 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-bebcec3b-9415-411d-9e0e-847a579f519f tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:15.001124 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-bebcec3b-9415-411d-9e0e-847a579f519f tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:15.036678 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-bebcec3b-9415-411d-9e0e-847a579f519f tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] [instance: 07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0] Going to try to terminate instance {{(pid=124769) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 11:33:15.176708 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-bf9d6bfd-8f10-474c-9ec3-da02711ac3ca tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:15.177966 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-bf9d6bfd-8f10-474c-9ec3-da02711ac3ca tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: 2d4527c9-c18c-4028-a452-d23423d9c4ee] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:15.186982 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-bf9d6bfd-8f10-474c-9ec3-da02711ac3ca tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:15.188086 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-bf9d6bfd-8f10-474c-9ec3-da02711ac3ca tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:15.188501 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG dbcounter [-] [124769] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=124769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:15.188685 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-bf9d6bfd-8f10-474c-9ec3-da02711ac3ca tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:15.189456 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-bf9d6bfd-8f10-474c-9ec3-da02711ac3ca tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:15.189897 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-bf9d6bfd-8f10-474c-9ec3-da02711ac3ca tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:15.190331 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-bf9d6bfd-8f10-474c-9ec3-da02711ac3ca tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:15.444099 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-bf9d6bfd-8f10-474c-9ec3-da02711ac3ca tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:15.460785 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-bf9d6bfd-8f10-474c-9ec3-da02711ac3ca tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee" status: 200 len: 1521 microversion: 2.1 time: 0.290063 Aug 24 11:33:15.476835 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 141/311] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:15 2022] GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee => generated 1521 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:33:15.498713 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-bebcec3b-9415-411d-9e0e-847a579f519f tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] 10.222.0.84 "DELETE /compute/v2.1/servers/07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0" status: 204 len: 0 microversion: 2.1 time: 0.518912 Aug 24 11:33:15.499726 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 171/312] 10.222.0.84 () {58 vars in 1239 bytes} [Wed Aug 24 11:33:14 2022] DELETE /compute/v2.1/servers/07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 11:33:15.509686 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-6e530166-a3a6-4de6-a21a-7be2d13e258b tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:15.510589 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-6e530166-a3a6-4de6-a21a-7be2d13e258b tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] [instance: 07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:15.521607 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6e530166-a3a6-4de6-a21a-7be2d13e258b tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:15.522448 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6e530166-a3a6-4de6-a21a-7be2d13e258b tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:15.523221 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6e530166-a3a6-4de6-a21a-7be2d13e258b tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:15.524472 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6e530166-a3a6-4de6-a21a-7be2d13e258b tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:15.525197 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6e530166-a3a6-4de6-a21a-7be2d13e258b tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:15.525827 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6e530166-a3a6-4de6-a21a-7be2d13e258b tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:15.727364 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-6e530166-a3a6-4de6-a21a-7be2d13e258b tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cef1a9e6a241ac8401b88f4a0f69fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901780013b03485a83261796f69e1b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:15.741008 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-6e530166-a3a6-4de6-a21a-7be2d13e258b tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] 10.222.0.84 "GET /compute/v2.1/servers/07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0" status: 200 len: 1553 microversion: 2.1 time: 0.235313 Aug 24 11:33:15.742056 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 142/313] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:15 2022] GET /compute/v2.1/servers/07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0 => generated 1553 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:33:15.901834 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-fde78792-1270-4037-b233-d34662a9677c tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:15.907955 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-fde78792-1270-4037-b233-d34662a9677c tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] [instance: 0402b684-55db-4c63-8142-de3fd0cc1503] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:15.915794 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-fde78792-1270-4037-b233-d34662a9677c tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:15.916627 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-fde78792-1270-4037-b233-d34662a9677c tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:15.917338 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-fde78792-1270-4037-b233-d34662a9677c tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:15.918332 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-fde78792-1270-4037-b233-d34662a9677c tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:15.918970 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-fde78792-1270-4037-b233-d34662a9677c tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:15.919622 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-fde78792-1270-4037-b233-d34662a9677c tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:16.152120 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-fde78792-1270-4037-b233-d34662a9677c tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5055ddeab8314c93bb2a664f9d1a7f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f910065fc9da40798c7f3d4366dab7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:16.161357 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-fde78792-1270-4037-b233-d34662a9677c tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] 10.222.0.84 "GET /compute/v2.1/servers/0402b684-55db-4c63-8142-de3fd0cc1503" status: 200 len: 1319 microversion: 2.1 time: 0.264431 Aug 24 11:33:16.161933 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 172/314] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:15 2022] GET /compute/v2.1/servers/0402b684-55db-4c63-8142-de3fd0cc1503 => generated 1319 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:33:16.494174 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-7813f3df-9dee-4a4f-92f7-8dff0ad8df25 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:16.495126 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-7813f3df-9dee-4a4f-92f7-8dff0ad8df25 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: 2d4527c9-c18c-4028-a452-d23423d9c4ee] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:16.497514 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_api:SELECT=77 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:16.503130 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-7813f3df-9dee-4a4f-92f7-8dff0ad8df25 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:16.509480 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-7813f3df-9dee-4a4f-92f7-8dff0ad8df25 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:16.509480 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-7813f3df-9dee-4a4f-92f7-8dff0ad8df25 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:16.509480 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-7813f3df-9dee-4a4f-92f7-8dff0ad8df25 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:16.509480 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-7813f3df-9dee-4a4f-92f7-8dff0ad8df25 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:16.510130 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-7813f3df-9dee-4a4f-92f7-8dff0ad8df25 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:16.684193 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-7813f3df-9dee-4a4f-92f7-8dff0ad8df25 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:16.694872 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-7813f3df-9dee-4a4f-92f7-8dff0ad8df25 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee" status: 200 len: 1521 microversion: 2.1 time: 0.204944 Aug 24 11:33:16.695471 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 143/315] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:16 2022] GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee => generated 1521 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:33:16.774485 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-58014e62-bf26-4efc-bb75-958cab2bb543 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:16.774987 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-58014e62-bf26-4efc-bb75-958cab2bb543 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] [instance: 07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:16.782552 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-58014e62-bf26-4efc-bb75-958cab2bb543 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:16.789971 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-58014e62-bf26-4efc-bb75-958cab2bb543 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:16.789971 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-58014e62-bf26-4efc-bb75-958cab2bb543 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:16.789971 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-58014e62-bf26-4efc-bb75-958cab2bb543 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:16.789971 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-58014e62-bf26-4efc-bb75-958cab2bb543 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:16.790617 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-58014e62-bf26-4efc-bb75-958cab2bb543 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:16.958089 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-58014e62-bf26-4efc-bb75-958cab2bb543 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cef1a9e6a241ac8401b88f4a0f69fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901780013b03485a83261796f69e1b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:16.968060 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-58014e62-bf26-4efc-bb75-958cab2bb543 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] 10.222.0.84 "GET /compute/v2.1/servers/07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0" status: 200 len: 1553 microversion: 2.1 time: 0.197431 Aug 24 11:33:16.969779 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 173/316] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:16 2022] GET /compute/v2.1/servers/07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0 => generated 1553 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:33:17.187741 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-cd3c8835-e14d-4299-85dd-54a7d2707833 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:17.188888 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-cd3c8835-e14d-4299-85dd-54a7d2707833 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] [instance: 0402b684-55db-4c63-8142-de3fd0cc1503] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:17.199035 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-cd3c8835-e14d-4299-85dd-54a7d2707833 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:17.199891 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-cd3c8835-e14d-4299-85dd-54a7d2707833 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:17.200350 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-cd3c8835-e14d-4299-85dd-54a7d2707833 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:17.201535 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-cd3c8835-e14d-4299-85dd-54a7d2707833 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:17.202619 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-cd3c8835-e14d-4299-85dd-54a7d2707833 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:17.203500 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-cd3c8835-e14d-4299-85dd-54a7d2707833 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:17.444764 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-cd3c8835-e14d-4299-85dd-54a7d2707833 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5055ddeab8314c93bb2a664f9d1a7f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f910065fc9da40798c7f3d4366dab7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:17.458964 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-cd3c8835-e14d-4299-85dd-54a7d2707833 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] 10.222.0.84 "GET /compute/v2.1/servers/0402b684-55db-4c63-8142-de3fd0cc1503" status: 200 len: 1319 microversion: 2.1 time: 0.278011 Aug 24 11:33:17.473265 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 144/317] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:17 2022] GET /compute/v2.1/servers/0402b684-55db-4c63-8142-de3fd0cc1503 => generated 1319 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:33:17.723008 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-3f9b4503-83a2-430c-8e66-a146276541db tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:17.723746 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-3f9b4503-83a2-430c-8e66-a146276541db tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: 2d4527c9-c18c-4028-a452-d23423d9c4ee] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:17.730011 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-3f9b4503-83a2-430c-8e66-a146276541db tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:17.730538 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-3f9b4503-83a2-430c-8e66-a146276541db tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:17.731019 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-3f9b4503-83a2-430c-8e66-a146276541db tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:17.732022 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-3f9b4503-83a2-430c-8e66-a146276541db tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:17.733194 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-3f9b4503-83a2-430c-8e66-a146276541db tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:17.733736 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-3f9b4503-83a2-430c-8e66-a146276541db tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:17.932326 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-3f9b4503-83a2-430c-8e66-a146276541db tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:17.947840 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-3f9b4503-83a2-430c-8e66-a146276541db tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee" status: 200 len: 1521 microversion: 2.1 time: 0.231221 Aug 24 11:33:17.948903 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 174/318] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:17 2022] GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee => generated 1521 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:33:18.005119 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-c5f4dd2d-3f11-47b0-ad36-d0c06241aa14 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:18.006021 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-c5f4dd2d-3f11-47b0-ad36-d0c06241aa14 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] [instance: 07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:18.016747 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c5f4dd2d-3f11-47b0-ad36-d0c06241aa14 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:18.017547 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c5f4dd2d-3f11-47b0-ad36-d0c06241aa14 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:18.018345 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c5f4dd2d-3f11-47b0-ad36-d0c06241aa14 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:18.019103 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c5f4dd2d-3f11-47b0-ad36-d0c06241aa14 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:18.019693 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c5f4dd2d-3f11-47b0-ad36-d0c06241aa14 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:18.020339 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c5f4dd2d-3f11-47b0-ad36-d0c06241aa14 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:18.249639 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-c5f4dd2d-3f11-47b0-ad36-d0c06241aa14 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cef1a9e6a241ac8401b88f4a0f69fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901780013b03485a83261796f69e1b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:18.264849 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-c5f4dd2d-3f11-47b0-ad36-d0c06241aa14 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] 10.222.0.84 "GET /compute/v2.1/servers/07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0" status: 200 len: 1553 microversion: 2.1 time: 0.266435 Aug 24 11:33:18.265678 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 145/319] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:17 2022] GET /compute/v2.1/servers/07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0 => generated 1553 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:33:18.492728 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-e6e9b50c-9a4f-41f2-b1ea-226cf0dcffa8 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:18.493947 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-e6e9b50c-9a4f-41f2-b1ea-226cf0dcffa8 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] [instance: 0402b684-55db-4c63-8142-de3fd0cc1503] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:18.505236 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-e6e9b50c-9a4f-41f2-b1ea-226cf0dcffa8 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:18.507119 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-e6e9b50c-9a4f-41f2-b1ea-226cf0dcffa8 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:18.507119 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-e6e9b50c-9a4f-41f2-b1ea-226cf0dcffa8 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:18.508027 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-e6e9b50c-9a4f-41f2-b1ea-226cf0dcffa8 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:18.508582 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-e6e9b50c-9a4f-41f2-b1ea-226cf0dcffa8 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:18.509103 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-e6e9b50c-9a4f-41f2-b1ea-226cf0dcffa8 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:18.689385 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-e6e9b50c-9a4f-41f2-b1ea-226cf0dcffa8 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5055ddeab8314c93bb2a664f9d1a7f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f910065fc9da40798c7f3d4366dab7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:18.697626 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-e6e9b50c-9a4f-41f2-b1ea-226cf0dcffa8 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] 10.222.0.84 "GET /compute/v2.1/servers/0402b684-55db-4c63-8142-de3fd0cc1503" status: 200 len: 1319 microversion: 2.1 time: 0.210995 Aug 24 11:33:18.698275 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 175/320] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:18 2022] GET /compute/v2.1/servers/0402b684-55db-4c63-8142-de3fd0cc1503 => generated 1319 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:33:18.973127 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-09437cb7-47f6-45fa-830b-8c2fb8331334 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:18.974203 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-09437cb7-47f6-45fa-830b-8c2fb8331334 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: 2d4527c9-c18c-4028-a452-d23423d9c4ee] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:18.983553 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-09437cb7-47f6-45fa-830b-8c2fb8331334 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:18.984525 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-09437cb7-47f6-45fa-830b-8c2fb8331334 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:18.985365 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-09437cb7-47f6-45fa-830b-8c2fb8331334 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:18.986576 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-09437cb7-47f6-45fa-830b-8c2fb8331334 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:18.987465 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-09437cb7-47f6-45fa-830b-8c2fb8331334 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:18.988400 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-09437cb7-47f6-45fa-830b-8c2fb8331334 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:19.175769 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-09437cb7-47f6-45fa-830b-8c2fb8331334 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:19.184526 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-09437cb7-47f6-45fa-830b-8c2fb8331334 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee" status: 200 len: 1521 microversion: 2.1 time: 0.217466 Aug 24 11:33:19.184768 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 146/321] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:18 2022] GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee => generated 1521 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:33:19.298047 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-fc35daab-ec20-4d60-a8ca-e904c54a9947 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:19.305896 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-fc35daab-ec20-4d60-a8ca-e904c54a9947 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] [instance: 07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:19.305896 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-fc35daab-ec20-4d60-a8ca-e904c54a9947 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:19.305896 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-fc35daab-ec20-4d60-a8ca-e904c54a9947 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:19.306365 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-fc35daab-ec20-4d60-a8ca-e904c54a9947 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:19.306730 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-fc35daab-ec20-4d60-a8ca-e904c54a9947 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:19.307180 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-fc35daab-ec20-4d60-a8ca-e904c54a9947 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:19.307621 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-fc35daab-ec20-4d60-a8ca-e904c54a9947 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:19.466880 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-fc35daab-ec20-4d60-a8ca-e904c54a9947 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cef1a9e6a241ac8401b88f4a0f69fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901780013b03485a83261796f69e1b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:19.481533 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-fc35daab-ec20-4d60-a8ca-e904c54a9947 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] 10.222.0.84 "GET /compute/v2.1/servers/07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0" status: 200 len: 1553 microversion: 2.1 time: 0.188351 Aug 24 11:33:19.482588 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 176/322] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:19 2022] GET /compute/v2.1/servers/07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0 => generated 1553 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:33:19.720096 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-26e17c03-fb9e-401f-944b-310e75eb8e0a tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:19.720885 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-26e17c03-fb9e-401f-944b-310e75eb8e0a tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] [instance: 0402b684-55db-4c63-8142-de3fd0cc1503] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:19.729616 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-26e17c03-fb9e-401f-944b-310e75eb8e0a tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:19.730099 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-26e17c03-fb9e-401f-944b-310e75eb8e0a tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:19.730592 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-26e17c03-fb9e-401f-944b-310e75eb8e0a tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:19.731284 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-26e17c03-fb9e-401f-944b-310e75eb8e0a tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:19.731740 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-26e17c03-fb9e-401f-944b-310e75eb8e0a tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:19.732663 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-26e17c03-fb9e-401f-944b-310e75eb8e0a tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:19.891508 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-26e17c03-fb9e-401f-944b-310e75eb8e0a tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5055ddeab8314c93bb2a664f9d1a7f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f910065fc9da40798c7f3d4366dab7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:19.899913 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-26e17c03-fb9e-401f-944b-310e75eb8e0a tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] 10.222.0.84 "GET /compute/v2.1/servers/0402b684-55db-4c63-8142-de3fd0cc1503" status: 200 len: 1319 microversion: 2.1 time: 0.184192 Aug 24 11:33:19.900578 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 147/323] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:19 2022] GET /compute/v2.1/servers/0402b684-55db-4c63-8142-de3fd0cc1503 => generated 1319 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:33:20.212508 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-3dd4b515-9ac8-4f2b-9273-7afb7dc0fbbc tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:20.213311 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-3dd4b515-9ac8-4f2b-9273-7afb7dc0fbbc tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: 2d4527c9-c18c-4028-a452-d23423d9c4ee] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:20.229483 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-3dd4b515-9ac8-4f2b-9273-7afb7dc0fbbc tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:20.229483 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-3dd4b515-9ac8-4f2b-9273-7afb7dc0fbbc tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:20.229483 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-3dd4b515-9ac8-4f2b-9273-7afb7dc0fbbc tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:20.229483 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-3dd4b515-9ac8-4f2b-9273-7afb7dc0fbbc tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:20.230082 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-3dd4b515-9ac8-4f2b-9273-7afb7dc0fbbc tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:20.230082 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-3dd4b515-9ac8-4f2b-9273-7afb7dc0fbbc tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:20.481423 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-3dd4b515-9ac8-4f2b-9273-7afb7dc0fbbc tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:20.496051 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-3dd4b515-9ac8-4f2b-9273-7afb7dc0fbbc tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee" status: 200 len: 1521 microversion: 2.1 time: 0.289626 Aug 24 11:33:20.497020 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 177/324] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:20 2022] GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee => generated 1521 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:33:20.510817 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-23192e5f-9bce-472f-a81c-cc4fbe7b213c tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:20.512001 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-23192e5f-9bce-472f-a81c-cc4fbe7b213c tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] [instance: 07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:20.523530 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-23192e5f-9bce-472f-a81c-cc4fbe7b213c tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:20.524287 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-23192e5f-9bce-472f-a81c-cc4fbe7b213c tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:20.525169 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-23192e5f-9bce-472f-a81c-cc4fbe7b213c tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:20.526424 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-23192e5f-9bce-472f-a81c-cc4fbe7b213c tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:20.527231 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-23192e5f-9bce-472f-a81c-cc4fbe7b213c tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:20.527959 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-23192e5f-9bce-472f-a81c-cc4fbe7b213c tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:20.745791 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-23192e5f-9bce-472f-a81c-cc4fbe7b213c tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cef1a9e6a241ac8401b88f4a0f69fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901780013b03485a83261796f69e1b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:20.760833 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-23192e5f-9bce-472f-a81c-cc4fbe7b213c tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] 10.222.0.84 "GET /compute/v2.1/servers/07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0" status: 200 len: 1553 microversion: 2.1 time: 0.256608 Aug 24 11:33:20.761749 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 148/325] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:20 2022] GET /compute/v2.1/servers/07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0 => generated 1553 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:33:20.924548 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-85f20893-2e83-4def-949e-524f4eeef5bc tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:20.925605 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-85f20893-2e83-4def-949e-524f4eeef5bc tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] [instance: 0402b684-55db-4c63-8142-de3fd0cc1503] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:20.933771 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-85f20893-2e83-4def-949e-524f4eeef5bc tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:20.934272 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-85f20893-2e83-4def-949e-524f4eeef5bc tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:20.934707 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-85f20893-2e83-4def-949e-524f4eeef5bc tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:20.935471 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-85f20893-2e83-4def-949e-524f4eeef5bc tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:20.935932 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-85f20893-2e83-4def-949e-524f4eeef5bc tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:20.936357 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-85f20893-2e83-4def-949e-524f4eeef5bc tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:21.123960 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-85f20893-2e83-4def-949e-524f4eeef5bc tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5055ddeab8314c93bb2a664f9d1a7f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f910065fc9da40798c7f3d4366dab7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:21.139647 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-85f20893-2e83-4def-949e-524f4eeef5bc tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] 10.222.0.84 "GET /compute/v2.1/servers/0402b684-55db-4c63-8142-de3fd0cc1503" status: 200 len: 1509 microversion: 2.1 time: 0.218125 Aug 24 11:33:21.160214 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 178/326] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:20 2022] GET /compute/v2.1/servers/0402b684-55db-4c63-8142-de3fd0cc1503 => generated 1509 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:33:21.541680 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-a8b200f7-542d-471e-894c-8e7bc5948c6f tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:21.543005 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-a8b200f7-542d-471e-894c-8e7bc5948c6f tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: 2d4527c9-c18c-4028-a452-d23423d9c4ee] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:21.555528 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a8b200f7-542d-471e-894c-8e7bc5948c6f tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:21.556166 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a8b200f7-542d-471e-894c-8e7bc5948c6f tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:21.556614 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a8b200f7-542d-471e-894c-8e7bc5948c6f tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:21.557354 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a8b200f7-542d-471e-894c-8e7bc5948c6f tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:21.557820 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a8b200f7-542d-471e-894c-8e7bc5948c6f tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:21.558246 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a8b200f7-542d-471e-894c-8e7bc5948c6f tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:21.798963 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-d350a729-c5d6-40cf-979a-492e79642075 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:21.800272 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-d350a729-c5d6-40cf-979a-492e79642075 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] [instance: 07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:21.809744 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-d350a729-c5d6-40cf-979a-492e79642075 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:21.810409 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-d350a729-c5d6-40cf-979a-492e79642075 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:21.811825 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-d350a729-c5d6-40cf-979a-492e79642075 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:21.812583 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-d350a729-c5d6-40cf-979a-492e79642075 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:21.813288 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-d350a729-c5d6-40cf-979a-492e79642075 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:21.813960 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-d350a729-c5d6-40cf-979a-492e79642075 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:22.038885 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-d350a729-c5d6-40cf-979a-492e79642075 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cef1a9e6a241ac8401b88f4a0f69fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901780013b03485a83261796f69e1b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:22.054966 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-d350a729-c5d6-40cf-979a-492e79642075 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] 10.222.0.84 "GET /compute/v2.1/servers/07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0" status: 200 len: 1553 microversion: 2.1 time: 0.263231 Aug 24 11:33:22.060477 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 179/327] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:21 2022] GET /compute/v2.1/servers/07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0 => generated 1553 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:33:22.104098 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-a8b200f7-542d-471e-894c-8e7bc5948c6f tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:22.115569 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-a8b200f7-542d-471e-894c-8e7bc5948c6f tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee" status: 200 len: 1521 microversion: 2.1 time: 0.583253 Aug 24 11:33:22.116181 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 149/328] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:21 2022] GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee => generated 1521 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:33:22.457347 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [req-077e3c4d-2b66-4885-8f68-85009d455084 req-f35d22e0-2bf9-40b0-b4b1-0b15b84c1d98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0", "name": "network-vif-deleted", "tag": "6b1e0c30-55ba-4a63-afed-d5e130d41fb3"}]} {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:33:22.462734 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG dbcounter [-] [124769] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1 {{(pid=124769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:22.469027 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [req-077e3c4d-2b66-4885-8f68-85009d455084 req-f35d22e0-2bf9-40b0-b4b1-0b15b84c1d98 service nova] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:22.469543 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [req-077e3c4d-2b66-4885-8f68-85009d455084 req-f35d22e0-2bf9-40b0-b4b1-0b15b84c1d98 service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:22.469955 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [req-077e3c4d-2b66-4885-8f68-85009d455084 req-f35d22e0-2bf9-40b0-b4b1-0b15b84c1d98 service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:22.484950 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.compute.server_external_events [req-077e3c4d-2b66-4885-8f68-85009d455084 req-f35d22e0-2bf9-40b0-b4b1-0b15b84c1d98 service nova] Creating event network-vif-deleted:6b1e0c30-55ba-4a63-afed-d5e130d41fb3 for instance 07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0 on hv-cinder-85427 Aug 24 11:33:22.492018 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [req-077e3c4d-2b66-4885-8f68-85009d455084 req-f35d22e0-2bf9-40b0-b4b1-0b15b84c1d98 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038114 Aug 24 11:33:22.493144 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 180/329] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Aug 24 11:33:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:33:23.090831 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-5152fbb7-3b8d-4d25-a37f-2ddb8d35896c tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:23.091983 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-5152fbb7-3b8d-4d25-a37f-2ddb8d35896c tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] [instance: 07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:23.100565 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5152fbb7-3b8d-4d25-a37f-2ddb8d35896c tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:23.101243 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5152fbb7-3b8d-4d25-a37f-2ddb8d35896c tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:23.101772 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5152fbb7-3b8d-4d25-a37f-2ddb8d35896c tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:23.102558 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5152fbb7-3b8d-4d25-a37f-2ddb8d35896c tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:23.103077 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5152fbb7-3b8d-4d25-a37f-2ddb8d35896c tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:23.103555 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5152fbb7-3b8d-4d25-a37f-2ddb8d35896c tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:23.144599 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-5224a709-8323-4d8d-99b8-e1a261f3b8be tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:23.150174 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-5224a709-8323-4d8d-99b8-e1a261f3b8be tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: 2d4527c9-c18c-4028-a452-d23423d9c4ee] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:23.152764 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-5224a709-8323-4d8d-99b8-e1a261f3b8be tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:23.153301 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-5224a709-8323-4d8d-99b8-e1a261f3b8be tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:23.153743 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-5224a709-8323-4d8d-99b8-e1a261f3b8be tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:23.155966 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-5224a709-8323-4d8d-99b8-e1a261f3b8be tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:23.156440 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-5224a709-8323-4d8d-99b8-e1a261f3b8be tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:23.156922 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-5224a709-8323-4d8d-99b8-e1a261f3b8be tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:23.179928 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-5152fbb7-3b8d-4d25-a37f-2ddb8d35896c tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cef1a9e6a241ac8401b88f4a0f69fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901780013b03485a83261796f69e1b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:23.191962 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-5152fbb7-3b8d-4d25-a37f-2ddb8d35896c tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] 10.222.0.84 "GET /compute/v2.1/servers/07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0" status: 200 len: 1345 microversion: 2.1 time: 0.105309 Aug 24 11:33:23.192560 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 150/330] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:23 2022] GET /compute/v2.1/servers/07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0 => generated 1345 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:33:23.345381 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-5224a709-8323-4d8d-99b8-e1a261f3b8be tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:23.354376 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-5224a709-8323-4d8d-99b8-e1a261f3b8be tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee" status: 200 len: 1521 microversion: 2.1 time: 0.215266 Aug 24 11:33:23.355166 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 181/331] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:23 2022] GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee => generated 1521 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:33:24.223236 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-394dee0a-ecfc-45aa-9e9c-cb5a93fa0c03 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:24.224459 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-394dee0a-ecfc-45aa-9e9c-cb5a93fa0c03 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] [instance: 07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:24.237628 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-394dee0a-ecfc-45aa-9e9c-cb5a93fa0c03 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:24.238581 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-394dee0a-ecfc-45aa-9e9c-cb5a93fa0c03 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:24.239410 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-394dee0a-ecfc-45aa-9e9c-cb5a93fa0c03 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:24.240955 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-394dee0a-ecfc-45aa-9e9c-cb5a93fa0c03 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:24.241897 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-394dee0a-ecfc-45aa-9e9c-cb5a93fa0c03 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:24.242785 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-394dee0a-ecfc-45aa-9e9c-cb5a93fa0c03 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:24.334448 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-394dee0a-ecfc-45aa-9e9c-cb5a93fa0c03 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cef1a9e6a241ac8401b88f4a0f69fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901780013b03485a83261796f69e1b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:24.343478 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-394dee0a-ecfc-45aa-9e9c-cb5a93fa0c03 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] 10.222.0.84 "GET /compute/v2.1/servers/07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0" status: 200 len: 1345 microversion: 2.1 time: 0.129706 Aug 24 11:33:24.344161 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 151/332] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:24 2022] GET /compute/v2.1/servers/07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0 => generated 1345 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:33:24.390846 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-26696598-e288-40f3-928f-da7bf8a30a99 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:24.392192 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-26696598-e288-40f3-928f-da7bf8a30a99 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: 2d4527c9-c18c-4028-a452-d23423d9c4ee] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:24.402267 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-26696598-e288-40f3-928f-da7bf8a30a99 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:24.403207 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-26696598-e288-40f3-928f-da7bf8a30a99 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:24.404389 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-26696598-e288-40f3-928f-da7bf8a30a99 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:24.406310 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-26696598-e288-40f3-928f-da7bf8a30a99 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:24.407146 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-26696598-e288-40f3-928f-da7bf8a30a99 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:24.408136 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-26696598-e288-40f3-928f-da7bf8a30a99 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:24.684112 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-26696598-e288-40f3-928f-da7bf8a30a99 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:24.699887 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-26696598-e288-40f3-928f-da7bf8a30a99 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee" status: 200 len: 1521 microversion: 2.1 time: 0.315465 Aug 24 11:33:24.700979 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 182/333] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:24 2022] GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee => generated 1521 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:33:25.369101 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-9b6c3507-0577-4455-b618-730f315a8a77 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:25.370160 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-9b6c3507-0577-4455-b618-730f315a8a77 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] [instance: 07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:25.377790 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9b6c3507-0577-4455-b618-730f315a8a77 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:25.378288 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9b6c3507-0577-4455-b618-730f315a8a77 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:25.379220 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9b6c3507-0577-4455-b618-730f315a8a77 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:25.379959 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9b6c3507-0577-4455-b618-730f315a8a77 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:25.380574 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9b6c3507-0577-4455-b618-730f315a8a77 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:25.381037 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9b6c3507-0577-4455-b618-730f315a8a77 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:25.410431 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_cell1:SELECT=100 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:25.442062 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9b6c3507-0577-4455-b618-730f315a8a77 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:25.442884 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9b6c3507-0577-4455-b618-730f315a8a77 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:25.444192 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9b6c3507-0577-4455-b618-730f315a8a77 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:25.445077 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.objects.instance [None req-9b6c3507-0577-4455-b618-730f315a8a77 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lazy-loading 'fault' on Instance uuid 07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0 {{(pid=124770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:33:25.537937 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-9b6c3507-0577-4455-b618-730f315a8a77 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cef1a9e6a241ac8401b88f4a0f69fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901780013b03485a83261796f69e1b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:25.559607 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-9b6c3507-0577-4455-b618-730f315a8a77 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] 10.222.0.84 "GET /compute/v2.1/servers/07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0" status: 200 len: 1350 microversion: 2.1 time: 0.191805 Aug 24 11:33:25.585998 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 152/334] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:25 2022] GET /compute/v2.1/servers/07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0 => generated 1350 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:33:25.727503 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-4b154c20-00ba-4883-a5be-c778ca7dd319 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:25.729392 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-4b154c20-00ba-4883-a5be-c778ca7dd319 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: 2d4527c9-c18c-4028-a452-d23423d9c4ee] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:25.739764 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-4b154c20-00ba-4883-a5be-c778ca7dd319 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:25.740533 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-4b154c20-00ba-4883-a5be-c778ca7dd319 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:25.741265 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-4b154c20-00ba-4883-a5be-c778ca7dd319 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:25.742296 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-4b154c20-00ba-4883-a5be-c778ca7dd319 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:25.743238 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-4b154c20-00ba-4883-a5be-c778ca7dd319 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:25.743907 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-4b154c20-00ba-4883-a5be-c778ca7dd319 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:25.964610 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-4b154c20-00ba-4883-a5be-c778ca7dd319 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:25.975989 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-4b154c20-00ba-4883-a5be-c778ca7dd319 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee" status: 200 len: 1521 microversion: 2.1 time: 0.255592 Aug 24 11:33:25.976592 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 183/335] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:25 2022] GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee => generated 1521 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:33:26.595951 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-8946014a-8307-449a-9d3f-b14072d76283 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:26.597729 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-8946014a-8307-449a-9d3f-b14072d76283 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] [instance: 07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:26.609188 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8946014a-8307-449a-9d3f-b14072d76283 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:26.609988 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8946014a-8307-449a-9d3f-b14072d76283 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:26.610712 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8946014a-8307-449a-9d3f-b14072d76283 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:26.611976 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8946014a-8307-449a-9d3f-b14072d76283 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:26.612765 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8946014a-8307-449a-9d3f-b14072d76283 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:26.613526 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8946014a-8307-449a-9d3f-b14072d76283 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:26.639786 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.wsgi [None req-8946014a-8307-449a-9d3f-b14072d76283 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] HTTP exception thrown: Instance 07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0 could not be found. Aug 24 11:33:26.645296 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-8946014a-8307-449a-9d3f-b14072d76283 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Request method failure captured: Aug 24 11:33:26.645296 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: request: GET /compute/v2.1/servers/07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0 HTTP/1.1 Aug 24 11:33:26.645296 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Accept: application/json Aug 24 11:33:26.645296 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Accept-Encoding: identity Aug 24 11:33:26.645296 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Connection: close Aug 24 11:33:26.645296 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Content-Length: 0 Aug 24 11:33:26.645296 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Content-Type: application/json Aug 24 11:33:26.645296 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Host: 10.222.0.84 Aug 24 11:33:26.645296 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Openstack-System-Scope: None Aug 24 11:33:26.645296 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: User-Agent: python-urllib3/1.26.11 Aug 24 11:33:26.645296 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Auth-Token: gAAAAABjBgwgdvqWKdmWKA2YlyzHNYaOwtsNDxlUkdJ96ro10CREhPu0O1AERn5ePKoXEG-C-E3LHRilmKqKS4zEW7ex98nS4LHvbyhI77n3SEiNXpsJTlyD0P7cXzmeWOd7AJEJtfgTwxFLw7P9lHdDD6TUs5qQM-LztnVJirhNUI-IrDt_eEI Aug 24 11:33:26.645296 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Domain-Id: None Aug 24 11:33:26.645296 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Domain-Name: None Aug 24 11:33:26.645296 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Identity-Status: Confirmed Aug 24 11:33:26.645296 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Is-Admin-Project: True Aug 24 11:33:26.645296 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Project-Domain-Id: default Aug 24 11:33:26.645296 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Project-Domain-Name: Default Aug 24 11:33:26.645296 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Project-Id: 901780013b03485a83261796f69e1b01 Aug 24 11:33:26.645296 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Project-Name: tempest-DeleteServersTestJSON-1522416775 Aug 24 11:33:26.645296 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Role: reader,member Aug 24 11:33:26.645296 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Roles: reader,member Aug 24 11:33:26.647929 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/volume/v3/901780013b03485a83261796f69e1b01"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/volume/v3/901780013b03485a83261796f69e1b01"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/compute/v2/901780013b03485a83261796f69e1b01"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84:8080/v1/AUTH_901780013b03485a83261796f69e1b01", "adminURL": "http://10.222.0.84:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/placement"}]}] Aug 24 11:33:26.647929 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Tenant: tempest-DeleteServersTestJSON-1522416775 Aug 24 11:33:26.647929 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Tenant-Id: 901780013b03485a83261796f69e1b01 Aug 24 11:33:26.647929 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Tenant-Name: tempest-DeleteServersTestJSON-1522416775 Aug 24 11:33:26.647929 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User: tempest-DeleteServersTestJSON-1522416775-project Aug 24 11:33:26.647929 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User-Domain-Id: default Aug 24 11:33:26.647929 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User-Domain-Name: Default Aug 24 11:33:26.647929 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User-Id: 77cef1a9e6a241ac8401b88f4a0f69fe Aug 24 11:33:26.647929 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User-Name: tempest-DeleteServersTestJSON-1522416775-project Aug 24 11:33:26.647929 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: method: > Aug 24 11:33:26.647929 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: exception: Instance 07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0 could not be found. Aug 24 11:33:26.647929 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: action_args: {'id': '07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0'} Aug 24 11:33:26.649548 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:33:26.649548 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:33:26.649548 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:33:26.649548 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:33:26.649548 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:33:26.649548 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:33:26.649548 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:33:26.649548 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:33:26.649548 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:33:26.649548 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:33:26.649548 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0 could not be found. Aug 24 11:33:26.649548 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:33:26.649548 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:33:26.649548 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:33:26.649548 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:33:26.649548 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:33:26.649548 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:33:26.649548 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:33:26.649548 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:33:26.649548 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:33:26.652273 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:33:26.652273 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:33:26.652273 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:33:26.652273 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:33:26.652273 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:33:26.652273 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:33:26.652273 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:33:26.652273 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0 could not be found. Aug 24 11:33:26.652273 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:33:26.652273 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:33:26.652273 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:33:26.652273 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:33:26.652273 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:33:26.652273 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:33:26.652273 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:33:26.652273 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:33:26.652273 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0 could not be found. Aug 24 11:33:26.652273 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:33:26.654715 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-8946014a-8307-449a-9d3f-b14072d76283 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Returning 404 to user: Instance 07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0 could not be found. {{(pid=124770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:33:26.654715 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-8946014a-8307-449a-9d3f-b14072d76283 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] 10.222.0.84 "GET /compute/v2.1/servers/07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0" status: 404 len: 111 microversion: 2.1 time: 0.056047 Aug 24 11:33:26.654715 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 153/336] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:26 2022] GET /compute/v2.1/servers/07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:33:26.788359 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-70878eb7-c226-4bcd-beb3-236bb32e5dd2 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:26.790782 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-70878eb7-c226-4bcd-beb3-236bb32e5dd2 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] [instance: 07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:26.797847 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-70878eb7-c226-4bcd-beb3-236bb32e5dd2 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:26.808664 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-70878eb7-c226-4bcd-beb3-236bb32e5dd2 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:26.808664 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-70878eb7-c226-4bcd-beb3-236bb32e5dd2 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:26.808664 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-70878eb7-c226-4bcd-beb3-236bb32e5dd2 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:26.808664 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-70878eb7-c226-4bcd-beb3-236bb32e5dd2 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:26.809938 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-70878eb7-c226-4bcd-beb3-236bb32e5dd2 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:26.820355 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.wsgi [None req-70878eb7-c226-4bcd-beb3-236bb32e5dd2 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] HTTP exception thrown: Instance 07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0 could not be found. Aug 24 11:33:26.824865 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-70878eb7-c226-4bcd-beb3-236bb32e5dd2 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Request method failure captured: Aug 24 11:33:26.824865 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: request: GET /compute/v2.1/servers/07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0/os-volume_attachments HTTP/1.1 Aug 24 11:33:26.824865 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Accept: application/json Aug 24 11:33:26.824865 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Accept-Encoding: identity Aug 24 11:33:26.824865 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Connection: close Aug 24 11:33:26.824865 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Content-Length: 0 Aug 24 11:33:26.824865 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Content-Type: application/json Aug 24 11:33:26.824865 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Host: 10.222.0.84 Aug 24 11:33:26.824865 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Openstack-System-Scope: None Aug 24 11:33:26.824865 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: User-Agent: python-urllib3/1.26.11 Aug 24 11:33:26.824865 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Auth-Token: gAAAAABjBgwgdvqWKdmWKA2YlyzHNYaOwtsNDxlUkdJ96ro10CREhPu0O1AERn5ePKoXEG-C-E3LHRilmKqKS4zEW7ex98nS4LHvbyhI77n3SEiNXpsJTlyD0P7cXzmeWOd7AJEJtfgTwxFLw7P9lHdDD6TUs5qQM-LztnVJirhNUI-IrDt_eEI Aug 24 11:33:26.824865 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Domain-Id: None Aug 24 11:33:26.824865 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Domain-Name: None Aug 24 11:33:26.824865 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Identity-Status: Confirmed Aug 24 11:33:26.824865 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Is-Admin-Project: True Aug 24 11:33:26.824865 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Project-Domain-Id: default Aug 24 11:33:26.824865 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Project-Domain-Name: Default Aug 24 11:33:26.824865 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Project-Id: 901780013b03485a83261796f69e1b01 Aug 24 11:33:26.824865 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Project-Name: tempest-DeleteServersTestJSON-1522416775 Aug 24 11:33:26.824865 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Role: reader,member Aug 24 11:33:26.824865 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Roles: reader,member Aug 24 11:33:26.827908 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/volume/v3/901780013b03485a83261796f69e1b01"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/volume/v3/901780013b03485a83261796f69e1b01"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/compute/v2/901780013b03485a83261796f69e1b01"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84:8080/v1/AUTH_901780013b03485a83261796f69e1b01", "adminURL": "http://10.222.0.84:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/placement"}]}] Aug 24 11:33:26.827908 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Tenant: tempest-DeleteServersTestJSON-1522416775 Aug 24 11:33:26.827908 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Tenant-Id: 901780013b03485a83261796f69e1b01 Aug 24 11:33:26.827908 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Tenant-Name: tempest-DeleteServersTestJSON-1522416775 Aug 24 11:33:26.827908 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-User: tempest-DeleteServersTestJSON-1522416775-project Aug 24 11:33:26.827908 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-User-Domain-Id: default Aug 24 11:33:26.827908 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-User-Domain-Name: Default Aug 24 11:33:26.827908 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-User-Id: 77cef1a9e6a241ac8401b88f4a0f69fe Aug 24 11:33:26.827908 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-User-Name: tempest-DeleteServersTestJSON-1522416775-project Aug 24 11:33:26.827908 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: method: > Aug 24 11:33:26.827908 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: exception: Instance 07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0 could not be found. Aug 24 11:33:26.827908 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: action_args: {'server_id': '07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0'} Aug 24 11:33:26.831994 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:33:26.831994 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:33:26.831994 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:33:26.831994 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:33:26.831994 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:33:26.831994 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:33:26.831994 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:33:26.831994 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:33:26.831994 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:33:26.831994 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:33:26.831994 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0 could not be found. Aug 24 11:33:26.831994 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Aug 24 11:33:26.831994 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:33:26.831994 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Aug 24 11:33:26.831994 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:33:26.831994 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:33:26.831994 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:33:26.831994 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:33:26.831994 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:33:26.831994 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:33:26.834276 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:33:26.834276 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 24 11:33:26.834276 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 11:33:26.834276 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 24 11:33:26.834276 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 11:33:26.834276 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 24 11:33:26.834276 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 24 11:33:26.834276 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:33:26.834276 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:33:26.834276 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0 could not be found. Aug 24 11:33:26.834276 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Aug 24 11:33:26.834276 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:33:26.834276 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Aug 24 11:33:26.834276 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:33:26.834276 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:33:26.834276 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:33:26.834276 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:33:26.834276 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:33:26.834276 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0 could not be found. Aug 24 11:33:26.834276 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Aug 24 11:33:26.836558 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-70878eb7-c226-4bcd-beb3-236bb32e5dd2 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Returning 404 to user: Instance 07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0 could not be found. {{(pid=124769) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:33:26.836558 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-70878eb7-c226-4bcd-beb3-236bb32e5dd2 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] 10.222.0.84 "GET /compute/v2.1/servers/07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.042389 Aug 24 11:33:26.836558 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 184/337] 10.222.0.84 () {58 vars in 1302 bytes} [Wed Aug 24 11:33:26 2022] GET /compute/v2.1/servers/07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0/os-volume_attachments => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 11:33:27.006269 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-3aa0b1f9-83b1-48e7-9ffe-a19605878b7a tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:27.007202 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-3aa0b1f9-83b1-48e7-9ffe-a19605878b7a tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: 2d4527c9-c18c-4028-a452-d23423d9c4ee] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:27.020528 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-3aa0b1f9-83b1-48e7-9ffe-a19605878b7a tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:27.021086 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-3aa0b1f9-83b1-48e7-9ffe-a19605878b7a tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:27.021526 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-3aa0b1f9-83b1-48e7-9ffe-a19605878b7a tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:27.022230 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-3aa0b1f9-83b1-48e7-9ffe-a19605878b7a tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:27.022687 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-3aa0b1f9-83b1-48e7-9ffe-a19605878b7a tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:27.023155 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-3aa0b1f9-83b1-48e7-9ffe-a19605878b7a tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:27.236372 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-3aa0b1f9-83b1-48e7-9ffe-a19605878b7a tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:27.250158 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-3aa0b1f9-83b1-48e7-9ffe-a19605878b7a tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee" status: 200 len: 1521 microversion: 2.1 time: 0.250091 Aug 24 11:33:27.252517 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 154/338] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:26 2022] GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee => generated 1521 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:33:28.283587 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-5a8fba63-bcc9-41be-ae22-292835dd26a1 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:28.284124 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-5a8fba63-bcc9-41be-ae22-292835dd26a1 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: 2d4527c9-c18c-4028-a452-d23423d9c4ee] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:28.290401 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-5a8fba63-bcc9-41be-ae22-292835dd26a1 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:28.290875 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-5a8fba63-bcc9-41be-ae22-292835dd26a1 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:28.291305 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-5a8fba63-bcc9-41be-ae22-292835dd26a1 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:28.292011 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-5a8fba63-bcc9-41be-ae22-292835dd26a1 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:28.292656 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-5a8fba63-bcc9-41be-ae22-292835dd26a1 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:28.293363 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-5a8fba63-bcc9-41be-ae22-292835dd26a1 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:28.475467 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-5a8fba63-bcc9-41be-ae22-292835dd26a1 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:28.488486 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-5a8fba63-bcc9-41be-ae22-292835dd26a1 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee" status: 200 len: 1521 microversion: 2.1 time: 0.209664 Aug 24 11:33:28.489545 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 185/339] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:28 2022] GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee => generated 1521 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:33:29.437463 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-58daa387-2799-40a6-909d-029a2cbba69e tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:29.438237 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-58daa387-2799-40a6-909d-029a2cbba69e tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] [instance: 07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:29.449228 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-58daa387-2799-40a6-909d-029a2cbba69e tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:29.453286 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-58daa387-2799-40a6-909d-029a2cbba69e tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:29.453286 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-58daa387-2799-40a6-909d-029a2cbba69e tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:29.453286 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-58daa387-2799-40a6-909d-029a2cbba69e tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:29.454106 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-58daa387-2799-40a6-909d-029a2cbba69e tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:29.454106 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-58daa387-2799-40a6-909d-029a2cbba69e tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:29.471647 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.wsgi [None req-58daa387-2799-40a6-909d-029a2cbba69e tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] HTTP exception thrown: Instance 07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0 could not be found. Aug 24 11:33:29.473384 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-58daa387-2799-40a6-909d-029a2cbba69e tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Request method failure captured: Aug 24 11:33:29.473384 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: request: DELETE /compute/v2.1/servers/07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0 HTTP/1.1 Aug 24 11:33:29.473384 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Accept: application/json Aug 24 11:33:29.473384 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Accept-Encoding: identity Aug 24 11:33:29.473384 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Connection: close Aug 24 11:33:29.473384 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Content-Length: 0 Aug 24 11:33:29.473384 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Content-Type: application/json Aug 24 11:33:29.473384 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Host: 10.222.0.84 Aug 24 11:33:29.473384 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Openstack-System-Scope: None Aug 24 11:33:29.473384 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: User-Agent: python-urllib3/1.26.11 Aug 24 11:33:29.473384 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Auth-Token: gAAAAABjBgwgdvqWKdmWKA2YlyzHNYaOwtsNDxlUkdJ96ro10CREhPu0O1AERn5ePKoXEG-C-E3LHRilmKqKS4zEW7ex98nS4LHvbyhI77n3SEiNXpsJTlyD0P7cXzmeWOd7AJEJtfgTwxFLw7P9lHdDD6TUs5qQM-LztnVJirhNUI-IrDt_eEI Aug 24 11:33:29.473384 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Domain-Id: None Aug 24 11:33:29.473384 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Domain-Name: None Aug 24 11:33:29.473384 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Identity-Status: Confirmed Aug 24 11:33:29.473384 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Is-Admin-Project: True Aug 24 11:33:29.473384 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Project-Domain-Id: default Aug 24 11:33:29.473384 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Project-Domain-Name: Default Aug 24 11:33:29.473384 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Project-Id: 901780013b03485a83261796f69e1b01 Aug 24 11:33:29.473384 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Project-Name: tempest-DeleteServersTestJSON-1522416775 Aug 24 11:33:29.473384 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Role: reader,member Aug 24 11:33:29.473384 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Roles: reader,member Aug 24 11:33:29.475930 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/volume/v3/901780013b03485a83261796f69e1b01"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/volume/v3/901780013b03485a83261796f69e1b01"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/compute/v2/901780013b03485a83261796f69e1b01"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84:8080/v1/AUTH_901780013b03485a83261796f69e1b01", "adminURL": "http://10.222.0.84:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/placement"}]}] Aug 24 11:33:29.475930 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Tenant: tempest-DeleteServersTestJSON-1522416775 Aug 24 11:33:29.475930 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Tenant-Id: 901780013b03485a83261796f69e1b01 Aug 24 11:33:29.475930 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Tenant-Name: tempest-DeleteServersTestJSON-1522416775 Aug 24 11:33:29.475930 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User: tempest-DeleteServersTestJSON-1522416775-project Aug 24 11:33:29.475930 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User-Domain-Id: default Aug 24 11:33:29.475930 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User-Domain-Name: Default Aug 24 11:33:29.475930 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User-Id: 77cef1a9e6a241ac8401b88f4a0f69fe Aug 24 11:33:29.475930 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User-Name: tempest-DeleteServersTestJSON-1522416775-project Aug 24 11:33:29.475930 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: method: > Aug 24 11:33:29.475930 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: exception: Instance 07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0 could not be found. Aug 24 11:33:29.475930 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: action_args: {'id': '07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0'} Aug 24 11:33:29.477317 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:33:29.477317 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:33:29.477317 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:33:29.477317 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:33:29.477317 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:33:29.477317 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:33:29.477317 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:33:29.477317 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:33:29.477317 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:33:29.477317 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:33:29.477317 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0 could not be found. Aug 24 11:33:29.477317 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:33:29.477317 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:33:29.477317 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:33:29.477317 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:33:29.477317 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:33:29.477317 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:33:29.477317 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:33:29.477317 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:33:29.477317 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:33:29.479475 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:33:29.479475 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 11:33:29.479475 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 11:33:29.479475 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 11:33:29.479475 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 11:33:29.479475 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:33:29.479475 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:33:29.479475 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:33:29.479475 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:33:29.479475 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0 could not be found. Aug 24 11:33:29.479475 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:33:29.479475 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:33:29.479475 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:33:29.479475 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:33:29.479475 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:33:29.479475 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:33:29.479475 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:33:29.479475 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:33:29.479475 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0 could not be found. Aug 24 11:33:29.479475 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:33:29.483450 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-58daa387-2799-40a6-909d-029a2cbba69e tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Returning 404 to user: Instance 07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0 could not be found. {{(pid=124770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:33:29.483450 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-58daa387-2799-40a6-909d-029a2cbba69e tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] 10.222.0.84 "DELETE /compute/v2.1/servers/07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0" status: 404 len: 111 microversion: 2.1 time: 0.044859 Aug 24 11:33:29.483450 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 155/340] 10.222.0.84 () {58 vars in 1239 bytes} [Wed Aug 24 11:33:29 2022] DELETE /compute/v2.1/servers/07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:33:29.486423 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-3460cbf7-292e-4d55-b63f-ace722f63680 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:29.487084 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-3460cbf7-292e-4d55-b63f-ace722f63680 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] [instance: 07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:29.493786 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-3460cbf7-292e-4d55-b63f-ace722f63680 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:29.495788 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-3460cbf7-292e-4d55-b63f-ace722f63680 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:29.496468 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-3460cbf7-292e-4d55-b63f-ace722f63680 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:29.497696 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-3460cbf7-292e-4d55-b63f-ace722f63680 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:29.498703 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-3460cbf7-292e-4d55-b63f-ace722f63680 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:29.499282 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-3460cbf7-292e-4d55-b63f-ace722f63680 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:29.516837 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-dfea4b4f-d10d-4c77-b6d2-a7bae11c05ff tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:29.517839 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-dfea4b4f-d10d-4c77-b6d2-a7bae11c05ff tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: 2d4527c9-c18c-4028-a452-d23423d9c4ee] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:29.518415 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.wsgi [None req-3460cbf7-292e-4d55-b63f-ace722f63680 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] HTTP exception thrown: Instance 07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0 could not be found. Aug 24 11:33:29.523841 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-3460cbf7-292e-4d55-b63f-ace722f63680 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Request method failure captured: Aug 24 11:33:29.523841 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: request: GET /compute/v2.1/servers/07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0 HTTP/1.1 Aug 24 11:33:29.523841 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Accept: application/json Aug 24 11:33:29.523841 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Accept-Encoding: identity Aug 24 11:33:29.523841 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Connection: close Aug 24 11:33:29.523841 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Content-Length: 0 Aug 24 11:33:29.523841 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Content-Type: application/json Aug 24 11:33:29.523841 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Host: 10.222.0.84 Aug 24 11:33:29.523841 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Openstack-System-Scope: None Aug 24 11:33:29.523841 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: User-Agent: python-urllib3/1.26.11 Aug 24 11:33:29.523841 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Auth-Token: gAAAAABjBgwgdvqWKdmWKA2YlyzHNYaOwtsNDxlUkdJ96ro10CREhPu0O1AERn5ePKoXEG-C-E3LHRilmKqKS4zEW7ex98nS4LHvbyhI77n3SEiNXpsJTlyD0P7cXzmeWOd7AJEJtfgTwxFLw7P9lHdDD6TUs5qQM-LztnVJirhNUI-IrDt_eEI Aug 24 11:33:29.523841 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Domain-Id: None Aug 24 11:33:29.523841 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Domain-Name: None Aug 24 11:33:29.523841 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Identity-Status: Confirmed Aug 24 11:33:29.523841 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Is-Admin-Project: True Aug 24 11:33:29.523841 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Project-Domain-Id: default Aug 24 11:33:29.523841 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Project-Domain-Name: Default Aug 24 11:33:29.523841 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Project-Id: 901780013b03485a83261796f69e1b01 Aug 24 11:33:29.523841 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Project-Name: tempest-DeleteServersTestJSON-1522416775 Aug 24 11:33:29.523841 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Role: reader,member Aug 24 11:33:29.523841 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Roles: reader,member Aug 24 11:33:29.525849 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/volume/v3/901780013b03485a83261796f69e1b01"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/volume/v3/901780013b03485a83261796f69e1b01"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/compute/v2/901780013b03485a83261796f69e1b01"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84:8080/v1/AUTH_901780013b03485a83261796f69e1b01", "adminURL": "http://10.222.0.84:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/placement"}]}] Aug 24 11:33:29.525849 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Tenant: tempest-DeleteServersTestJSON-1522416775 Aug 24 11:33:29.525849 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Tenant-Id: 901780013b03485a83261796f69e1b01 Aug 24 11:33:29.525849 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Tenant-Name: tempest-DeleteServersTestJSON-1522416775 Aug 24 11:33:29.525849 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-User: tempest-DeleteServersTestJSON-1522416775-project Aug 24 11:33:29.525849 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-User-Domain-Id: default Aug 24 11:33:29.525849 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-User-Domain-Name: Default Aug 24 11:33:29.525849 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-User-Id: 77cef1a9e6a241ac8401b88f4a0f69fe Aug 24 11:33:29.525849 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-User-Name: tempest-DeleteServersTestJSON-1522416775-project Aug 24 11:33:29.525849 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: method: > Aug 24 11:33:29.525849 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: exception: Instance 07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0 could not be found. Aug 24 11:33:29.525849 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: action_args: {'id': '07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0'} Aug 24 11:33:29.526508 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:33:29.526508 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:33:29.526508 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:33:29.526508 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:33:29.526508 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:33:29.526508 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:33:29.526508 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:33:29.526508 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:33:29.526508 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:33:29.526508 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:33:29.526508 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0 could not be found. Aug 24 11:33:29.526508 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Aug 24 11:33:29.526508 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:33:29.526508 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Aug 24 11:33:29.526508 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:33:29.526508 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:33:29.526508 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:33:29.526508 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:33:29.526508 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:33:29.526508 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:33:29.527541 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:33:29.527541 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:33:29.527541 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:33:29.527541 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:33:29.527541 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:33:29.527541 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:33:29.527541 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:33:29.527541 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0 could not be found. Aug 24 11:33:29.527541 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Aug 24 11:33:29.527541 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:33:29.527541 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Aug 24 11:33:29.527541 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:33:29.527541 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:33:29.527541 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:33:29.527541 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:33:29.527541 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:33:29.527541 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0 could not be found. Aug 24 11:33:29.527541 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Aug 24 11:33:29.530469 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-dfea4b4f-d10d-4c77-b6d2-a7bae11c05ff tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:29.530861 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-3460cbf7-292e-4d55-b63f-ace722f63680 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] Returning 404 to user: Instance 07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0 could not be found. {{(pid=124769) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:33:29.530995 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-dfea4b4f-d10d-4c77-b6d2-a7bae11c05ff tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:29.530995 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-dfea4b4f-d10d-4c77-b6d2-a7bae11c05ff tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:29.530995 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-dfea4b4f-d10d-4c77-b6d2-a7bae11c05ff tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:29.531345 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-3460cbf7-292e-4d55-b63f-ace722f63680 tempest-DeleteServersTestJSON-1522416775 tempest-DeleteServersTestJSON-1522416775-project] 10.222.0.84 "GET /compute/v2.1/servers/07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0" status: 404 len: 111 microversion: 2.1 time: 0.045071 Aug 24 11:33:29.531477 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-dfea4b4f-d10d-4c77-b6d2-a7bae11c05ff tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:29.531613 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 186/341] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:29 2022] GET /compute/v2.1/servers/07f7cbdf-d2ac-420b-b1f2-66bd8577cdc0 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:33:29.532530 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-dfea4b4f-d10d-4c77-b6d2-a7bae11c05ff tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:29.785078 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-dfea4b4f-d10d-4c77-b6d2-a7bae11c05ff tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:29.804716 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-dfea4b4f-d10d-4c77-b6d2-a7bae11c05ff tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee" status: 200 len: 1521 microversion: 2.1 time: 0.294770 Aug 24 11:33:29.806043 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 156/342] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:29 2022] GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee => generated 1521 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:33:30.835585 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-1ea7183d-825d-407b-81f9-4bd723f90b80 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:30.837291 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-1ea7183d-825d-407b-81f9-4bd723f90b80 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: 2d4527c9-c18c-4028-a452-d23423d9c4ee] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:30.862407 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-1ea7183d-825d-407b-81f9-4bd723f90b80 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:30.862407 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-1ea7183d-825d-407b-81f9-4bd723f90b80 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:30.862407 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-1ea7183d-825d-407b-81f9-4bd723f90b80 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:30.862407 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-1ea7183d-825d-407b-81f9-4bd723f90b80 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:30.862835 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-1ea7183d-825d-407b-81f9-4bd723f90b80 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:30.862835 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-1ea7183d-825d-407b-81f9-4bd723f90b80 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:31.159736 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-1ea7183d-825d-407b-81f9-4bd723f90b80 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:31.187445 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-1ea7183d-825d-407b-81f9-4bd723f90b80 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee" status: 200 len: 1521 microversion: 2.1 time: 0.361357 Aug 24 11:33:31.189186 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 187/343] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:30 2022] GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee => generated 1521 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:33:32.225711 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-1bbfece6-0b78-4536-8316-305a10fc9ed2 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:32.229217 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-1bbfece6-0b78-4536-8316-305a10fc9ed2 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: 2d4527c9-c18c-4028-a452-d23423d9c4ee] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:32.242713 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1bbfece6-0b78-4536-8316-305a10fc9ed2 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:32.243371 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1bbfece6-0b78-4536-8316-305a10fc9ed2 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:32.243964 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1bbfece6-0b78-4536-8316-305a10fc9ed2 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:32.245136 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1bbfece6-0b78-4536-8316-305a10fc9ed2 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:32.253170 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1bbfece6-0b78-4536-8316-305a10fc9ed2 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:32.253170 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1bbfece6-0b78-4536-8316-305a10fc9ed2 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:32.732860 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-1bbfece6-0b78-4536-8316-305a10fc9ed2 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:32.751620 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-1bbfece6-0b78-4536-8316-305a10fc9ed2 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee" status: 200 len: 1521 microversion: 2.1 time: 0.535807 Aug 24 11:33:32.752391 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 157/344] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:32 2022] GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee => generated 1521 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:33:33.807039 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-76f6c19e-1fef-4e20-b095-8f70a6aa6147 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:33.808789 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-76f6c19e-1fef-4e20-b095-8f70a6aa6147 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: 2d4527c9-c18c-4028-a452-d23423d9c4ee] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:33.850216 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-76f6c19e-1fef-4e20-b095-8f70a6aa6147 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:33.851125 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-76f6c19e-1fef-4e20-b095-8f70a6aa6147 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:33.852203 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-76f6c19e-1fef-4e20-b095-8f70a6aa6147 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:33.853809 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-76f6c19e-1fef-4e20-b095-8f70a6aa6147 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:33.855281 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-76f6c19e-1fef-4e20-b095-8f70a6aa6147 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:33.862943 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-76f6c19e-1fef-4e20-b095-8f70a6aa6147 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:34.119909 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-76f6c19e-1fef-4e20-b095-8f70a6aa6147 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:34.146886 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-76f6c19e-1fef-4e20-b095-8f70a6aa6147 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee" status: 200 len: 1521 microversion: 2.1 time: 0.355458 Aug 24 11:33:34.148249 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 188/345] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:33 2022] GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee => generated 1521 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:33:35.185961 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-2b631223-c3d7-4e55-aace-3c9fe246caed tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:35.187975 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-2b631223-c3d7-4e55-aace-3c9fe246caed tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: 2d4527c9-c18c-4028-a452-d23423d9c4ee] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:35.202578 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-2b631223-c3d7-4e55-aace-3c9fe246caed tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:35.204337 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-2b631223-c3d7-4e55-aace-3c9fe246caed tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:35.205434 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-2b631223-c3d7-4e55-aace-3c9fe246caed tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:35.206868 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-2b631223-c3d7-4e55-aace-3c9fe246caed tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:35.207796 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-2b631223-c3d7-4e55-aace-3c9fe246caed tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:35.208445 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-2b631223-c3d7-4e55-aace-3c9fe246caed tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:35.551149 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-2b631223-c3d7-4e55-aace-3c9fe246caed tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:35.571035 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-2b631223-c3d7-4e55-aace-3c9fe246caed tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee" status: 200 len: 1501 microversion: 2.1 time: 0.393619 Aug 24 11:33:35.587631 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 158/346] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:35 2022] GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee => generated 1501 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:33:35.601483 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-1f4fb18b-374d-42a5-8dee-e0657fc753f5 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:35.602402 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-1f4fb18b-374d-42a5-8dee-e0657fc753f5 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: 3a7e223c-57dd-4ecc-a81f-9f4802472f4f] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:35.626224 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-1f4fb18b-374d-42a5-8dee-e0657fc753f5 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:35.630048 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-1f4fb18b-374d-42a5-8dee-e0657fc753f5 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:35.630048 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-1f4fb18b-374d-42a5-8dee-e0657fc753f5 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:35.630903 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-1f4fb18b-374d-42a5-8dee-e0657fc753f5 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:35.631672 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-1f4fb18b-374d-42a5-8dee-e0657fc753f5 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:35.632546 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-1f4fb18b-374d-42a5-8dee-e0657fc753f5 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:36.266069 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-1f4fb18b-374d-42a5-8dee-e0657fc753f5 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:36.273503 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-1f4fb18b-374d-42a5-8dee-e0657fc753f5 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/3a7e223c-57dd-4ecc-a81f-9f4802472f4f" status: 200 len: 1516 microversion: 2.1 time: 0.677033 Aug 24 11:33:36.274104 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 189/347] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:35 2022] GET /compute/v2.1/servers/3a7e223c-57dd-4ecc-a81f-9f4802472f4f => generated 1516 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:33:41.360435 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-ea4ed91b-521e-4908-ae24-d2003275506f tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:33:41.363446 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-ea4ed91b-521e-4908-ae24-d2003275506f tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: 3a7e223c-57dd-4ecc-a81f-9f4802472f4f] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:41.373671 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ea4ed91b-521e-4908-ae24-d2003275506f tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:41.374163 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ea4ed91b-521e-4908-ae24-d2003275506f tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:41.374587 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ea4ed91b-521e-4908-ae24-d2003275506f tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:41.375293 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ea4ed91b-521e-4908-ae24-d2003275506f tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:41.375737 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ea4ed91b-521e-4908-ae24-d2003275506f tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:41.376158 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ea4ed91b-521e-4908-ae24-d2003275506f tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:41.406768 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.objects.instance [None req-ea4ed91b-521e-4908-ae24-d2003275506f tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lazy-loading 'flavor' on Instance uuid 3a7e223c-57dd-4ecc-a81f-9f4802472f4f {{(pid=124770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:33:42.042729 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-ea4ed91b-521e-4908-ae24-d2003275506f tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "POST /compute/v2.1/servers/3a7e223c-57dd-4ecc-a81f-9f4802472f4f/action" status: 200 len: 32 microversion: 2.1 time: 0.687627 Aug 24 11:33:42.043252 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 159/348] 10.222.0.84 () {60 vars in 1278 bytes} [Wed Aug 24 11:33:41 2022] POST /compute/v2.1/servers/3a7e223c-57dd-4ecc-a81f-9f4802472f4f/action => generated 32 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 24 11:33:42.058627 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-1a138bde-d6e8-40c5-87f6-19231928137a tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:42.060281 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-1a138bde-d6e8-40c5-87f6-19231928137a tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: 3a7e223c-57dd-4ecc-a81f-9f4802472f4f] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:42.068100 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-1a138bde-d6e8-40c5-87f6-19231928137a tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:42.068613 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-1a138bde-d6e8-40c5-87f6-19231928137a tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:42.069078 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-1a138bde-d6e8-40c5-87f6-19231928137a tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:42.069767 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-1a138bde-d6e8-40c5-87f6-19231928137a tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:42.070563 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-1a138bde-d6e8-40c5-87f6-19231928137a tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:42.071054 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-1a138bde-d6e8-40c5-87f6-19231928137a tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:42.076231 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG dbcounter [-] [124769] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:42.233451 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-1a138bde-d6e8-40c5-87f6-19231928137a tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:42.248756 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-1a138bde-d6e8-40c5-87f6-19231928137a tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/3a7e223c-57dd-4ecc-a81f-9f4802472f4f" status: 200 len: 1522 microversion: 2.1 time: 0.196259 Aug 24 11:33:42.249790 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 190/349] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:42 2022] GET /compute/v2.1/servers/3a7e223c-57dd-4ecc-a81f-9f4802472f4f => generated 1522 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:33:43.279204 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-28d89716-e38f-41f8-a336-28a22ec446c8 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:43.280519 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-28d89716-e38f-41f8-a336-28a22ec446c8 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: 3a7e223c-57dd-4ecc-a81f-9f4802472f4f] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:43.287004 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-28d89716-e38f-41f8-a336-28a22ec446c8 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:43.287489 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-28d89716-e38f-41f8-a336-28a22ec446c8 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:43.288027 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-28d89716-e38f-41f8-a336-28a22ec446c8 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:43.288740 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-28d89716-e38f-41f8-a336-28a22ec446c8 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:43.289243 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-28d89716-e38f-41f8-a336-28a22ec446c8 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:43.289670 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-28d89716-e38f-41f8-a336-28a22ec446c8 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:43.433307 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-28d89716-e38f-41f8-a336-28a22ec446c8 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:43.441855 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-28d89716-e38f-41f8-a336-28a22ec446c8 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/3a7e223c-57dd-4ecc-a81f-9f4802472f4f" status: 200 len: 1522 microversion: 2.1 time: 0.167469 Aug 24 11:33:43.442420 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 160/350] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:43 2022] GET /compute/v2.1/servers/3a7e223c-57dd-4ecc-a81f-9f4802472f4f => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:33:44.463790 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-ad86e8ad-988f-48db-9b6b-9938eea35b67 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:44.464530 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-ad86e8ad-988f-48db-9b6b-9938eea35b67 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: 3a7e223c-57dd-4ecc-a81f-9f4802472f4f] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:44.472203 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-ad86e8ad-988f-48db-9b6b-9938eea35b67 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:44.472685 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-ad86e8ad-988f-48db-9b6b-9938eea35b67 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:44.473174 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-ad86e8ad-988f-48db-9b6b-9938eea35b67 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:44.473863 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-ad86e8ad-988f-48db-9b6b-9938eea35b67 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:44.474323 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-ad86e8ad-988f-48db-9b6b-9938eea35b67 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:44.474744 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-ad86e8ad-988f-48db-9b6b-9938eea35b67 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:44.651661 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-ad86e8ad-988f-48db-9b6b-9938eea35b67 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:44.674653 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-ad86e8ad-988f-48db-9b6b-9938eea35b67 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/3a7e223c-57dd-4ecc-a81f-9f4802472f4f" status: 200 len: 1522 microversion: 2.1 time: 0.214794 Aug 24 11:33:44.677307 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 191/351] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:44 2022] GET /compute/v2.1/servers/3a7e223c-57dd-4ecc-a81f-9f4802472f4f => generated 1522 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:33:45.712263 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-5165dd16-7090-499f-9d00-50b9dfed500a tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:45.712263 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-5165dd16-7090-499f-9d00-50b9dfed500a tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: 3a7e223c-57dd-4ecc-a81f-9f4802472f4f] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:45.715865 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5165dd16-7090-499f-9d00-50b9dfed500a tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:45.716583 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5165dd16-7090-499f-9d00-50b9dfed500a tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:45.717122 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5165dd16-7090-499f-9d00-50b9dfed500a tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:45.717957 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5165dd16-7090-499f-9d00-50b9dfed500a tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:45.718830 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5165dd16-7090-499f-9d00-50b9dfed500a tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:45.719368 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5165dd16-7090-499f-9d00-50b9dfed500a tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:45.908682 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-5165dd16-7090-499f-9d00-50b9dfed500a tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:45.923193 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-5165dd16-7090-499f-9d00-50b9dfed500a tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/3a7e223c-57dd-4ecc-a81f-9f4802472f4f" status: 200 len: 1522 microversion: 2.1 time: 0.229047 Aug 24 11:33:45.924369 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 161/352] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:45 2022] GET /compute/v2.1/servers/3a7e223c-57dd-4ecc-a81f-9f4802472f4f => generated 1522 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:33:46.955140 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-a43956a0-3854-4da8-8430-929a734b989d tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:46.957341 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-a43956a0-3854-4da8-8430-929a734b989d tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: 3a7e223c-57dd-4ecc-a81f-9f4802472f4f] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:46.967640 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-a43956a0-3854-4da8-8430-929a734b989d tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:46.968704 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-a43956a0-3854-4da8-8430-929a734b989d tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:46.970854 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-a43956a0-3854-4da8-8430-929a734b989d tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:46.972155 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-a43956a0-3854-4da8-8430-929a734b989d tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:46.978513 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-a43956a0-3854-4da8-8430-929a734b989d tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:46.978513 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-a43956a0-3854-4da8-8430-929a734b989d tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:47.244261 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-a43956a0-3854-4da8-8430-929a734b989d tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:47.260720 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-a43956a0-3854-4da8-8430-929a734b989d tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/3a7e223c-57dd-4ecc-a81f-9f4802472f4f" status: 200 len: 1522 microversion: 2.1 time: 0.312154 Aug 24 11:33:47.273832 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 192/353] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:46 2022] GET /compute/v2.1/servers/3a7e223c-57dd-4ecc-a81f-9f4802472f4f => generated 1522 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:33:48.291474 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-6342207e-fb81-4fd7-bb39-508a323594c5 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:48.292272 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-6342207e-fb81-4fd7-bb39-508a323594c5 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: 3a7e223c-57dd-4ecc-a81f-9f4802472f4f] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:48.295405 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_api:SELECT=40 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:48.301086 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6342207e-fb81-4fd7-bb39-508a323594c5 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:48.301555 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6342207e-fb81-4fd7-bb39-508a323594c5 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:48.301999 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6342207e-fb81-4fd7-bb39-508a323594c5 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:48.302712 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6342207e-fb81-4fd7-bb39-508a323594c5 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:48.303171 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6342207e-fb81-4fd7-bb39-508a323594c5 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:48.303596 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6342207e-fb81-4fd7-bb39-508a323594c5 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:48.510175 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-6342207e-fb81-4fd7-bb39-508a323594c5 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:48.533674 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-6342207e-fb81-4fd7-bb39-508a323594c5 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/3a7e223c-57dd-4ecc-a81f-9f4802472f4f" status: 200 len: 1522 microversion: 2.1 time: 0.245597 Aug 24 11:33:48.553152 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 162/354] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:48 2022] GET /compute/v2.1/servers/3a7e223c-57dd-4ecc-a81f-9f4802472f4f => generated 1522 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:33:49.569140 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-1a820529-185b-46f9-a3c7-13877db320dd tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:49.570223 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-1a820529-185b-46f9-a3c7-13877db320dd tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: 3a7e223c-57dd-4ecc-a81f-9f4802472f4f] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:49.577824 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-1a820529-185b-46f9-a3c7-13877db320dd tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:49.578395 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-1a820529-185b-46f9-a3c7-13877db320dd tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:49.578913 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-1a820529-185b-46f9-a3c7-13877db320dd tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:49.579702 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-1a820529-185b-46f9-a3c7-13877db320dd tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:49.580163 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-1a820529-185b-46f9-a3c7-13877db320dd tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:49.580597 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-1a820529-185b-46f9-a3c7-13877db320dd tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:49.745942 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-1a820529-185b-46f9-a3c7-13877db320dd tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:49.758162 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-1a820529-185b-46f9-a3c7-13877db320dd tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/3a7e223c-57dd-4ecc-a81f-9f4802472f4f" status: 200 len: 1522 microversion: 2.1 time: 0.196374 Aug 24 11:33:49.758788 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 193/355] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:49 2022] GET /compute/v2.1/servers/3a7e223c-57dd-4ecc-a81f-9f4802472f4f => generated 1522 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:33:50.791396 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-c197e4d7-d80a-446d-b9a7-dce900977b55 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:50.791995 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-c197e4d7-d80a-446d-b9a7-dce900977b55 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: 3a7e223c-57dd-4ecc-a81f-9f4802472f4f] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:50.799800 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c197e4d7-d80a-446d-b9a7-dce900977b55 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:50.800287 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c197e4d7-d80a-446d-b9a7-dce900977b55 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:50.800724 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c197e4d7-d80a-446d-b9a7-dce900977b55 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:50.801539 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c197e4d7-d80a-446d-b9a7-dce900977b55 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:50.801992 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c197e4d7-d80a-446d-b9a7-dce900977b55 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:50.802413 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c197e4d7-d80a-446d-b9a7-dce900977b55 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:50.957337 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-c197e4d7-d80a-446d-b9a7-dce900977b55 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:50.966163 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-c197e4d7-d80a-446d-b9a7-dce900977b55 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/3a7e223c-57dd-4ecc-a81f-9f4802472f4f" status: 200 len: 1522 microversion: 2.1 time: 0.177916 Aug 24 11:33:50.966746 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 163/356] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:50 2022] GET /compute/v2.1/servers/3a7e223c-57dd-4ecc-a81f-9f4802472f4f => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:33:51.988095 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-0d4a7057-2c23-4948-a45b-2698935176cf tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:51.988627 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-0d4a7057-2c23-4948-a45b-2698935176cf tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: 3a7e223c-57dd-4ecc-a81f-9f4802472f4f] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:51.994979 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-0d4a7057-2c23-4948-a45b-2698935176cf tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:51.995460 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-0d4a7057-2c23-4948-a45b-2698935176cf tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:51.995904 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-0d4a7057-2c23-4948-a45b-2698935176cf tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:51.996661 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-0d4a7057-2c23-4948-a45b-2698935176cf tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:51.997211 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-0d4a7057-2c23-4948-a45b-2698935176cf tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:51.997621 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-0d4a7057-2c23-4948-a45b-2698935176cf tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:52.144067 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-0d4a7057-2c23-4948-a45b-2698935176cf tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:52.154450 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-0d4a7057-2c23-4948-a45b-2698935176cf tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/3a7e223c-57dd-4ecc-a81f-9f4802472f4f" status: 200 len: 1522 microversion: 2.1 time: 0.168659 Aug 24 11:33:52.154450 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 194/357] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:51 2022] GET /compute/v2.1/servers/3a7e223c-57dd-4ecc-a81f-9f4802472f4f => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:33:53.177226 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-06bdda29-340e-4b7e-a19b-41f73291b696 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:53.178624 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-06bdda29-340e-4b7e-a19b-41f73291b696 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: 3a7e223c-57dd-4ecc-a81f-9f4802472f4f] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:53.187464 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-06bdda29-340e-4b7e-a19b-41f73291b696 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:53.188355 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-06bdda29-340e-4b7e-a19b-41f73291b696 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:53.188828 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-06bdda29-340e-4b7e-a19b-41f73291b696 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:53.189531 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-06bdda29-340e-4b7e-a19b-41f73291b696 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:53.189987 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-06bdda29-340e-4b7e-a19b-41f73291b696 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:53.190416 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-06bdda29-340e-4b7e-a19b-41f73291b696 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:53.346150 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-06bdda29-340e-4b7e-a19b-41f73291b696 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:53.359608 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-06bdda29-340e-4b7e-a19b-41f73291b696 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/3a7e223c-57dd-4ecc-a81f-9f4802472f4f" status: 200 len: 1522 microversion: 2.1 time: 0.187375 Aug 24 11:33:53.360617 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 164/358] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:53 2022] GET /compute/v2.1/servers/3a7e223c-57dd-4ecc-a81f-9f4802472f4f => generated 1522 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:33:54.387744 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-76356337-8e28-4c14-a8b8-2325e849b716 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:54.388354 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-76356337-8e28-4c14-a8b8-2325e849b716 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: 3a7e223c-57dd-4ecc-a81f-9f4802472f4f] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:54.390607 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG dbcounter [-] [124769] Writing DB stats nova_api:SELECT=30 {{(pid=124769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:54.395303 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-76356337-8e28-4c14-a8b8-2325e849b716 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:54.395788 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-76356337-8e28-4c14-a8b8-2325e849b716 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:54.396230 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-76356337-8e28-4c14-a8b8-2325e849b716 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:54.397057 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-76356337-8e28-4c14-a8b8-2325e849b716 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:54.397521 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-76356337-8e28-4c14-a8b8-2325e849b716 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:54.397955 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-76356337-8e28-4c14-a8b8-2325e849b716 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:54.537979 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-76356337-8e28-4c14-a8b8-2325e849b716 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:54.546036 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-76356337-8e28-4c14-a8b8-2325e849b716 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/3a7e223c-57dd-4ecc-a81f-9f4802472f4f" status: 200 len: 1522 microversion: 2.1 time: 0.162196 Aug 24 11:33:54.546596 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 195/359] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:54 2022] GET /compute/v2.1/servers/3a7e223c-57dd-4ecc-a81f-9f4802472f4f => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:33:55.570558 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-8df55c2b-b894-4243-adba-486a4fa69a53 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:55.571248 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-8df55c2b-b894-4243-adba-486a4fa69a53 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: 3a7e223c-57dd-4ecc-a81f-9f4802472f4f] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:55.580037 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8df55c2b-b894-4243-adba-486a4fa69a53 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:55.580701 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8df55c2b-b894-4243-adba-486a4fa69a53 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:55.581358 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8df55c2b-b894-4243-adba-486a4fa69a53 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:55.582272 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8df55c2b-b894-4243-adba-486a4fa69a53 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:55.582847 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8df55c2b-b894-4243-adba-486a4fa69a53 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:55.583444 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8df55c2b-b894-4243-adba-486a4fa69a53 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:55.587239 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:55.796431 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-8df55c2b-b894-4243-adba-486a4fa69a53 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:55.805921 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-8df55c2b-b894-4243-adba-486a4fa69a53 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/3a7e223c-57dd-4ecc-a81f-9f4802472f4f" status: 200 len: 1522 microversion: 2.1 time: 0.241215 Aug 24 11:33:55.806603 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 165/360] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:55 2022] GET /compute/v2.1/servers/3a7e223c-57dd-4ecc-a81f-9f4802472f4f => generated 1522 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:33:56.835426 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-f949b09c-9e08-480c-a53b-9fccb6bb7895 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:56.836131 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-f949b09c-9e08-480c-a53b-9fccb6bb7895 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: 3a7e223c-57dd-4ecc-a81f-9f4802472f4f] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:56.842759 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f949b09c-9e08-480c-a53b-9fccb6bb7895 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:56.843247 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f949b09c-9e08-480c-a53b-9fccb6bb7895 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:56.843683 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f949b09c-9e08-480c-a53b-9fccb6bb7895 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:56.844474 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f949b09c-9e08-480c-a53b-9fccb6bb7895 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:56.844954 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f949b09c-9e08-480c-a53b-9fccb6bb7895 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:56.845382 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f949b09c-9e08-480c-a53b-9fccb6bb7895 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:56.991119 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-f949b09c-9e08-480c-a53b-9fccb6bb7895 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:56.999792 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-f949b09c-9e08-480c-a53b-9fccb6bb7895 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/3a7e223c-57dd-4ecc-a81f-9f4802472f4f" status: 200 len: 1522 microversion: 2.1 time: 0.168192 Aug 24 11:33:57.000382 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 196/361] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:56 2022] GET /compute/v2.1/servers/3a7e223c-57dd-4ecc-a81f-9f4802472f4f => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:33:58.020939 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-76f22ff0-2604-4949-a2d9-294c4b676d6e tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:58.021624 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-76f22ff0-2604-4949-a2d9-294c4b676d6e tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: 3a7e223c-57dd-4ecc-a81f-9f4802472f4f] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:58.028171 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-76f22ff0-2604-4949-a2d9-294c4b676d6e tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:58.028717 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-76f22ff0-2604-4949-a2d9-294c4b676d6e tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:58.029194 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-76f22ff0-2604-4949-a2d9-294c4b676d6e tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:58.031074 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-76f22ff0-2604-4949-a2d9-294c4b676d6e tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:58.031673 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-76f22ff0-2604-4949-a2d9-294c4b676d6e tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:58.032149 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-76f22ff0-2604-4949-a2d9-294c4b676d6e tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:58.181769 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-76f22ff0-2604-4949-a2d9-294c4b676d6e tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:58.181769 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-76f22ff0-2604-4949-a2d9-294c4b676d6e tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/3a7e223c-57dd-4ecc-a81f-9f4802472f4f" status: 200 len: 1522 microversion: 2.1 time: 0.161155 Aug 24 11:33:58.181769 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 166/362] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:58 2022] GET /compute/v2.1/servers/3a7e223c-57dd-4ecc-a81f-9f4802472f4f => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:33:59.203318 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-93256aa3-e86c-449c-81ed-02b11c8dfde3 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:59.203948 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-93256aa3-e86c-449c-81ed-02b11c8dfde3 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: 3a7e223c-57dd-4ecc-a81f-9f4802472f4f] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:59.210088 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-93256aa3-e86c-449c-81ed-02b11c8dfde3 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:59.210564 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-93256aa3-e86c-449c-81ed-02b11c8dfde3 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:59.211030 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-93256aa3-e86c-449c-81ed-02b11c8dfde3 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:59.211724 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-93256aa3-e86c-449c-81ed-02b11c8dfde3 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:59.212159 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-93256aa3-e86c-449c-81ed-02b11c8dfde3 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:59.212586 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-93256aa3-e86c-449c-81ed-02b11c8dfde3 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:59.365733 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-93256aa3-e86c-449c-81ed-02b11c8dfde3 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:59.373767 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-93256aa3-e86c-449c-81ed-02b11c8dfde3 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/3a7e223c-57dd-4ecc-a81f-9f4802472f4f" status: 200 len: 1522 microversion: 2.1 time: 0.175335 Aug 24 11:33:59.374333 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 197/363] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:59 2022] GET /compute/v2.1/servers/3a7e223c-57dd-4ecc-a81f-9f4802472f4f => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:34:00.394582 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-16fee3b3-8215-4fd5-a335-4c497d46fddb tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:00.395376 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-16fee3b3-8215-4fd5-a335-4c497d46fddb tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: 3a7e223c-57dd-4ecc-a81f-9f4802472f4f] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:34:00.402594 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-16fee3b3-8215-4fd5-a335-4c497d46fddb tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:00.406529 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-16fee3b3-8215-4fd5-a335-4c497d46fddb tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:00.406529 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-16fee3b3-8215-4fd5-a335-4c497d46fddb tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:00.406529 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-16fee3b3-8215-4fd5-a335-4c497d46fddb tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:00.406529 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-16fee3b3-8215-4fd5-a335-4c497d46fddb tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:00.406903 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-16fee3b3-8215-4fd5-a335-4c497d46fddb tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:00.547043 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-16fee3b3-8215-4fd5-a335-4c497d46fddb tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:34:00.554775 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-16fee3b3-8215-4fd5-a335-4c497d46fddb tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/3a7e223c-57dd-4ecc-a81f-9f4802472f4f" status: 200 len: 1522 microversion: 2.1 time: 0.164060 Aug 24 11:34:00.555431 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 167/364] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:34:00 2022] GET /compute/v2.1/servers/3a7e223c-57dd-4ecc-a81f-9f4802472f4f => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:34:01.578150 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-033c5bce-b622-4d72-8c36-e2a487d4b3bb tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:01.579057 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-033c5bce-b622-4d72-8c36-e2a487d4b3bb tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: 3a7e223c-57dd-4ecc-a81f-9f4802472f4f] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:34:01.585180 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-033c5bce-b622-4d72-8c36-e2a487d4b3bb tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:01.585669 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-033c5bce-b622-4d72-8c36-e2a487d4b3bb tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:01.586105 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-033c5bce-b622-4d72-8c36-e2a487d4b3bb tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:01.588179 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-033c5bce-b622-4d72-8c36-e2a487d4b3bb tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:01.588179 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-033c5bce-b622-4d72-8c36-e2a487d4b3bb tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:01.588179 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-033c5bce-b622-4d72-8c36-e2a487d4b3bb tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:01.733820 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-033c5bce-b622-4d72-8c36-e2a487d4b3bb tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:34:01.741708 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-033c5bce-b622-4d72-8c36-e2a487d4b3bb tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/3a7e223c-57dd-4ecc-a81f-9f4802472f4f" status: 200 len: 1522 microversion: 2.1 time: 0.168402 Aug 24 11:34:01.742278 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 198/365] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:34:01 2022] GET /compute/v2.1/servers/3a7e223c-57dd-4ecc-a81f-9f4802472f4f => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:34:02.765218 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-e0c83f50-8c2e-4bc8-8c02-258e0c7a5381 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:02.765791 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-e0c83f50-8c2e-4bc8-8c02-258e0c7a5381 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: 3a7e223c-57dd-4ecc-a81f-9f4802472f4f] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:34:02.772084 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e0c83f50-8c2e-4bc8-8c02-258e0c7a5381 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:02.772564 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e0c83f50-8c2e-4bc8-8c02-258e0c7a5381 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:02.773116 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e0c83f50-8c2e-4bc8-8c02-258e0c7a5381 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:02.773809 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e0c83f50-8c2e-4bc8-8c02-258e0c7a5381 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:02.774263 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e0c83f50-8c2e-4bc8-8c02-258e0c7a5381 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:02.774691 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e0c83f50-8c2e-4bc8-8c02-258e0c7a5381 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:02.913125 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-e0c83f50-8c2e-4bc8-8c02-258e0c7a5381 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:34:02.922277 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-e0c83f50-8c2e-4bc8-8c02-258e0c7a5381 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/3a7e223c-57dd-4ecc-a81f-9f4802472f4f" status: 200 len: 1522 microversion: 2.1 time: 0.161658 Aug 24 11:34:02.922867 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 168/366] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:34:02 2022] GET /compute/v2.1/servers/3a7e223c-57dd-4ecc-a81f-9f4802472f4f => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:34:03.946607 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-4ba9e833-92ff-4117-b897-36fdc00718d8 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:03.947224 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-4ba9e833-92ff-4117-b897-36fdc00718d8 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: 3a7e223c-57dd-4ecc-a81f-9f4802472f4f] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:34:03.954263 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-4ba9e833-92ff-4117-b897-36fdc00718d8 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:03.954766 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-4ba9e833-92ff-4117-b897-36fdc00718d8 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:03.955199 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-4ba9e833-92ff-4117-b897-36fdc00718d8 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:03.955900 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-4ba9e833-92ff-4117-b897-36fdc00718d8 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:03.956409 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-4ba9e833-92ff-4117-b897-36fdc00718d8 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:03.956887 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-4ba9e833-92ff-4117-b897-36fdc00718d8 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:04.098305 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-4ba9e833-92ff-4117-b897-36fdc00718d8 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:34:04.107291 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-4ba9e833-92ff-4117-b897-36fdc00718d8 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/3a7e223c-57dd-4ecc-a81f-9f4802472f4f" status: 200 len: 1522 microversion: 2.1 time: 0.164642 Aug 24 11:34:04.107871 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 199/367] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:34:03 2022] GET /compute/v2.1/servers/3a7e223c-57dd-4ecc-a81f-9f4802472f4f => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:34:05.129406 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-7817ae8f-d13f-4099-b52d-3f362e43314d tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:05.130041 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-7817ae8f-d13f-4099-b52d-3f362e43314d tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: 3a7e223c-57dd-4ecc-a81f-9f4802472f4f] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:34:05.137661 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-7817ae8f-d13f-4099-b52d-3f362e43314d tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:05.138242 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-7817ae8f-d13f-4099-b52d-3f362e43314d tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:05.138750 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-7817ae8f-d13f-4099-b52d-3f362e43314d tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:05.139461 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-7817ae8f-d13f-4099-b52d-3f362e43314d tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:05.139915 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-7817ae8f-d13f-4099-b52d-3f362e43314d tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:05.140336 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-7817ae8f-d13f-4099-b52d-3f362e43314d tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:05.282720 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-7817ae8f-d13f-4099-b52d-3f362e43314d tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:34:05.291177 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-7817ae8f-d13f-4099-b52d-3f362e43314d tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/3a7e223c-57dd-4ecc-a81f-9f4802472f4f" status: 200 len: 1522 microversion: 2.1 time: 0.165524 Aug 24 11:34:05.292034 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 169/368] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:34:05 2022] GET /compute/v2.1/servers/3a7e223c-57dd-4ecc-a81f-9f4802472f4f => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:34:06.312917 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-a2d538be-ddde-4765-b66e-f48351362afe tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:06.313531 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-a2d538be-ddde-4765-b66e-f48351362afe tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: 3a7e223c-57dd-4ecc-a81f-9f4802472f4f] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:34:06.319811 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-a2d538be-ddde-4765-b66e-f48351362afe tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:06.320299 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-a2d538be-ddde-4765-b66e-f48351362afe tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:06.320739 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-a2d538be-ddde-4765-b66e-f48351362afe tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:06.321455 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-a2d538be-ddde-4765-b66e-f48351362afe tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:06.321908 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-a2d538be-ddde-4765-b66e-f48351362afe tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:06.322338 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-a2d538be-ddde-4765-b66e-f48351362afe tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:06.469749 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-a2d538be-ddde-4765-b66e-f48351362afe tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:34:06.478029 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-a2d538be-ddde-4765-b66e-f48351362afe tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/3a7e223c-57dd-4ecc-a81f-9f4802472f4f" status: 200 len: 1522 microversion: 2.1 time: 0.168899 Aug 24 11:34:06.478717 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 200/369] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:34:06 2022] GET /compute/v2.1/servers/3a7e223c-57dd-4ecc-a81f-9f4802472f4f => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:34:07.501174 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-2eee764d-9db0-49e6-b99c-c3df24f6d04f tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:07.501868 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-2eee764d-9db0-49e6-b99c-c3df24f6d04f tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: 3a7e223c-57dd-4ecc-a81f-9f4802472f4f] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:34:07.509569 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-2eee764d-9db0-49e6-b99c-c3df24f6d04f tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:07.510058 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-2eee764d-9db0-49e6-b99c-c3df24f6d04f tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:07.510485 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-2eee764d-9db0-49e6-b99c-c3df24f6d04f tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:07.511285 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-2eee764d-9db0-49e6-b99c-c3df24f6d04f tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:07.511948 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-2eee764d-9db0-49e6-b99c-c3df24f6d04f tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:07.512384 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-2eee764d-9db0-49e6-b99c-c3df24f6d04f tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:07.665215 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-2eee764d-9db0-49e6-b99c-c3df24f6d04f tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:34:07.680365 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-2eee764d-9db0-49e6-b99c-c3df24f6d04f tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/3a7e223c-57dd-4ecc-a81f-9f4802472f4f" status: 200 len: 1522 microversion: 2.1 time: 0.183454 Aug 24 11:34:07.681555 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 170/370] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:34:07 2022] GET /compute/v2.1/servers/3a7e223c-57dd-4ecc-a81f-9f4802472f4f => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:34:08.507894 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-10c4a87c-f344-41fc-8719-0d2c142d18fd tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6d9d9254-5c51-4135-8729-886ef56affcb", "device": "/dev/sdb"}} {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:34:08.515301 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-10c4a87c-f344-41fc-8719-0d2c142d18fd tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] [instance: 0402b684-55db-4c63-8142-de3fd0cc1503] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:34:08.517399 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-10c4a87c-f344-41fc-8719-0d2c142d18fd tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:08.517879 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-10c4a87c-f344-41fc-8719-0d2c142d18fd tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:08.518314 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-10c4a87c-f344-41fc-8719-0d2c142d18fd tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:08.519006 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-10c4a87c-f344-41fc-8719-0d2c142d18fd tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:08.519448 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-10c4a87c-f344-41fc-8719-0d2c142d18fd tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:08.519868 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-10c4a87c-f344-41fc-8719-0d2c142d18fd tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:08.707729 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-a34cfc6c-fcb7-4463-9e1c-3facd47e4dba tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:08.708596 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-a34cfc6c-fcb7-4463-9e1c-3facd47e4dba tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: 3a7e223c-57dd-4ecc-a81f-9f4802472f4f] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:34:08.719527 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a34cfc6c-fcb7-4463-9e1c-3facd47e4dba tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:08.720410 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a34cfc6c-fcb7-4463-9e1c-3facd47e4dba tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:08.721249 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a34cfc6c-fcb7-4463-9e1c-3facd47e4dba tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:08.722435 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a34cfc6c-fcb7-4463-9e1c-3facd47e4dba tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:08.723158 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a34cfc6c-fcb7-4463-9e1c-3facd47e4dba tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:08.723873 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a34cfc6c-fcb7-4463-9e1c-3facd47e4dba tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:08.882421 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-a34cfc6c-fcb7-4463-9e1c-3facd47e4dba tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:34:08.895540 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-a34cfc6c-fcb7-4463-9e1c-3facd47e4dba tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/3a7e223c-57dd-4ecc-a81f-9f4802472f4f" status: 200 len: 1522 microversion: 2.1 time: 0.191428 Aug 24 11:34:08.896392 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 171/371] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:34:08 2022] GET /compute/v2.1/servers/3a7e223c-57dd-4ecc-a81f-9f4802472f4f => generated 1522 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:34:09.925353 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-45dd749c-386b-47ea-849b-dd5d827be5a2 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:09.926456 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-45dd749c-386b-47ea-849b-dd5d827be5a2 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: 3a7e223c-57dd-4ecc-a81f-9f4802472f4f] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:34:09.938393 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-45dd749c-386b-47ea-849b-dd5d827be5a2 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:09.939231 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-45dd749c-386b-47ea-849b-dd5d827be5a2 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:09.939977 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-45dd749c-386b-47ea-849b-dd5d827be5a2 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:09.941241 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-45dd749c-386b-47ea-849b-dd5d827be5a2 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:09.942068 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-45dd749c-386b-47ea-849b-dd5d827be5a2 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:09.942784 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-45dd749c-386b-47ea-849b-dd5d827be5a2 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:10.145986 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-45dd749c-386b-47ea-849b-dd5d827be5a2 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:34:10.164894 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-45dd749c-386b-47ea-849b-dd5d827be5a2 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/3a7e223c-57dd-4ecc-a81f-9f4802472f4f" status: 200 len: 1522 microversion: 2.1 time: 0.247749 Aug 24 11:34:10.168333 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 172/372] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:34:09 2022] GET /compute/v2.1/servers/3a7e223c-57dd-4ecc-a81f-9f4802472f4f => generated 1522 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:34:10.596888 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-10c4a87c-f344-41fc-8719-0d2c142d18fd tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] 10.222.0.84 "POST /compute/v2.1/servers/0402b684-55db-4c63-8142-de3fd0cc1503/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.092955 Aug 24 11:34:10.598665 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 201/373] 10.222.0.84 () {60 vars in 1323 bytes} [Wed Aug 24 11:34:08 2022] POST /compute/v2.1/servers/0402b684-55db-4c63-8142-de3fd0cc1503/os-volume_attachments => generated 194 bytes in 2095 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:34:11.194802 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-91bb447a-1548-45da-ae29-c20e33482e1f tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:11.195404 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-91bb447a-1548-45da-ae29-c20e33482e1f tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: 3a7e223c-57dd-4ecc-a81f-9f4802472f4f] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:34:11.201814 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-91bb447a-1548-45da-ae29-c20e33482e1f tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:11.202289 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-91bb447a-1548-45da-ae29-c20e33482e1f tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:11.202719 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-91bb447a-1548-45da-ae29-c20e33482e1f tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:11.203400 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-91bb447a-1548-45da-ae29-c20e33482e1f tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:11.203844 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-91bb447a-1548-45da-ae29-c20e33482e1f tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:11.204260 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-91bb447a-1548-45da-ae29-c20e33482e1f tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:11.340763 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-91bb447a-1548-45da-ae29-c20e33482e1f tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:34:11.350355 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-91bb447a-1548-45da-ae29-c20e33482e1f tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/3a7e223c-57dd-4ecc-a81f-9f4802472f4f" status: 200 len: 1502 microversion: 2.1 time: 0.160012 Aug 24 11:34:11.360829 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 173/374] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:34:11 2022] GET /compute/v2.1/servers/3a7e223c-57dd-4ecc-a81f-9f4802472f4f => generated 1502 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:34:11.377332 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-f54b105b-e222-428f-b364-5b07fe74650a tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b4061661-b3c6-41fe-b4a4-e04ac08df1c8"}} {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:34:11.380345 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-f54b105b-e222-428f-b364-5b07fe74650a tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: 3a7e223c-57dd-4ecc-a81f-9f4802472f4f] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:34:11.392224 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f54b105b-e222-428f-b364-5b07fe74650a tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:11.393761 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f54b105b-e222-428f-b364-5b07fe74650a tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:11.397594 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f54b105b-e222-428f-b364-5b07fe74650a tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:11.400486 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f54b105b-e222-428f-b364-5b07fe74650a tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:11.402556 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f54b105b-e222-428f-b364-5b07fe74650a tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:11.407511 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f54b105b-e222-428f-b364-5b07fe74650a tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:11.444742 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.wsgi [None req-f54b105b-e222-428f-b364-5b07fe74650a tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] HTTP exception thrown: Cannot 'attach_volume' instance 3a7e223c-57dd-4ecc-a81f-9f4802472f4f while it is in vm_state rescued Aug 24 11:34:11.446572 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-f54b105b-e222-428f-b364-5b07fe74650a tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Request method failure captured: Aug 24 11:34:11.446572 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: request: POST /compute/v2.1/servers/3a7e223c-57dd-4ecc-a81f-9f4802472f4f/os-volume_attachments HTTP/1.1 Aug 24 11:34:11.446572 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Accept: application/json Aug 24 11:34:11.446572 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Accept-Encoding: identity Aug 24 11:34:11.446572 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Connection: close Aug 24 11:34:11.446572 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Content-Length: 74 Aug 24 11:34:11.446572 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Content-Type: application/json Aug 24 11:34:11.446572 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Host: 10.222.0.84 Aug 24 11:34:11.446572 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Openstack-System-Scope: None Aug 24 11:34:11.446572 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: User-Agent: python-urllib3/1.26.11 Aug 24 11:34:11.446572 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Auth-Token: gAAAAABjBgwcqa0CYUPhW6H0Ka_8PQo6WuRnVZxjJiGxVsP8OjBajZzTfRi-wT8euSPFOEzkWOlYPU2oyt3p2sSsquSlSFvb_OOqjFi6GL1r-duvQ_e_lEwQ5SQEw1PDuzr4YOYFBd4Fp8LuJKTid5FAIFqTau26udI57bZEjikHTi6akUiQBpI Aug 24 11:34:11.446572 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Domain-Id: None Aug 24 11:34:11.446572 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Domain-Name: None Aug 24 11:34:11.446572 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Identity-Status: Confirmed Aug 24 11:34:11.446572 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Is-Admin-Project: True Aug 24 11:34:11.446572 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Project-Domain-Id: default Aug 24 11:34:11.446572 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Project-Domain-Name: Default Aug 24 11:34:11.446572 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Project-Id: 048c7f026f304084960d77bf46f367d8 Aug 24 11:34:11.446572 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-309471798 Aug 24 11:34:11.446572 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Role: reader,member Aug 24 11:34:11.446572 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Roles: reader,member Aug 24 11:34:11.448016 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/volume/v3/048c7f026f304084960d77bf46f367d8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/volume/v3/048c7f026f304084960d77bf46f367d8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/compute/v2/048c7f026f304084960d77bf46f367d8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84:8080/v1/AUTH_048c7f026f304084960d77bf46f367d8", "adminURL": "http://10.222.0.84:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/placement"}]}] Aug 24 11:34:11.448016 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Tenant: tempest-ServerRescueNegativeTestJSON-309471798 Aug 24 11:34:11.448016 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Tenant-Id: 048c7f026f304084960d77bf46f367d8 Aug 24 11:34:11.448016 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-309471798 Aug 24 11:34:11.448016 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-User: tempest-ServerRescueNegativeTestJSON-309471798-project Aug 24 11:34:11.448016 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-User-Domain-Id: default Aug 24 11:34:11.448016 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-User-Domain-Name: Default Aug 24 11:34:11.448016 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-User-Id: 2d5bfffc316f481183093e386a326946 Aug 24 11:34:11.448016 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-User-Name: tempest-ServerRescueNegativeTestJSON-309471798-project Aug 24 11:34:11.448016 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Aug 24 11:34:11.448016 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: {"volumeAttachment": {"volumeId": "b4061661-b3c6-41fe-b4a4-e04ac08df1c8"}} Aug 24 11:34:11.448016 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: method: > Aug 24 11:34:11.449449 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: exception: Cannot 'attach_volume' instance 3a7e223c-57dd-4ecc-a81f-9f4802472f4f while it is in vm_state rescued Aug 24 11:34:11.449449 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: action_args: {'server_id': '3a7e223c-57dd-4ecc-a81f-9f4802472f4f', 'body': {'volumeAttachment': {'volumeId': 'b4061661-b3c6-41fe-b4a4-e04ac08df1c8'}}} Aug 24 11:34:11.449449 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:34:11.449449 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:34:11.449449 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 24 11:34:11.449449 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 24 11:34:11.449449 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 11:34:11.449449 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 11:34:11.449449 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 24 11:34:11.449449 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 24 11:34:11.449449 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 3a7e223c-57dd-4ecc-a81f-9f4802472f4f in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 24 11:34:11.449449 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Aug 24 11:34:11.449449 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:34:11.449449 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Aug 24 11:34:11.449449 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:34:11.449449 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:34:11.449449 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:34:11.449449 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:34:11.449449 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:34:11.450658 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:34:11.450658 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:34:11.450658 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 11:34:11.450658 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 11:34:11.450658 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 11:34:11.450658 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 11:34:11.450658 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 11:34:11.450658 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 11:34:11.450658 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 24 11:34:11.450658 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 24 11:34:11.450658 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 24 11:34:11.450658 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 24 11:34:11.450658 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 3a7e223c-57dd-4ecc-a81f-9f4802472f4f while it is in vm_state rescued Aug 24 11:34:11.450658 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Aug 24 11:34:11.450658 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:34:11.450658 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Aug 24 11:34:11.450658 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:34:11.450658 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:34:11.450658 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:34:11.451686 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:34:11.451686 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:34:11.451686 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 3a7e223c-57dd-4ecc-a81f-9f4802472f4f while it is in vm_state rescued Aug 24 11:34:11.451686 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Aug 24 11:34:11.451686 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-f54b105b-e222-428f-b364-5b07fe74650a tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Returning 409 to user: Cannot 'attach_volume' instance 3a7e223c-57dd-4ecc-a81f-9f4802472f4f while it is in vm_state rescued {{(pid=124769) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:34:11.451686 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-f54b105b-e222-428f-b364-5b07fe74650a tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "POST /compute/v2.1/servers/3a7e223c-57dd-4ecc-a81f-9f4802472f4f/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.077255 Aug 24 11:34:11.451686 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 202/375] 10.222.0.84 () {60 vars in 1323 bytes} [Wed Aug 24 11:34:11 2022] POST /compute/v2.1/servers/3a7e223c-57dd-4ecc-a81f-9f4802472f4f/os-volume_attachments => generated 152 bytes in 79 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 24 11:34:11.467117 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-815a8462-7e9d-46a2-ac50-0da2a35a4c14 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:34:11.467724 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-815a8462-7e9d-46a2-ac50-0da2a35a4c14 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: 3a7e223c-57dd-4ecc-a81f-9f4802472f4f] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:34:11.473850 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-815a8462-7e9d-46a2-ac50-0da2a35a4c14 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:11.474441 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-815a8462-7e9d-46a2-ac50-0da2a35a4c14 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:11.474930 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-815a8462-7e9d-46a2-ac50-0da2a35a4c14 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:11.475881 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-815a8462-7e9d-46a2-ac50-0da2a35a4c14 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:11.476533 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-815a8462-7e9d-46a2-ac50-0da2a35a4c14 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:11.476996 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-815a8462-7e9d-46a2-ac50-0da2a35a4c14 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:11.861126 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-815a8462-7e9d-46a2-ac50-0da2a35a4c14 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "POST /compute/v2.1/servers/3a7e223c-57dd-4ecc-a81f-9f4802472f4f/action" status: 202 len: 0 microversion: 2.1 time: 0.398858 Aug 24 11:34:11.862186 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 174/376] 10.222.0.84 () {60 vars in 1278 bytes} [Wed Aug 24 11:34:11 2022] POST /compute/v2.1/servers/3a7e223c-57dd-4ecc-a81f-9f4802472f4f/action => generated 0 bytes in 401 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:34:11.877226 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-45d1274a-d6b0-4be7-b2ce-a349202a096e tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:11.877226 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-45d1274a-d6b0-4be7-b2ce-a349202a096e tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: 3a7e223c-57dd-4ecc-a81f-9f4802472f4f] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:34:11.882522 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-45d1274a-d6b0-4be7-b2ce-a349202a096e tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:11.883057 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-45d1274a-d6b0-4be7-b2ce-a349202a096e tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:11.883679 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-45d1274a-d6b0-4be7-b2ce-a349202a096e tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:11.884724 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-45d1274a-d6b0-4be7-b2ce-a349202a096e tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:11.885236 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-45d1274a-d6b0-4be7-b2ce-a349202a096e tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:11.885832 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-45d1274a-d6b0-4be7-b2ce-a349202a096e tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:12.081797 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-45d1274a-d6b0-4be7-b2ce-a349202a096e tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:34:12.096409 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-45d1274a-d6b0-4be7-b2ce-a349202a096e tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/3a7e223c-57dd-4ecc-a81f-9f4802472f4f" status: 200 len: 1510 microversion: 2.1 time: 0.227834 Aug 24 11:34:12.097015 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 203/377] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:34:11 2022] GET /compute/v2.1/servers/3a7e223c-57dd-4ecc-a81f-9f4802472f4f => generated 1510 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:34:13.129120 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-ddeb380b-53a6-4df6-bd60-0d77fb22f2de tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:13.130832 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-ddeb380b-53a6-4df6-bd60-0d77fb22f2de tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: 3a7e223c-57dd-4ecc-a81f-9f4802472f4f] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:34:13.149961 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ddeb380b-53a6-4df6-bd60-0d77fb22f2de tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:13.150471 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ddeb380b-53a6-4df6-bd60-0d77fb22f2de tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:13.150918 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ddeb380b-53a6-4df6-bd60-0d77fb22f2de tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:13.151685 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ddeb380b-53a6-4df6-bd60-0d77fb22f2de tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:13.152919 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ddeb380b-53a6-4df6-bd60-0d77fb22f2de tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:13.153357 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ddeb380b-53a6-4df6-bd60-0d77fb22f2de tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:13.361404 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-ddeb380b-53a6-4df6-bd60-0d77fb22f2de tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:34:13.369315 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-ddeb380b-53a6-4df6-bd60-0d77fb22f2de tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/3a7e223c-57dd-4ecc-a81f-9f4802472f4f" status: 200 len: 1510 microversion: 2.1 time: 0.250958 Aug 24 11:34:13.370338 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 175/378] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:34:13 2022] GET /compute/v2.1/servers/3a7e223c-57dd-4ecc-a81f-9f4802472f4f => generated 1510 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:34:14.398746 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-97fb5339-a642-40f8-9e47-1eca5e279934 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:14.403274 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-97fb5339-a642-40f8-9e47-1eca5e279934 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: 3a7e223c-57dd-4ecc-a81f-9f4802472f4f] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:34:14.408297 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-97fb5339-a642-40f8-9e47-1eca5e279934 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:14.408871 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-97fb5339-a642-40f8-9e47-1eca5e279934 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:14.409307 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-97fb5339-a642-40f8-9e47-1eca5e279934 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:14.410005 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-97fb5339-a642-40f8-9e47-1eca5e279934 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:14.410453 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-97fb5339-a642-40f8-9e47-1eca5e279934 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:14.410872 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-97fb5339-a642-40f8-9e47-1eca5e279934 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:14.546627 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-97fb5339-a642-40f8-9e47-1eca5e279934 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:34:14.554764 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-97fb5339-a642-40f8-9e47-1eca5e279934 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/3a7e223c-57dd-4ecc-a81f-9f4802472f4f" status: 200 len: 1510 microversion: 2.1 time: 0.159952 Aug 24 11:34:14.555421 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 204/379] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:34:14 2022] GET /compute/v2.1/servers/3a7e223c-57dd-4ecc-a81f-9f4802472f4f => generated 1510 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:34:15.576716 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-063e4f8c-e340-49be-9224-bed7d203bc4a tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:15.577923 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-063e4f8c-e340-49be-9224-bed7d203bc4a tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: 3a7e223c-57dd-4ecc-a81f-9f4802472f4f] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:34:15.584729 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-063e4f8c-e340-49be-9224-bed7d203bc4a tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:15.585535 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-063e4f8c-e340-49be-9224-bed7d203bc4a tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:15.585987 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-063e4f8c-e340-49be-9224-bed7d203bc4a tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:15.586679 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-063e4f8c-e340-49be-9224-bed7d203bc4a tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:15.587176 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-063e4f8c-e340-49be-9224-bed7d203bc4a tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:15.587614 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-063e4f8c-e340-49be-9224-bed7d203bc4a tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:15.733869 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-063e4f8c-e340-49be-9224-bed7d203bc4a tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:34:15.743074 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-063e4f8c-e340-49be-9224-bed7d203bc4a tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/3a7e223c-57dd-4ecc-a81f-9f4802472f4f" status: 200 len: 1510 microversion: 2.1 time: 0.170247 Aug 24 11:34:15.743665 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 176/380] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:34:15 2022] GET /compute/v2.1/servers/3a7e223c-57dd-4ecc-a81f-9f4802472f4f => generated 1510 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:34:16.765439 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-0673da36-388f-4bb7-b447-2518d965b461 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:16.766081 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-0673da36-388f-4bb7-b447-2518d965b461 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: 3a7e223c-57dd-4ecc-a81f-9f4802472f4f] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:34:16.772770 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-0673da36-388f-4bb7-b447-2518d965b461 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:16.777448 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-0673da36-388f-4bb7-b447-2518d965b461 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:16.777448 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-0673da36-388f-4bb7-b447-2518d965b461 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:16.777448 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-0673da36-388f-4bb7-b447-2518d965b461 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:16.777448 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-0673da36-388f-4bb7-b447-2518d965b461 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:16.777920 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-0673da36-388f-4bb7-b447-2518d965b461 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:16.928007 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-0673da36-388f-4bb7-b447-2518d965b461 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:34:16.928007 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG dbcounter [-] [124769] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:16.933032 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-0673da36-388f-4bb7-b447-2518d965b461 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/3a7e223c-57dd-4ecc-a81f-9f4802472f4f" status: 200 len: 1516 microversion: 2.1 time: 0.172157 Aug 24 11:34:16.933674 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 205/381] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:34:16 2022] GET /compute/v2.1/servers/3a7e223c-57dd-4ecc-a81f-9f4802472f4f => generated 1516 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:34:19.940186 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-b40713e1-2d41-4922-8093-fe37da8df78c tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Action: 'create', calling method: .version_select at 0x7f0e2a64d280>, body: {"keypair": {"name": "tempest-keypair-816624209", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCG4lUpUPwgHkvE2a5jJFhzSP7s+VbnBggVHX/42HJ8mq7kslOhdltoA7kIqfC3+JhNAev8r1JFZ7CuSXP3tHp4yM7SNXc669rz7yPUgiPdomDmaSz6fmf69+XhT2v5jXg=="}} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:34:19.958111 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.quota [None req-b40713e1-2d41-4922-8093-fe37da8df78c tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Getting quotas for project 048c7f026f304084960d77bf46f367d8. Resources: {'key_pairs'} {{(pid=124770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:34:19.962319 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.quota [None req-b40713e1-2d41-4922-8093-fe37da8df78c tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Getting quotas for user 2d5bfffc316f481183093e386a326946 and project 048c7f026f304084960d77bf46f367d8. Resources: {'key_pairs'} {{(pid=124770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:34:20.126222 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-b40713e1-2d41-4922-8093-fe37da8df78c tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.190580 Aug 24 11:34:20.127329 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 177/382] 10.222.0.84 () {60 vars in 1159 bytes} [Wed Aug 24 11:34:19 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:34:23.456372 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-1753c205-3412-4e69-8a93-5d53d5f3d157 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1660096411", "imageRef": "028cad80-8f50-4139-b345-dfdca694dc6b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "34c53048-be0c-4bb3-ac17-ec4672543fdd"}], "security_groups": [{"name": "tempest-securitygroup--1831857660"}], "key_name": "tempest-keypair-816624209", "user_data": "}} {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:34:23.571305 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.network.neutron [None req-1753c205-3412-4e69-8a93-5d53d5f3d157 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] validate_networks() for [('34c53048-be0c-4bb3-ac17-ec4672543fdd', None, None, None, None, None)] {{(pid=124769) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 11:34:23.992837 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.virt.hardware [None req-1753c205-3412-4e69-8a93-5d53d5f3d157 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Flavor limits 0:0:0 {{(pid=124769) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 11:34:23.993379 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.virt.hardware [None req-1753c205-3412-4e69-8a93-5d53d5f3d157 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Image limits 0:0:0 {{(pid=124769) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 11:34:23.994088 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.virt.hardware [None req-1753c205-3412-4e69-8a93-5d53d5f3d157 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Flavor pref 0:0:0 {{(pid=124769) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 11:34:23.995554 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.virt.hardware [None req-1753c205-3412-4e69-8a93-5d53d5f3d157 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Image pref 0:0:0 {{(pid=124769) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 11:34:23.996551 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.virt.hardware [None req-1753c205-3412-4e69-8a93-5d53d5f3d157 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124769) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 11:34:24.012257 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-1753c205-3412-4e69-8a93-5d53d5f3d157 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:24.013043 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-1753c205-3412-4e69-8a93-5d53d5f3d157 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:24.013677 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-1753c205-3412-4e69-8a93-5d53d5f3d157 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:24.014892 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-1753c205-3412-4e69-8a93-5d53d5f3d157 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:24.015447 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-1753c205-3412-4e69-8a93-5d53d5f3d157 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:24.015933 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-1753c205-3412-4e69-8a93-5d53d5f3d157 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:24.036070 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.quota [None req-1753c205-3412-4e69-8a93-5d53d5f3d157 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Getting quotas for project 048c7f026f304084960d77bf46f367d8. Resources: {'ram', 'cores', 'instances'} {{(pid=124769) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:34:24.041192 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.quota [None req-1753c205-3412-4e69-8a93-5d53d5f3d157 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Getting quotas for user 2d5bfffc316f481183093e386a326946 and project 048c7f026f304084960d77bf46f367d8. Resources: {'ram', 'cores', 'instances'} {{(pid=124769) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:34:24.054075 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-1753c205-3412-4e69-8a93-5d53d5f3d157 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Going to run 1 instances... {{(pid=124769) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 11:34:24.056402 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-1753c205-3412-4e69-8a93-5d53d5f3d157 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: a8ce5b7f-1b02-4746-9aa5-0d826615df18] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='028cad80-8f50-4139-b345-dfdca694dc6b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124769) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 11:34:24.233502 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-1753c205-3412-4e69-8a93-5d53d5f3d157 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.780789 Aug 24 11:34:24.234345 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 206/383] 10.222.0.84 () {60 vars in 1147 bytes} [Wed Aug 24 11:34:23 2022] POST /compute/v2.1/servers => generated 409 bytes in 784 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 11:34:24.254516 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-9c38c981-907a-4df3-996c-bf0ba059d8ff tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:24.255988 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-9c38c981-907a-4df3-996c-bf0ba059d8ff tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: a8ce5b7f-1b02-4746-9aa5-0d826615df18] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:34:24.259945 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:24.349926 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-9c38c981-907a-4df3-996c-bf0ba059d8ff tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:34:24.358971 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-9c38c981-907a-4df3-996c-bf0ba059d8ff tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18" status: 200 len: 1245 microversion: 2.1 time: 0.110021 Aug 24 11:34:24.359663 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 178/384] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:34:24 2022] GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18 => generated 1245 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:34:25.396394 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-77e08ec5-3af0-45e0-a55d-b0082313eaba tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:25.397276 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-77e08ec5-3af0-45e0-a55d-b0082313eaba tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: a8ce5b7f-1b02-4746-9aa5-0d826615df18] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:34:25.399241 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG dbcounter [-] [124769] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=124769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:25.404933 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-77e08ec5-3af0-45e0-a55d-b0082313eaba tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:25.405413 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-77e08ec5-3af0-45e0-a55d-b0082313eaba tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:25.405844 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-77e08ec5-3af0-45e0-a55d-b0082313eaba tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:25.406717 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-77e08ec5-3af0-45e0-a55d-b0082313eaba tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:25.407166 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-77e08ec5-3af0-45e0-a55d-b0082313eaba tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:25.407660 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-77e08ec5-3af0-45e0-a55d-b0082313eaba tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:25.476346 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-77e08ec5-3af0-45e0-a55d-b0082313eaba tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:34:25.490302 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-77e08ec5-3af0-45e0-a55d-b0082313eaba tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18" status: 200 len: 1249 microversion: 2.1 time: 0.097872 Aug 24 11:34:25.491647 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 207/385] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:34:25 2022] GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18 => generated 1249 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:34:26.513176 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-a5175c00-3ef9-4424-859d-06b7fad6bc6d tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:26.513987 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-a5175c00-3ef9-4424-859d-06b7fad6bc6d tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: a8ce5b7f-1b02-4746-9aa5-0d826615df18] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:34:26.516080 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:26.521139 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a5175c00-3ef9-4424-859d-06b7fad6bc6d tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:26.521617 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a5175c00-3ef9-4424-859d-06b7fad6bc6d tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:26.522081 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a5175c00-3ef9-4424-859d-06b7fad6bc6d tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:26.522840 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a5175c00-3ef9-4424-859d-06b7fad6bc6d tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:26.523290 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a5175c00-3ef9-4424-859d-06b7fad6bc6d tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:26.523706 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a5175c00-3ef9-4424-859d-06b7fad6bc6d tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:26.592463 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-a5175c00-3ef9-4424-859d-06b7fad6bc6d tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:34:26.600120 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-a5175c00-3ef9-4424-859d-06b7fad6bc6d tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18" status: 200 len: 1249 microversion: 2.1 time: 0.092489 Aug 24 11:34:26.600687 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 179/386] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:34:26 2022] GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18 => generated 1249 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:34:27.622348 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-3f241b42-6a12-4d14-8d4b-ad6282a2c3f3 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:27.623448 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-3f241b42-6a12-4d14-8d4b-ad6282a2c3f3 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: a8ce5b7f-1b02-4746-9aa5-0d826615df18] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:34:27.630859 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-3f241b42-6a12-4d14-8d4b-ad6282a2c3f3 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:27.631441 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-3f241b42-6a12-4d14-8d4b-ad6282a2c3f3 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:27.631955 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-3f241b42-6a12-4d14-8d4b-ad6282a2c3f3 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:27.632651 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-3f241b42-6a12-4d14-8d4b-ad6282a2c3f3 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:27.633144 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-3f241b42-6a12-4d14-8d4b-ad6282a2c3f3 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:27.633565 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-3f241b42-6a12-4d14-8d4b-ad6282a2c3f3 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:27.700712 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-3f241b42-6a12-4d14-8d4b-ad6282a2c3f3 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:34:27.713737 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-3f241b42-6a12-4d14-8d4b-ad6282a2c3f3 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18" status: 200 len: 1241 microversion: 2.1 time: 0.096157 Aug 24 11:34:27.725136 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 208/387] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:34:27 2022] GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18 => generated 1241 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:34:28.742721 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-b0aa95de-7b27-4038-b3d7-97f192178b1e tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:28.743754 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-b0aa95de-7b27-4038-b3d7-97f192178b1e tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: a8ce5b7f-1b02-4746-9aa5-0d826615df18] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:34:28.754140 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b0aa95de-7b27-4038-b3d7-97f192178b1e tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:28.754771 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b0aa95de-7b27-4038-b3d7-97f192178b1e tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:28.755213 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b0aa95de-7b27-4038-b3d7-97f192178b1e tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:28.755925 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b0aa95de-7b27-4038-b3d7-97f192178b1e tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:28.756388 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b0aa95de-7b27-4038-b3d7-97f192178b1e tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:28.756841 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b0aa95de-7b27-4038-b3d7-97f192178b1e tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:28.873299 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-b0aa95de-7b27-4038-b3d7-97f192178b1e tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:34:28.882281 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-b0aa95de-7b27-4038-b3d7-97f192178b1e tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18" status: 200 len: 1305 microversion: 2.1 time: 0.144569 Aug 24 11:34:28.882897 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 180/388] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:34:28 2022] GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18 => generated 1305 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:34:29.915393 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-db10b3ac-97fa-4f29-8b1d-85e7c6a046cf tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:29.924441 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-db10b3ac-97fa-4f29-8b1d-85e7c6a046cf tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: a8ce5b7f-1b02-4746-9aa5-0d826615df18] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:34:29.951239 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-db10b3ac-97fa-4f29-8b1d-85e7c6a046cf tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:29.951881 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-db10b3ac-97fa-4f29-8b1d-85e7c6a046cf tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:29.954650 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-db10b3ac-97fa-4f29-8b1d-85e7c6a046cf tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:29.955749 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-db10b3ac-97fa-4f29-8b1d-85e7c6a046cf tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:29.956450 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-db10b3ac-97fa-4f29-8b1d-85e7c6a046cf tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:29.957445 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-db10b3ac-97fa-4f29-8b1d-85e7c6a046cf tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:30.366921 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-db10b3ac-97fa-4f29-8b1d-85e7c6a046cf tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:34:30.375907 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-db10b3ac-97fa-4f29-8b1d-85e7c6a046cf tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18" status: 200 len: 1371 microversion: 2.1 time: 0.474008 Aug 24 11:34:30.376500 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 209/389] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:34:29 2022] GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18 => generated 1371 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:34:31.398707 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-deb6ceef-9f83-4f8d-8d7a-2abd8dc98c44 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:31.399368 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-deb6ceef-9f83-4f8d-8d7a-2abd8dc98c44 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: a8ce5b7f-1b02-4746-9aa5-0d826615df18] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:34:31.407195 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-deb6ceef-9f83-4f8d-8d7a-2abd8dc98c44 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:31.407675 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-deb6ceef-9f83-4f8d-8d7a-2abd8dc98c44 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:31.408105 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-deb6ceef-9f83-4f8d-8d7a-2abd8dc98c44 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:31.408820 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-deb6ceef-9f83-4f8d-8d7a-2abd8dc98c44 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:31.409270 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-deb6ceef-9f83-4f8d-8d7a-2abd8dc98c44 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:31.409689 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-deb6ceef-9f83-4f8d-8d7a-2abd8dc98c44 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:31.550603 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-deb6ceef-9f83-4f8d-8d7a-2abd8dc98c44 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:34:31.559298 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-deb6ceef-9f83-4f8d-8d7a-2abd8dc98c44 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18" status: 200 len: 1371 microversion: 2.1 time: 0.164541 Aug 24 11:34:31.559873 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 181/390] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:34:31 2022] GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18 => generated 1371 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:34:32.581435 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-baf9f689-9214-4cce-89fa-14d46561acda tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:32.582046 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-baf9f689-9214-4cce-89fa-14d46561acda tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: a8ce5b7f-1b02-4746-9aa5-0d826615df18] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:34:32.589274 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-baf9f689-9214-4cce-89fa-14d46561acda tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:32.589769 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-baf9f689-9214-4cce-89fa-14d46561acda tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:32.590208 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-baf9f689-9214-4cce-89fa-14d46561acda tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:32.590929 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-baf9f689-9214-4cce-89fa-14d46561acda tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:32.591376 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-baf9f689-9214-4cce-89fa-14d46561acda tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:32.591804 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-baf9f689-9214-4cce-89fa-14d46561acda tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:32.739615 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-baf9f689-9214-4cce-89fa-14d46561acda tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:34:32.747775 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-baf9f689-9214-4cce-89fa-14d46561acda tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18" status: 200 len: 1371 microversion: 2.1 time: 0.170134 Aug 24 11:34:32.748366 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 210/391] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:34:32 2022] GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18 => generated 1371 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:34:33.772213 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-e398e6b0-379c-4396-8d3f-8de2c3f92110 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:33.774692 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-e398e6b0-379c-4396-8d3f-8de2c3f92110 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: a8ce5b7f-1b02-4746-9aa5-0d826615df18] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:34:33.786676 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e398e6b0-379c-4396-8d3f-8de2c3f92110 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:33.788000 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e398e6b0-379c-4396-8d3f-8de2c3f92110 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:33.788929 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e398e6b0-379c-4396-8d3f-8de2c3f92110 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:33.790225 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e398e6b0-379c-4396-8d3f-8de2c3f92110 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:33.791657 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e398e6b0-379c-4396-8d3f-8de2c3f92110 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:33.792544 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e398e6b0-379c-4396-8d3f-8de2c3f92110 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:34.119058 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-e398e6b0-379c-4396-8d3f-8de2c3f92110 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:34:34.128279 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-e398e6b0-379c-4396-8d3f-8de2c3f92110 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18" status: 200 len: 1371 microversion: 2.1 time: 0.363807 Aug 24 11:34:34.128986 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 182/392] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:34:33 2022] GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18 => generated 1371 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:34:35.043028 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [req-28992cb6-886b-447b-bcd1-8778194e5c1b req-9fd61efc-438d-49f8-a84e-54bc25c21b78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8ce5b7f-1b02-4746-9aa5-0d826615df18", "tag": "808cd754-982d-460a-8dbd-1ce9354861d7"}]} {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:34:35.048394 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG dbcounter [-] [124769] Writing DB stats nova_cell0:SELECT=2 {{(pid=124769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:35.059589 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG dbcounter [-] [124769] Writing DB stats nova_cell0:SELECT=6 {{(pid=124769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:35.059589 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [req-28992cb6-886b-447b-bcd1-8778194e5c1b req-9fd61efc-438d-49f8-a84e-54bc25c21b78 service nova] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:35.059589 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [req-28992cb6-886b-447b-bcd1-8778194e5c1b req-9fd61efc-438d-49f8-a84e-54bc25c21b78 service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:35.059589 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [req-28992cb6-886b-447b-bcd1-8778194e5c1b req-9fd61efc-438d-49f8-a84e-54bc25c21b78 service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:35.067958 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.compute.server_external_events [req-28992cb6-886b-447b-bcd1-8778194e5c1b req-9fd61efc-438d-49f8-a84e-54bc25c21b78 service nova] Creating event network-changed:808cd754-982d-460a-8dbd-1ce9354861d7 for instance a8ce5b7f-1b02-4746-9aa5-0d826615df18 on hv-cinder-85427 Aug 24 11:34:35.074370 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [req-28992cb6-886b-447b-bcd1-8778194e5c1b req-9fd61efc-438d-49f8-a84e-54bc25c21b78 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035704 Aug 24 11:34:35.075148 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 211/393] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Aug 24 11:34:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:34:35.148053 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_cell0:SELECT=6 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:35.153287 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-d611c734-5e1b-452d-9f7f-f3fb5cb9b169 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:35.157203 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-d611c734-5e1b-452d-9f7f-f3fb5cb9b169 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: a8ce5b7f-1b02-4746-9aa5-0d826615df18] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:34:35.159774 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d611c734-5e1b-452d-9f7f-f3fb5cb9b169 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:35.160251 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d611c734-5e1b-452d-9f7f-f3fb5cb9b169 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:35.160692 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d611c734-5e1b-452d-9f7f-f3fb5cb9b169 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:35.161411 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d611c734-5e1b-452d-9f7f-f3fb5cb9b169 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:35.161873 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d611c734-5e1b-452d-9f7f-f3fb5cb9b169 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:35.162297 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d611c734-5e1b-452d-9f7f-f3fb5cb9b169 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:35.405057 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-d611c734-5e1b-452d-9f7f-f3fb5cb9b169 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:34:35.413189 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-d611c734-5e1b-452d-9f7f-f3fb5cb9b169 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18" status: 200 len: 1371 microversion: 2.1 time: 0.265770 Aug 24 11:34:35.413821 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 183/394] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:34:35 2022] GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18 => generated 1371 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:34:36.438061 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-b2dd3565-c167-4a26-88fd-aa5e8b3e6a50 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:36.438766 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-b2dd3565-c167-4a26-88fd-aa5e8b3e6a50 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: a8ce5b7f-1b02-4746-9aa5-0d826615df18] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:34:36.446066 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-b2dd3565-c167-4a26-88fd-aa5e8b3e6a50 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:36.446561 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-b2dd3565-c167-4a26-88fd-aa5e8b3e6a50 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:36.446999 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-b2dd3565-c167-4a26-88fd-aa5e8b3e6a50 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:36.448401 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-b2dd3565-c167-4a26-88fd-aa5e8b3e6a50 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:36.448885 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-b2dd3565-c167-4a26-88fd-aa5e8b3e6a50 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:36.449345 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-b2dd3565-c167-4a26-88fd-aa5e8b3e6a50 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:36.599502 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-b2dd3565-c167-4a26-88fd-aa5e8b3e6a50 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:34:36.608202 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-b2dd3565-c167-4a26-88fd-aa5e8b3e6a50 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18" status: 200 len: 1371 microversion: 2.1 time: 0.176099 Aug 24 11:34:36.608786 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 212/395] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:34:36 2022] GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18 => generated 1371 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:34:37.630940 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-5b99ec6d-b1fc-47d9-8ea8-42172b7f0b0c tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:37.631562 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-5b99ec6d-b1fc-47d9-8ea8-42172b7f0b0c tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: a8ce5b7f-1b02-4746-9aa5-0d826615df18] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:34:37.640963 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5b99ec6d-b1fc-47d9-8ea8-42172b7f0b0c tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:37.641477 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5b99ec6d-b1fc-47d9-8ea8-42172b7f0b0c tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:37.641934 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5b99ec6d-b1fc-47d9-8ea8-42172b7f0b0c tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:37.642730 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5b99ec6d-b1fc-47d9-8ea8-42172b7f0b0c tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:37.643239 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5b99ec6d-b1fc-47d9-8ea8-42172b7f0b0c tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:37.643687 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5b99ec6d-b1fc-47d9-8ea8-42172b7f0b0c tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:37.795735 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-5b99ec6d-b1fc-47d9-8ea8-42172b7f0b0c tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:34:37.803820 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-5b99ec6d-b1fc-47d9-8ea8-42172b7f0b0c tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18" status: 200 len: 1371 microversion: 2.1 time: 0.177363 Aug 24 11:34:37.804411 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 184/396] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:34:37 2022] GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18 => generated 1371 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:34:38.825758 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-7ef79ed7-ae33-4ab2-ac90-ae2dfd033785 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:38.826365 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-7ef79ed7-ae33-4ab2-ac90-ae2dfd033785 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: a8ce5b7f-1b02-4746-9aa5-0d826615df18] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:34:38.833114 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-7ef79ed7-ae33-4ab2-ac90-ae2dfd033785 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:38.833603 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-7ef79ed7-ae33-4ab2-ac90-ae2dfd033785 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:38.834040 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-7ef79ed7-ae33-4ab2-ac90-ae2dfd033785 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:38.834738 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-7ef79ed7-ae33-4ab2-ac90-ae2dfd033785 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:38.835191 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-7ef79ed7-ae33-4ab2-ac90-ae2dfd033785 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:38.835614 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-7ef79ed7-ae33-4ab2-ac90-ae2dfd033785 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:38.975722 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-7ef79ed7-ae33-4ab2-ac90-ae2dfd033785 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:34:38.984547 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-7ef79ed7-ae33-4ab2-ac90-ae2dfd033785 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18" status: 200 len: 1371 microversion: 2.1 time: 0.163103 Aug 24 11:34:38.985166 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 213/397] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:34:38 2022] GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18 => generated 1371 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:34:40.011705 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-150596ac-5d87-4d7a-9788-da0f3b94963c tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:40.014458 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-150596ac-5d87-4d7a-9788-da0f3b94963c tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: a8ce5b7f-1b02-4746-9aa5-0d826615df18] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:34:40.026980 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-150596ac-5d87-4d7a-9788-da0f3b94963c tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:40.028202 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-150596ac-5d87-4d7a-9788-da0f3b94963c tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:40.029418 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-150596ac-5d87-4d7a-9788-da0f3b94963c tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:40.030934 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-150596ac-5d87-4d7a-9788-da0f3b94963c tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:40.032270 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-150596ac-5d87-4d7a-9788-da0f3b94963c tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:40.033302 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-150596ac-5d87-4d7a-9788-da0f3b94963c tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:40.257999 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-150596ac-5d87-4d7a-9788-da0f3b94963c tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:34:40.266959 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-150596ac-5d87-4d7a-9788-da0f3b94963c tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18" status: 200 len: 1371 microversion: 2.1 time: 0.264552 Aug 24 11:34:40.267453 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 185/398] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:34:40 2022] GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18 => generated 1371 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:34:41.288313 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-9e886130-01c0-438a-a08c-f6fc0a83be1d tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:41.289278 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-9e886130-01c0-438a-a08c-f6fc0a83be1d tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: a8ce5b7f-1b02-4746-9aa5-0d826615df18] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:34:41.296900 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-9e886130-01c0-438a-a08c-f6fc0a83be1d tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:41.297556 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-9e886130-01c0-438a-a08c-f6fc0a83be1d tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:41.298018 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-9e886130-01c0-438a-a08c-f6fc0a83be1d tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:41.298764 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-9e886130-01c0-438a-a08c-f6fc0a83be1d tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:41.299791 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-9e886130-01c0-438a-a08c-f6fc0a83be1d tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:41.299791 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-9e886130-01c0-438a-a08c-f6fc0a83be1d tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:41.469140 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-9e886130-01c0-438a-a08c-f6fc0a83be1d tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:34:41.476823 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-9e886130-01c0-438a-a08c-f6fc0a83be1d tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18" status: 200 len: 1371 microversion: 2.1 time: 0.192602 Aug 24 11:34:41.477524 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 214/399] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:34:41 2022] GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18 => generated 1371 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:34:42.498184 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-bddbb197-e2e9-4f00-9686-07c09ced67db tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:42.498745 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-bddbb197-e2e9-4f00-9686-07c09ced67db tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: a8ce5b7f-1b02-4746-9aa5-0d826615df18] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:34:42.505297 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-bddbb197-e2e9-4f00-9686-07c09ced67db tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:42.505810 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-bddbb197-e2e9-4f00-9686-07c09ced67db tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:42.506238 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-bddbb197-e2e9-4f00-9686-07c09ced67db tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:42.506980 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-bddbb197-e2e9-4f00-9686-07c09ced67db tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:42.507425 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-bddbb197-e2e9-4f00-9686-07c09ced67db tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:42.507841 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-bddbb197-e2e9-4f00-9686-07c09ced67db tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:42.655321 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-bddbb197-e2e9-4f00-9686-07c09ced67db tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:34:42.663143 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-bddbb197-e2e9-4f00-9686-07c09ced67db tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18" status: 200 len: 1371 microversion: 2.1 time: 0.169149 Aug 24 11:34:42.663713 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 186/400] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:34:42 2022] GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18 => generated 1371 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:34:43.685426 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-934a5f73-9853-4f3c-bcd6-71b3628691e7 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:43.686135 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-934a5f73-9853-4f3c-bcd6-71b3628691e7 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: a8ce5b7f-1b02-4746-9aa5-0d826615df18] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:34:43.692769 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-934a5f73-9853-4f3c-bcd6-71b3628691e7 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:43.693287 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-934a5f73-9853-4f3c-bcd6-71b3628691e7 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:43.693723 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-934a5f73-9853-4f3c-bcd6-71b3628691e7 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:43.694420 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-934a5f73-9853-4f3c-bcd6-71b3628691e7 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:43.694874 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-934a5f73-9853-4f3c-bcd6-71b3628691e7 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:43.695291 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-934a5f73-9853-4f3c-bcd6-71b3628691e7 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:43.831877 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-934a5f73-9853-4f3c-bcd6-71b3628691e7 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:34:43.840758 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-934a5f73-9853-4f3c-bcd6-71b3628691e7 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18" status: 200 len: 1371 microversion: 2.1 time: 0.159761 Aug 24 11:34:43.841355 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 215/401] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:34:43 2022] GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18 => generated 1371 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:34:44.862639 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-702160a1-e466-40e2-ade6-0fb2ac4322a4 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:44.863258 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-702160a1-e466-40e2-ade6-0fb2ac4322a4 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: a8ce5b7f-1b02-4746-9aa5-0d826615df18] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:34:44.870747 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-702160a1-e466-40e2-ade6-0fb2ac4322a4 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:44.871229 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-702160a1-e466-40e2-ade6-0fb2ac4322a4 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:44.871661 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-702160a1-e466-40e2-ade6-0fb2ac4322a4 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:44.872354 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-702160a1-e466-40e2-ade6-0fb2ac4322a4 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:44.872815 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-702160a1-e466-40e2-ade6-0fb2ac4322a4 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:44.873250 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-702160a1-e466-40e2-ade6-0fb2ac4322a4 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:45.020415 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-702160a1-e466-40e2-ade6-0fb2ac4322a4 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:34:45.028494 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-702160a1-e466-40e2-ade6-0fb2ac4322a4 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18" status: 200 len: 1371 microversion: 2.1 time: 0.169649 Aug 24 11:34:45.029363 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 187/402] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:34:44 2022] GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18 => generated 1371 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:34:46.049257 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-df4e763a-af74-4211-a0ad-c4455a703c27 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:46.050011 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-df4e763a-af74-4211-a0ad-c4455a703c27 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: a8ce5b7f-1b02-4746-9aa5-0d826615df18] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:34:46.057226 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-df4e763a-af74-4211-a0ad-c4455a703c27 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:46.057745 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-df4e763a-af74-4211-a0ad-c4455a703c27 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:46.058175 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-df4e763a-af74-4211-a0ad-c4455a703c27 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:46.058879 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-df4e763a-af74-4211-a0ad-c4455a703c27 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:46.059327 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-df4e763a-af74-4211-a0ad-c4455a703c27 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:46.059745 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-df4e763a-af74-4211-a0ad-c4455a703c27 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:46.204391 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-df4e763a-af74-4211-a0ad-c4455a703c27 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:34:46.215815 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-df4e763a-af74-4211-a0ad-c4455a703c27 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18" status: 200 len: 1371 microversion: 2.1 time: 0.170411 Aug 24 11:34:46.216394 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 216/403] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:34:46 2022] GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18 => generated 1371 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:34:47.247202 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-0a26979f-a0d6-4eaf-9f82-6bda5eb0dcba tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:47.247821 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-0a26979f-a0d6-4eaf-9f82-6bda5eb0dcba tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: a8ce5b7f-1b02-4746-9aa5-0d826615df18] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:34:47.254609 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-0a26979f-a0d6-4eaf-9f82-6bda5eb0dcba tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:47.255097 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-0a26979f-a0d6-4eaf-9f82-6bda5eb0dcba tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:47.255536 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-0a26979f-a0d6-4eaf-9f82-6bda5eb0dcba tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:47.256240 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-0a26979f-a0d6-4eaf-9f82-6bda5eb0dcba tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:47.256726 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-0a26979f-a0d6-4eaf-9f82-6bda5eb0dcba tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:47.257171 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-0a26979f-a0d6-4eaf-9f82-6bda5eb0dcba tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:47.397094 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-0a26979f-a0d6-4eaf-9f82-6bda5eb0dcba tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:34:47.406065 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-0a26979f-a0d6-4eaf-9f82-6bda5eb0dcba tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18" status: 200 len: 1371 microversion: 2.1 time: 0.163152 Aug 24 11:34:47.406634 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 188/404] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:34:47 2022] GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18 => generated 1371 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:34:48.429872 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-04ccea72-784a-4cc6-b16a-88ad0866eb44 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:48.430253 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-04ccea72-784a-4cc6-b16a-88ad0866eb44 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: a8ce5b7f-1b02-4746-9aa5-0d826615df18] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:34:48.442068 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-04ccea72-784a-4cc6-b16a-88ad0866eb44 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:48.442068 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-04ccea72-784a-4cc6-b16a-88ad0866eb44 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:48.442068 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-04ccea72-784a-4cc6-b16a-88ad0866eb44 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:48.442068 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-04ccea72-784a-4cc6-b16a-88ad0866eb44 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:48.442431 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-04ccea72-784a-4cc6-b16a-88ad0866eb44 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:48.442431 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-04ccea72-784a-4cc6-b16a-88ad0866eb44 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:48.578405 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-04ccea72-784a-4cc6-b16a-88ad0866eb44 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:34:48.586080 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-04ccea72-784a-4cc6-b16a-88ad0866eb44 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18" status: 200 len: 1371 microversion: 2.1 time: 0.160558 Aug 24 11:34:48.586639 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 217/405] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:34:48 2022] GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18 => generated 1371 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:34:49.608109 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-9345f886-2b50-428f-b821-4238b548e35e tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:49.608717 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-9345f886-2b50-428f-b821-4238b548e35e tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: a8ce5b7f-1b02-4746-9aa5-0d826615df18] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:34:49.615574 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9345f886-2b50-428f-b821-4238b548e35e tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:49.616072 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9345f886-2b50-428f-b821-4238b548e35e tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:49.616918 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9345f886-2b50-428f-b821-4238b548e35e tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:49.617279 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9345f886-2b50-428f-b821-4238b548e35e tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:49.617738 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9345f886-2b50-428f-b821-4238b548e35e tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:49.618166 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9345f886-2b50-428f-b821-4238b548e35e tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:49.774303 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-9345f886-2b50-428f-b821-4238b548e35e tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:34:49.782926 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-9345f886-2b50-428f-b821-4238b548e35e tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18" status: 200 len: 1371 microversion: 2.1 time: 0.178762 Aug 24 11:34:49.783496 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 189/406] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:34:49 2022] GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18 => generated 1371 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:34:50.804729 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-e087994c-30a8-46ab-80f7-948d2df6a826 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:50.805403 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-e087994c-30a8-46ab-80f7-948d2df6a826 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: a8ce5b7f-1b02-4746-9aa5-0d826615df18] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:34:50.812171 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-e087994c-30a8-46ab-80f7-948d2df6a826 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:50.812665 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-e087994c-30a8-46ab-80f7-948d2df6a826 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:50.813135 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-e087994c-30a8-46ab-80f7-948d2df6a826 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:50.813838 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-e087994c-30a8-46ab-80f7-948d2df6a826 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:50.814297 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-e087994c-30a8-46ab-80f7-948d2df6a826 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:50.814728 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-e087994c-30a8-46ab-80f7-948d2df6a826 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:50.961519 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-e087994c-30a8-46ab-80f7-948d2df6a826 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:34:50.970415 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-e087994c-30a8-46ab-80f7-948d2df6a826 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18" status: 200 len: 1371 microversion: 2.1 time: 0.169437 Aug 24 11:34:50.970989 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 218/407] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:34:50 2022] GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18 => generated 1371 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:34:51.991232 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-11a2af33-6a22-4021-a2db-fb975b1afc8b tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:51.991766 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-11a2af33-6a22-4021-a2db-fb975b1afc8b tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: a8ce5b7f-1b02-4746-9aa5-0d826615df18] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:34:51.999189 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-11a2af33-6a22-4021-a2db-fb975b1afc8b tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:51.999669 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-11a2af33-6a22-4021-a2db-fb975b1afc8b tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:52.000104 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-11a2af33-6a22-4021-a2db-fb975b1afc8b tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:52.000790 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-11a2af33-6a22-4021-a2db-fb975b1afc8b tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:52.001277 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-11a2af33-6a22-4021-a2db-fb975b1afc8b tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:52.001700 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-11a2af33-6a22-4021-a2db-fb975b1afc8b tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:52.139205 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-11a2af33-6a22-4021-a2db-fb975b1afc8b tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:34:52.148863 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-11a2af33-6a22-4021-a2db-fb975b1afc8b tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18" status: 200 len: 1371 microversion: 2.1 time: 0.161446 Aug 24 11:34:52.149457 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 190/408] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:34:51 2022] GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18 => generated 1371 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:34:53.174417 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-4f1b89e4-3dde-4a68-87aa-fc5818615573 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:53.175496 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-4f1b89e4-3dde-4a68-87aa-fc5818615573 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: a8ce5b7f-1b02-4746-9aa5-0d826615df18] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:34:53.183286 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-4f1b89e4-3dde-4a68-87aa-fc5818615573 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:53.183770 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-4f1b89e4-3dde-4a68-87aa-fc5818615573 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:53.184207 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-4f1b89e4-3dde-4a68-87aa-fc5818615573 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:53.184974 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-4f1b89e4-3dde-4a68-87aa-fc5818615573 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:53.185431 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-4f1b89e4-3dde-4a68-87aa-fc5818615573 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:53.185857 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-4f1b89e4-3dde-4a68-87aa-fc5818615573 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:53.332680 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-4f1b89e4-3dde-4a68-87aa-fc5818615573 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:34:53.353067 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-4f1b89e4-3dde-4a68-87aa-fc5818615573 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18" status: 200 len: 1371 microversion: 2.1 time: 0.180155 Aug 24 11:34:53.353067 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 219/409] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:34:53 2022] GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18 => generated 1371 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:34:54.370598 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-24d8b380-4c37-4370-afde-5dec5e01b6c3 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:54.371179 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-24d8b380-4c37-4370-afde-5dec5e01b6c3 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: a8ce5b7f-1b02-4746-9aa5-0d826615df18] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:34:54.378107 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-24d8b380-4c37-4370-afde-5dec5e01b6c3 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:54.378720 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-24d8b380-4c37-4370-afde-5dec5e01b6c3 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:54.379163 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-24d8b380-4c37-4370-afde-5dec5e01b6c3 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:54.379865 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-24d8b380-4c37-4370-afde-5dec5e01b6c3 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:54.380338 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-24d8b380-4c37-4370-afde-5dec5e01b6c3 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:54.380790 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-24d8b380-4c37-4370-afde-5dec5e01b6c3 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:54.551352 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-24d8b380-4c37-4370-afde-5dec5e01b6c3 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:34:54.560734 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-24d8b380-4c37-4370-afde-5dec5e01b6c3 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18" status: 200 len: 1371 microversion: 2.1 time: 0.194400 Aug 24 11:34:54.561777 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 191/410] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:34:54 2022] GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18 => generated 1371 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:34:55.584027 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-d4124cc7-e6b1-4c1a-bd05-31fe8eb156b4 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:55.584644 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-d4124cc7-e6b1-4c1a-bd05-31fe8eb156b4 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: a8ce5b7f-1b02-4746-9aa5-0d826615df18] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:34:55.591416 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-d4124cc7-e6b1-4c1a-bd05-31fe8eb156b4 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:55.591891 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-d4124cc7-e6b1-4c1a-bd05-31fe8eb156b4 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:55.592325 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-d4124cc7-e6b1-4c1a-bd05-31fe8eb156b4 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:55.593048 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-d4124cc7-e6b1-4c1a-bd05-31fe8eb156b4 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:55.593523 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-d4124cc7-e6b1-4c1a-bd05-31fe8eb156b4 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:55.593936 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-d4124cc7-e6b1-4c1a-bd05-31fe8eb156b4 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:55.596620 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG dbcounter [-] [124769] Writing DB stats nova_cell1:SELECT=77 {{(pid=124769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:55.746867 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-d4124cc7-e6b1-4c1a-bd05-31fe8eb156b4 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:34:55.754529 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-d4124cc7-e6b1-4c1a-bd05-31fe8eb156b4 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18" status: 200 len: 1371 microversion: 2.1 time: 0.174385 Aug 24 11:34:55.755092 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 220/411] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:34:55 2022] GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18 => generated 1371 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:34:56.777308 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-e7a80eda-5171-4f9a-a7c7-069a1e954690 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:56.777308 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-e7a80eda-5171-4f9a-a7c7-069a1e954690 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: a8ce5b7f-1b02-4746-9aa5-0d826615df18] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:34:56.783096 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e7a80eda-5171-4f9a-a7c7-069a1e954690 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:56.783591 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e7a80eda-5171-4f9a-a7c7-069a1e954690 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:56.784022 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e7a80eda-5171-4f9a-a7c7-069a1e954690 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:56.784727 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e7a80eda-5171-4f9a-a7c7-069a1e954690 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:56.785207 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e7a80eda-5171-4f9a-a7c7-069a1e954690 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:56.785631 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e7a80eda-5171-4f9a-a7c7-069a1e954690 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:56.922038 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-e7a80eda-5171-4f9a-a7c7-069a1e954690 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:34:56.930060 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-e7a80eda-5171-4f9a-a7c7-069a1e954690 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18" status: 200 len: 1371 microversion: 2.1 time: 0.158115 Aug 24 11:34:56.932077 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 192/412] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:34:56 2022] GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18 => generated 1371 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:34:57.952571 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-6f47e281-4681-49d0-bded-12c537ceb5d5 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:57.953868 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-6f47e281-4681-49d0-bded-12c537ceb5d5 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: a8ce5b7f-1b02-4746-9aa5-0d826615df18] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:34:57.956552 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG dbcounter [-] [124769] Writing DB stats nova_api:SELECT=28 {{(pid=124769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:57.961419 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-6f47e281-4681-49d0-bded-12c537ceb5d5 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:57.962827 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-6f47e281-4681-49d0-bded-12c537ceb5d5 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:57.963293 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-6f47e281-4681-49d0-bded-12c537ceb5d5 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:57.964001 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-6f47e281-4681-49d0-bded-12c537ceb5d5 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:57.964454 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-6f47e281-4681-49d0-bded-12c537ceb5d5 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:57.964962 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-6f47e281-4681-49d0-bded-12c537ceb5d5 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:58.111244 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-6f47e281-4681-49d0-bded-12c537ceb5d5 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:34:58.120319 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-6f47e281-4681-49d0-bded-12c537ceb5d5 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18" status: 200 len: 1371 microversion: 2.1 time: 0.171367 Aug 24 11:34:58.135767 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 221/413] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:34:57 2022] GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18 => generated 1371 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:34:58.788687 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-33a3ed34-c875-4837-91f6-716fafe9b65d tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:58.789261 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-33a3ed34-c875-4837-91f6-716fafe9b65d tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] [instance: 0402b684-55db-4c63-8142-de3fd0cc1503] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:34:58.791956 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_api:SELECT=32 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:58.796928 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-33a3ed34-c875-4837-91f6-716fafe9b65d tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:58.797417 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-33a3ed34-c875-4837-91f6-716fafe9b65d tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:58.797849 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-33a3ed34-c875-4837-91f6-716fafe9b65d tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:58.798557 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-33a3ed34-c875-4837-91f6-716fafe9b65d tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:58.799005 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-33a3ed34-c875-4837-91f6-716fafe9b65d tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:58.799483 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-33a3ed34-c875-4837-91f6-716fafe9b65d tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:58.929393 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.objects.instance [None req-33a3ed34-c875-4837-91f6-716fafe9b65d tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lazy-loading 'services' on Instance uuid 0402b684-55db-4c63-8142-de3fd0cc1503 {{(pid=124770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:34:59.156092 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-ed9832c8-fdea-4ba4-8ec0-43065afec8a3 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:59.156812 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-ed9832c8-fdea-4ba4-8ec0-43065afec8a3 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: a8ce5b7f-1b02-4746-9aa5-0d826615df18] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:34:59.168164 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-ed9832c8-fdea-4ba4-8ec0-43065afec8a3 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:59.168698 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-ed9832c8-fdea-4ba4-8ec0-43065afec8a3 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:59.169156 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-ed9832c8-fdea-4ba4-8ec0-43065afec8a3 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:59.169841 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-ed9832c8-fdea-4ba4-8ec0-43065afec8a3 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:59.170289 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-ed9832c8-fdea-4ba4-8ec0-43065afec8a3 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:59.170710 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-ed9832c8-fdea-4ba4-8ec0-43065afec8a3 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:59.303737 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-ed9832c8-fdea-4ba4-8ec0-43065afec8a3 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:34:59.311659 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-ed9832c8-fdea-4ba4-8ec0-43065afec8a3 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18" status: 200 len: 1371 microversion: 2.1 time: 0.160081 Aug 24 11:34:59.312145 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 222/414] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:34:59 2022] GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18 => generated 1371 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:34:59.334612 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-33a3ed34-c875-4837-91f6-716fafe9b65d tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] 10.222.0.84 "DELETE /compute/v2.1/servers/0402b684-55db-4c63-8142-de3fd0cc1503/os-volume_attachments/6d9d9254-5c51-4135-8729-886ef56affcb" status: 202 len: 0 microversion: 2.1 time: 0.550282 Aug 24 11:34:59.335223 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 193/415] 10.222.0.84 () {58 vars in 1416 bytes} [Wed Aug 24 11:34:58 2022] DELETE /compute/v2.1/servers/0402b684-55db-4c63-8142-de3fd0cc1503/os-volume_attachments/6d9d9254-5c51-4135-8729-886ef56affcb => generated 0 bytes in 552 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:35:00.332301 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-a6cee026-cad8-4b8b-a894-82e248460f04 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:35:00.333018 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-a6cee026-cad8-4b8b-a894-82e248460f04 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: a8ce5b7f-1b02-4746-9aa5-0d826615df18] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:35:00.340251 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-a6cee026-cad8-4b8b-a894-82e248460f04 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:00.340753 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-a6cee026-cad8-4b8b-a894-82e248460f04 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:00.341220 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-a6cee026-cad8-4b8b-a894-82e248460f04 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:00.342109 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-a6cee026-cad8-4b8b-a894-82e248460f04 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:00.342562 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-a6cee026-cad8-4b8b-a894-82e248460f04 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:00.342981 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-a6cee026-cad8-4b8b-a894-82e248460f04 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:00.484695 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-a6cee026-cad8-4b8b-a894-82e248460f04 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:35:00.492539 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-a6cee026-cad8-4b8b-a894-82e248460f04 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18" status: 200 len: 1371 microversion: 2.1 time: 0.164007 Aug 24 11:35:00.493295 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 223/416] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:35:00 2022] GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18 => generated 1371 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:35:01.515536 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-a99161a2-8fdd-4702-bf1b-a06e212c01f5 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:35:01.516238 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-a99161a2-8fdd-4702-bf1b-a06e212c01f5 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: a8ce5b7f-1b02-4746-9aa5-0d826615df18] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:35:01.522717 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a99161a2-8fdd-4702-bf1b-a06e212c01f5 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:01.523203 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a99161a2-8fdd-4702-bf1b-a06e212c01f5 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:01.523650 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a99161a2-8fdd-4702-bf1b-a06e212c01f5 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:01.524464 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a99161a2-8fdd-4702-bf1b-a06e212c01f5 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:01.525144 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a99161a2-8fdd-4702-bf1b-a06e212c01f5 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:01.525646 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a99161a2-8fdd-4702-bf1b-a06e212c01f5 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:01.532145 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=1 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:35:01.679733 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-a99161a2-8fdd-4702-bf1b-a06e212c01f5 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:35:01.688020 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-a99161a2-8fdd-4702-bf1b-a06e212c01f5 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18" status: 200 len: 1371 microversion: 2.1 time: 0.177358 Aug 24 11:35:01.688615 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 194/417] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:35:01 2022] GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18 => generated 1371 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:35:02.709065 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-d322e621-22a6-44ad-80fd-d0d05fed25c8 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:35:02.709669 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-d322e621-22a6-44ad-80fd-d0d05fed25c8 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: a8ce5b7f-1b02-4746-9aa5-0d826615df18] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:35:02.716969 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-d322e621-22a6-44ad-80fd-d0d05fed25c8 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:02.717450 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-d322e621-22a6-44ad-80fd-d0d05fed25c8 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:02.717884 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-d322e621-22a6-44ad-80fd-d0d05fed25c8 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:02.718598 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-d322e621-22a6-44ad-80fd-d0d05fed25c8 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:02.719175 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-d322e621-22a6-44ad-80fd-d0d05fed25c8 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:02.719604 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-d322e621-22a6-44ad-80fd-d0d05fed25c8 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:02.854125 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-d322e621-22a6-44ad-80fd-d0d05fed25c8 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:35:02.861839 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-d322e621-22a6-44ad-80fd-d0d05fed25c8 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18" status: 200 len: 1371 microversion: 2.1 time: 0.156649 Aug 24 11:35:02.862424 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 224/418] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:35:02 2022] GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18 => generated 1371 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:35:03.574975 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 11:35:03.575240 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Wed Aug 24 11:35:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 11:35:03.882389 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-2fdaf5c1-84c3-4c68-95ce-21f24f536bf6 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:35:03.882907 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-2fdaf5c1-84c3-4c68-95ce-21f24f536bf6 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: a8ce5b7f-1b02-4746-9aa5-0d826615df18] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:35:03.889832 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-2fdaf5c1-84c3-4c68-95ce-21f24f536bf6 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:03.890315 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-2fdaf5c1-84c3-4c68-95ce-21f24f536bf6 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:03.890752 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-2fdaf5c1-84c3-4c68-95ce-21f24f536bf6 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:03.891443 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-2fdaf5c1-84c3-4c68-95ce-21f24f536bf6 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:03.891902 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-2fdaf5c1-84c3-4c68-95ce-21f24f536bf6 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:03.892325 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-2fdaf5c1-84c3-4c68-95ce-21f24f536bf6 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:04.040484 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-2fdaf5c1-84c3-4c68-95ce-21f24f536bf6 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:35:04.048820 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-2fdaf5c1-84c3-4c68-95ce-21f24f536bf6 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18" status: 200 len: 1371 microversion: 2.1 time: 0.170269 Aug 24 11:35:04.049415 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 195/419] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:35:03 2022] GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18 => generated 1371 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:35:04.526452 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [req-2b179caf-007c-4354-b903-b82906e88d14 req-62d787ce-76b0-41f4-946b-7badd1c3cfba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8ce5b7f-1b02-4746-9aa5-0d826615df18", "name": "network-vif-plugged", "status": "completed", "tag": "808cd754-982d-460a-8dbd-1ce9354861d7"}]} {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:35:04.538190 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [req-2b179caf-007c-4354-b903-b82906e88d14 req-62d787ce-76b0-41f4-946b-7badd1c3cfba service nova] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:04.538669 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [req-2b179caf-007c-4354-b903-b82906e88d14 req-62d787ce-76b0-41f4-946b-7badd1c3cfba service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:04.539108 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [req-2b179caf-007c-4354-b903-b82906e88d14 req-62d787ce-76b0-41f4-946b-7badd1c3cfba service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:04.552169 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.compute.server_external_events [req-2b179caf-007c-4354-b903-b82906e88d14 req-62d787ce-76b0-41f4-946b-7badd1c3cfba service nova] Creating event network-vif-plugged:808cd754-982d-460a-8dbd-1ce9354861d7 for instance a8ce5b7f-1b02-4746-9aa5-0d826615df18 on hv-cinder-85427 Aug 24 11:35:04.558342 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [req-2b179caf-007c-4354-b903-b82906e88d14 req-62d787ce-76b0-41f4-946b-7badd1c3cfba service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035711 Aug 24 11:35:04.559070 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 225/420] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Aug 24 11:35:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:35:05.069664 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-885c9441-8d79-430d-b149-cb3e389761b1 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:35:05.070277 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-885c9441-8d79-430d-b149-cb3e389761b1 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: a8ce5b7f-1b02-4746-9aa5-0d826615df18] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:35:05.077868 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-885c9441-8d79-430d-b149-cb3e389761b1 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:05.087647 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-885c9441-8d79-430d-b149-cb3e389761b1 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:05.087647 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-885c9441-8d79-430d-b149-cb3e389761b1 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:05.087647 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-885c9441-8d79-430d-b149-cb3e389761b1 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:05.087647 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-885c9441-8d79-430d-b149-cb3e389761b1 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:05.088355 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-885c9441-8d79-430d-b149-cb3e389761b1 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:05.146291 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 11:35:05.146291 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Wed Aug 24 11:35:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18 (ip 10.222.0.84) !!! Aug 24 11:35:05.240575 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-885c9441-8d79-430d-b149-cb3e389761b1 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:35:05.242759 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-885c9441-8d79-430d-b149-cb3e389761b1 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18" status: 200 len: 1371 microversion: 2.1 time: 0.176788 Aug 24 11:35:05.243743 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 196/421] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:35:05 2022] GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18 => generated 1371 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:35:06.268001 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-4dc04886-afe8-4aa4-b789-34498a19af7f tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:35:06.268781 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-4dc04886-afe8-4aa4-b789-34498a19af7f tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: a8ce5b7f-1b02-4746-9aa5-0d826615df18] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:35:06.275717 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-4dc04886-afe8-4aa4-b789-34498a19af7f tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:06.276201 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-4dc04886-afe8-4aa4-b789-34498a19af7f tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:06.276641 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-4dc04886-afe8-4aa4-b789-34498a19af7f tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:06.277351 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-4dc04886-afe8-4aa4-b789-34498a19af7f tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:06.277800 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-4dc04886-afe8-4aa4-b789-34498a19af7f tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:06.278220 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-4dc04886-afe8-4aa4-b789-34498a19af7f tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:06.413519 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-4dc04886-afe8-4aa4-b789-34498a19af7f tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:35:06.422062 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-4dc04886-afe8-4aa4-b789-34498a19af7f tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18" status: 200 len: 1371 microversion: 2.1 time: 0.159972 Aug 24 11:35:06.422646 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 226/422] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:35:06 2022] GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18 => generated 1371 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:35:07.443429 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-8aa52eb3-9e15-46b9-8567-c7741316f55a tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:35:07.444027 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-8aa52eb3-9e15-46b9-8567-c7741316f55a tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: a8ce5b7f-1b02-4746-9aa5-0d826615df18] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:35:07.451575 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8aa52eb3-9e15-46b9-8567-c7741316f55a tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:07.452064 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8aa52eb3-9e15-46b9-8567-c7741316f55a tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:07.452504 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8aa52eb3-9e15-46b9-8567-c7741316f55a tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:07.453228 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8aa52eb3-9e15-46b9-8567-c7741316f55a tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:07.453689 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8aa52eb3-9e15-46b9-8567-c7741316f55a tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:07.454112 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8aa52eb3-9e15-46b9-8567-c7741316f55a tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:07.598462 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-8aa52eb3-9e15-46b9-8567-c7741316f55a tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:35:07.607474 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-8aa52eb3-9e15-46b9-8567-c7741316f55a tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18" status: 200 len: 1371 microversion: 2.1 time: 0.167712 Aug 24 11:35:07.608020 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 197/423] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:35:07 2022] GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18 => generated 1371 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:35:08.629279 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-2e6ba36b-26cc-4f31-bdbc-0b0ca2350d4e tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:35:08.629935 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-2e6ba36b-26cc-4f31-bdbc-0b0ca2350d4e tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: a8ce5b7f-1b02-4746-9aa5-0d826615df18] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:35:08.637178 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-2e6ba36b-26cc-4f31-bdbc-0b0ca2350d4e tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:08.637673 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-2e6ba36b-26cc-4f31-bdbc-0b0ca2350d4e tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:08.638111 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-2e6ba36b-26cc-4f31-bdbc-0b0ca2350d4e tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:08.638822 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-2e6ba36b-26cc-4f31-bdbc-0b0ca2350d4e tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:08.639275 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-2e6ba36b-26cc-4f31-bdbc-0b0ca2350d4e tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:08.639694 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-2e6ba36b-26cc-4f31-bdbc-0b0ca2350d4e tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:08.784564 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-2e6ba36b-26cc-4f31-bdbc-0b0ca2350d4e tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:35:08.794993 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-2e6ba36b-26cc-4f31-bdbc-0b0ca2350d4e tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18" status: 200 len: 1371 microversion: 2.1 time: 0.169750 Aug 24 11:35:08.795581 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 227/424] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:35:08 2022] GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18 => generated 1371 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:35:09.817557 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-2247ea05-000a-4839-8e04-d20092196045 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:35:09.818272 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-2247ea05-000a-4839-8e04-d20092196045 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: a8ce5b7f-1b02-4746-9aa5-0d826615df18] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:35:09.825820 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-2247ea05-000a-4839-8e04-d20092196045 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:09.826347 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-2247ea05-000a-4839-8e04-d20092196045 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:09.826782 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-2247ea05-000a-4839-8e04-d20092196045 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:09.827843 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-2247ea05-000a-4839-8e04-d20092196045 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:09.828303 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-2247ea05-000a-4839-8e04-d20092196045 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:09.828730 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-2247ea05-000a-4839-8e04-d20092196045 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:09.975615 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-2247ea05-000a-4839-8e04-d20092196045 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:35:09.987370 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-2247ea05-000a-4839-8e04-d20092196045 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18" status: 200 len: 1371 microversion: 2.1 time: 0.173723 Aug 24 11:35:09.988560 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 198/425] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:35:09 2022] GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18 => generated 1371 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:35:11.011815 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-55973668-e840-4eb5-adeb-eb489c7efe60 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:35:11.012345 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-55973668-e840-4eb5-adeb-eb489c7efe60 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: a8ce5b7f-1b02-4746-9aa5-0d826615df18] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:35:11.019351 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-55973668-e840-4eb5-adeb-eb489c7efe60 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:11.019845 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-55973668-e840-4eb5-adeb-eb489c7efe60 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:11.020282 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-55973668-e840-4eb5-adeb-eb489c7efe60 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:11.021005 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-55973668-e840-4eb5-adeb-eb489c7efe60 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:11.021463 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-55973668-e840-4eb5-adeb-eb489c7efe60 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:11.021905 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-55973668-e840-4eb5-adeb-eb489c7efe60 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:11.175655 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-55973668-e840-4eb5-adeb-eb489c7efe60 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:35:11.183663 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-55973668-e840-4eb5-adeb-eb489c7efe60 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18" status: 200 len: 1371 microversion: 2.1 time: 0.175998 Aug 24 11:35:11.184244 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 228/426] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:35:11 2022] GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18 => generated 1371 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:35:12.187641 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-52012020-7507-4ffe-a78f-cc2089d4f753 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:35:12.188212 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-52012020-7507-4ffe-a78f-cc2089d4f753 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] [instance: 0402b684-55db-4c63-8142-de3fd0cc1503] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:35:12.194771 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-52012020-7507-4ffe-a78f-cc2089d4f753 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:12.195251 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-52012020-7507-4ffe-a78f-cc2089d4f753 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:12.196432 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-52012020-7507-4ffe-a78f-cc2089d4f753 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:12.196933 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-52012020-7507-4ffe-a78f-cc2089d4f753 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:12.197382 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-52012020-7507-4ffe-a78f-cc2089d4f753 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:12.197801 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-52012020-7507-4ffe-a78f-cc2089d4f753 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:12.205390 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-bae9e5e7-3bc2-4026-acae-6c89df6dac5b tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:35:12.206024 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-bae9e5e7-3bc2-4026-acae-6c89df6dac5b tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: a8ce5b7f-1b02-4746-9aa5-0d826615df18] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:35:12.213317 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-bae9e5e7-3bc2-4026-acae-6c89df6dac5b tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:12.213802 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-bae9e5e7-3bc2-4026-acae-6c89df6dac5b tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:12.214235 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-bae9e5e7-3bc2-4026-acae-6c89df6dac5b tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:12.215021 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-bae9e5e7-3bc2-4026-acae-6c89df6dac5b tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:12.215462 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-bae9e5e7-3bc2-4026-acae-6c89df6dac5b tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:12.215883 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-bae9e5e7-3bc2-4026-acae-6c89df6dac5b tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:12.224830 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-52012020-7507-4ffe-a78f-cc2089d4f753 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] [instance: 0402b684-55db-4c63-8142-de3fd0cc1503] Going to try to terminate instance {{(pid=124770) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 11:35:12.355200 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-bae9e5e7-3bc2-4026-acae-6c89df6dac5b tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:35:12.363188 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-bae9e5e7-3bc2-4026-acae-6c89df6dac5b tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18" status: 200 len: 1371 microversion: 2.1 time: 0.161583 Aug 24 11:35:12.363775 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 229/427] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:35:12 2022] GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18 => generated 1371 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:35:12.866958 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-52012020-7507-4ffe-a78f-cc2089d4f753 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] 10.222.0.84 "DELETE /compute/v2.1/servers/0402b684-55db-4c63-8142-de3fd0cc1503" status: 204 len: 0 microversion: 2.1 time: 0.682606 Aug 24 11:35:12.868243 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 199/428] 10.222.0.84 () {58 vars in 1239 bytes} [Wed Aug 24 11:35:12 2022] DELETE /compute/v2.1/servers/0402b684-55db-4c63-8142-de3fd0cc1503 => generated 0 bytes in 685 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 11:35:12.883442 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-79c8c49d-e8c1-4d38-bca8-bf006a10f5dc tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:35:12.884091 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-79c8c49d-e8c1-4d38-bca8-bf006a10f5dc tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] [instance: 0402b684-55db-4c63-8142-de3fd0cc1503] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:35:12.890269 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-79c8c49d-e8c1-4d38-bca8-bf006a10f5dc tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:12.890756 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-79c8c49d-e8c1-4d38-bca8-bf006a10f5dc tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:12.891372 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-79c8c49d-e8c1-4d38-bca8-bf006a10f5dc tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:12.892076 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-79c8c49d-e8c1-4d38-bca8-bf006a10f5dc tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:12.892527 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-79c8c49d-e8c1-4d38-bca8-bf006a10f5dc tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:12.894739 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-79c8c49d-e8c1-4d38-bca8-bf006a10f5dc tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:13.043158 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-79c8c49d-e8c1-4d38-bca8-bf006a10f5dc tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5055ddeab8314c93bb2a664f9d1a7f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f910065fc9da40798c7f3d4366dab7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:35:13.051741 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-79c8c49d-e8c1-4d38-bca8-bf006a10f5dc tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] 10.222.0.84 "GET /compute/v2.1/servers/0402b684-55db-4c63-8142-de3fd0cc1503" status: 200 len: 1515 microversion: 2.1 time: 0.174021 Aug 24 11:35:13.052317 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 230/429] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:35:12 2022] GET /compute/v2.1/servers/0402b684-55db-4c63-8142-de3fd0cc1503 => generated 1515 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:35:13.386147 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-bbc3f541-ec73-4b11-aff4-464e4716b36f tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:35:13.386752 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-bbc3f541-ec73-4b11-aff4-464e4716b36f tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: a8ce5b7f-1b02-4746-9aa5-0d826615df18] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:35:13.393924 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-bbc3f541-ec73-4b11-aff4-464e4716b36f tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:13.394411 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-bbc3f541-ec73-4b11-aff4-464e4716b36f tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:13.394845 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-bbc3f541-ec73-4b11-aff4-464e4716b36f tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:13.395540 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-bbc3f541-ec73-4b11-aff4-464e4716b36f tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:13.396060 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-bbc3f541-ec73-4b11-aff4-464e4716b36f tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:13.396484 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-bbc3f541-ec73-4b11-aff4-464e4716b36f tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:13.548527 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-bbc3f541-ec73-4b11-aff4-464e4716b36f tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:35:13.557948 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-bbc3f541-ec73-4b11-aff4-464e4716b36f tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18" status: 200 len: 1371 microversion: 2.1 time: 0.176230 Aug 24 11:35:13.558678 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 200/430] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:35:13 2022] GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18 => generated 1371 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:35:14.075181 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-9ee4cdb7-177c-4901-a469-7e442ac7b208 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:35:14.075811 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-9ee4cdb7-177c-4901-a469-7e442ac7b208 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] [instance: 0402b684-55db-4c63-8142-de3fd0cc1503] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:35:14.083288 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-9ee4cdb7-177c-4901-a469-7e442ac7b208 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:14.083781 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-9ee4cdb7-177c-4901-a469-7e442ac7b208 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:14.084398 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-9ee4cdb7-177c-4901-a469-7e442ac7b208 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:14.085098 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-9ee4cdb7-177c-4901-a469-7e442ac7b208 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:14.085494 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-9ee4cdb7-177c-4901-a469-7e442ac7b208 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:14.085929 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-9ee4cdb7-177c-4901-a469-7e442ac7b208 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:14.240926 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-9ee4cdb7-177c-4901-a469-7e442ac7b208 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5055ddeab8314c93bb2a664f9d1a7f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f910065fc9da40798c7f3d4366dab7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:35:14.253429 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-9ee4cdb7-177c-4901-a469-7e442ac7b208 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] 10.222.0.84 "GET /compute/v2.1/servers/0402b684-55db-4c63-8142-de3fd0cc1503" status: 200 len: 1515 microversion: 2.1 time: 0.183316 Aug 24 11:35:14.254498 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 231/431] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:35:14 2022] GET /compute/v2.1/servers/0402b684-55db-4c63-8142-de3fd0cc1503 => generated 1515 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:35:14.589881 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-ea2c274e-e2f3-446b-a2a1-8378164b18fb tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:35:14.590499 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-ea2c274e-e2f3-446b-a2a1-8378164b18fb tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: a8ce5b7f-1b02-4746-9aa5-0d826615df18] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:35:14.598118 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ea2c274e-e2f3-446b-a2a1-8378164b18fb tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:14.598617 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ea2c274e-e2f3-446b-a2a1-8378164b18fb tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:14.599061 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ea2c274e-e2f3-446b-a2a1-8378164b18fb tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:14.599879 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ea2c274e-e2f3-446b-a2a1-8378164b18fb tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:14.600346 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ea2c274e-e2f3-446b-a2a1-8378164b18fb tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:14.600776 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ea2c274e-e2f3-446b-a2a1-8378164b18fb tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:14.752692 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-ea2c274e-e2f3-446b-a2a1-8378164b18fb tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:35:14.761623 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-ea2c274e-e2f3-446b-a2a1-8378164b18fb tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18" status: 200 len: 1371 microversion: 2.1 time: 0.176065 Aug 24 11:35:14.762213 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 201/432] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:35:14 2022] GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18 => generated 1371 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:35:15.285563 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-0adcf109-188c-4638-b799-b22ec12a81f5 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:35:15.293968 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-0adcf109-188c-4638-b799-b22ec12a81f5 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] [instance: 0402b684-55db-4c63-8142-de3fd0cc1503] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:35:15.294616 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-0adcf109-188c-4638-b799-b22ec12a81f5 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:15.295189 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-0adcf109-188c-4638-b799-b22ec12a81f5 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:15.295749 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-0adcf109-188c-4638-b799-b22ec12a81f5 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:15.296541 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-0adcf109-188c-4638-b799-b22ec12a81f5 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:15.297417 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-0adcf109-188c-4638-b799-b22ec12a81f5 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:15.298032 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-0adcf109-188c-4638-b799-b22ec12a81f5 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:15.444652 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-0adcf109-188c-4638-b799-b22ec12a81f5 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5055ddeab8314c93bb2a664f9d1a7f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f910065fc9da40798c7f3d4366dab7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:35:15.453660 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-0adcf109-188c-4638-b799-b22ec12a81f5 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] 10.222.0.84 "GET /compute/v2.1/servers/0402b684-55db-4c63-8142-de3fd0cc1503" status: 200 len: 1515 microversion: 2.1 time: 0.173409 Aug 24 11:35:15.454232 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 232/433] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:35:15 2022] GET /compute/v2.1/servers/0402b684-55db-4c63-8142-de3fd0cc1503 => generated 1515 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:35:15.782722 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-68daa096-ac66-42c9-b51e-9651b0e71fdf tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:35:15.783353 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-68daa096-ac66-42c9-b51e-9651b0e71fdf tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: a8ce5b7f-1b02-4746-9aa5-0d826615df18] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:35:15.790286 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-68daa096-ac66-42c9-b51e-9651b0e71fdf tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:15.790781 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-68daa096-ac66-42c9-b51e-9651b0e71fdf tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:15.791216 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-68daa096-ac66-42c9-b51e-9651b0e71fdf tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:15.791918 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-68daa096-ac66-42c9-b51e-9651b0e71fdf tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:15.792374 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-68daa096-ac66-42c9-b51e-9651b0e71fdf tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:15.792817 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-68daa096-ac66-42c9-b51e-9651b0e71fdf tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:15.937811 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-68daa096-ac66-42c9-b51e-9651b0e71fdf tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:35:15.946413 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-68daa096-ac66-42c9-b51e-9651b0e71fdf tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18" status: 200 len: 1371 microversion: 2.1 time: 0.167003 Aug 24 11:35:15.947710 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 202/434] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:35:15 2022] GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18 => generated 1371 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:35:16.475932 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-50464083-d696-434b-93da-c125ac38eaba tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:35:16.476557 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-50464083-d696-434b-93da-c125ac38eaba tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] [instance: 0402b684-55db-4c63-8142-de3fd0cc1503] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:35:16.484341 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-50464083-d696-434b-93da-c125ac38eaba tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:16.484850 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-50464083-d696-434b-93da-c125ac38eaba tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:16.485283 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-50464083-d696-434b-93da-c125ac38eaba tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:16.485982 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-50464083-d696-434b-93da-c125ac38eaba tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:16.486428 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-50464083-d696-434b-93da-c125ac38eaba tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:16.486846 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-50464083-d696-434b-93da-c125ac38eaba tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:16.645129 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-50464083-d696-434b-93da-c125ac38eaba tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5055ddeab8314c93bb2a664f9d1a7f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f910065fc9da40798c7f3d4366dab7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:35:16.654681 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-50464083-d696-434b-93da-c125ac38eaba tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] 10.222.0.84 "GET /compute/v2.1/servers/0402b684-55db-4c63-8142-de3fd0cc1503" status: 200 len: 1515 microversion: 2.1 time: 0.182192 Aug 24 11:35:16.655279 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 233/435] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:35:16 2022] GET /compute/v2.1/servers/0402b684-55db-4c63-8142-de3fd0cc1503 => generated 1515 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:35:16.974692 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-85b44d9b-13fd-433f-8ae8-97f8711a0a65 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:35:16.975642 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-85b44d9b-13fd-433f-8ae8-97f8711a0a65 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: a8ce5b7f-1b02-4746-9aa5-0d826615df18] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:35:16.986689 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-85b44d9b-13fd-433f-8ae8-97f8711a0a65 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:16.987503 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-85b44d9b-13fd-433f-8ae8-97f8711a0a65 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:16.988241 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-85b44d9b-13fd-433f-8ae8-97f8711a0a65 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:16.989506 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-85b44d9b-13fd-433f-8ae8-97f8711a0a65 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:16.990296 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-85b44d9b-13fd-433f-8ae8-97f8711a0a65 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:16.991028 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-85b44d9b-13fd-433f-8ae8-97f8711a0a65 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:17.147488 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-85b44d9b-13fd-433f-8ae8-97f8711a0a65 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:35:17.158095 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-85b44d9b-13fd-433f-8ae8-97f8711a0a65 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18" status: 200 len: 1371 microversion: 2.1 time: 0.190283 Aug 24 11:35:17.158739 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 203/436] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:35:16 2022] GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18 => generated 1371 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:35:17.678349 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-35dda307-ab31-4c34-b6b0-ccc71842dddc tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:35:17.679071 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-35dda307-ab31-4c34-b6b0-ccc71842dddc tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] [instance: 0402b684-55db-4c63-8142-de3fd0cc1503] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:35:17.686141 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-35dda307-ab31-4c34-b6b0-ccc71842dddc tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:17.686660 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-35dda307-ab31-4c34-b6b0-ccc71842dddc tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:17.687101 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-35dda307-ab31-4c34-b6b0-ccc71842dddc tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:17.687793 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-35dda307-ab31-4c34-b6b0-ccc71842dddc tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:17.688276 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-35dda307-ab31-4c34-b6b0-ccc71842dddc tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:17.688694 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-35dda307-ab31-4c34-b6b0-ccc71842dddc tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:17.843668 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-35dda307-ab31-4c34-b6b0-ccc71842dddc tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5055ddeab8314c93bb2a664f9d1a7f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f910065fc9da40798c7f3d4366dab7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:35:17.852454 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-35dda307-ab31-4c34-b6b0-ccc71842dddc tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] 10.222.0.84 "GET /compute/v2.1/servers/0402b684-55db-4c63-8142-de3fd0cc1503" status: 200 len: 1515 microversion: 2.1 time: 0.177614 Aug 24 11:35:17.852937 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 234/437] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:35:17 2022] GET /compute/v2.1/servers/0402b684-55db-4c63-8142-de3fd0cc1503 => generated 1515 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:35:18.179651 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-3db463d4-2790-4d43-9dcb-f4be23d7f0ea tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:35:18.181452 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-3db463d4-2790-4d43-9dcb-f4be23d7f0ea tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: a8ce5b7f-1b02-4746-9aa5-0d826615df18] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:35:18.188385 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-3db463d4-2790-4d43-9dcb-f4be23d7f0ea tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:18.188913 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-3db463d4-2790-4d43-9dcb-f4be23d7f0ea tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:18.189356 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-3db463d4-2790-4d43-9dcb-f4be23d7f0ea tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:18.190064 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-3db463d4-2790-4d43-9dcb-f4be23d7f0ea tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:18.190519 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-3db463d4-2790-4d43-9dcb-f4be23d7f0ea tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:18.190943 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-3db463d4-2790-4d43-9dcb-f4be23d7f0ea tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:18.335101 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-3db463d4-2790-4d43-9dcb-f4be23d7f0ea tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:35:18.344409 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-3db463d4-2790-4d43-9dcb-f4be23d7f0ea tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18" status: 200 len: 1371 microversion: 2.1 time: 0.168683 Aug 24 11:35:18.345034 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 204/438] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:35:18 2022] GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18 => generated 1371 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:35:18.873613 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-79718354-fe50-40d6-bd40-b14fa8b396dd tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:35:18.874216 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-79718354-fe50-40d6-bd40-b14fa8b396dd tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] [instance: 0402b684-55db-4c63-8142-de3fd0cc1503] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:35:18.880779 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-79718354-fe50-40d6-bd40-b14fa8b396dd tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:18.881288 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-79718354-fe50-40d6-bd40-b14fa8b396dd tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:18.881722 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-79718354-fe50-40d6-bd40-b14fa8b396dd tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:18.882404 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-79718354-fe50-40d6-bd40-b14fa8b396dd tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:18.883402 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-79718354-fe50-40d6-bd40-b14fa8b396dd tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:18.883827 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-79718354-fe50-40d6-bd40-b14fa8b396dd tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:19.013553 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-79718354-fe50-40d6-bd40-b14fa8b396dd tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5055ddeab8314c93bb2a664f9d1a7f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f910065fc9da40798c7f3d4366dab7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:35:19.021402 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-79718354-fe50-40d6-bd40-b14fa8b396dd tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] 10.222.0.84 "GET /compute/v2.1/servers/0402b684-55db-4c63-8142-de3fd0cc1503" status: 200 len: 1515 microversion: 2.1 time: 0.151880 Aug 24 11:35:19.021976 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 235/439] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:35:18 2022] GET /compute/v2.1/servers/0402b684-55db-4c63-8142-de3fd0cc1503 => generated 1515 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:35:19.368715 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-4f56af78-adab-49f2-bc99-5f1e95a49b89 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:35:19.369638 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-4f56af78-adab-49f2-bc99-5f1e95a49b89 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: a8ce5b7f-1b02-4746-9aa5-0d826615df18] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:35:19.376859 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4f56af78-adab-49f2-bc99-5f1e95a49b89 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:19.377378 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4f56af78-adab-49f2-bc99-5f1e95a49b89 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:19.377933 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4f56af78-adab-49f2-bc99-5f1e95a49b89 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:19.378778 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4f56af78-adab-49f2-bc99-5f1e95a49b89 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:19.379249 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4f56af78-adab-49f2-bc99-5f1e95a49b89 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:19.379676 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4f56af78-adab-49f2-bc99-5f1e95a49b89 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:19.529317 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-4f56af78-adab-49f2-bc99-5f1e95a49b89 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:35:19.537403 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-4f56af78-adab-49f2-bc99-5f1e95a49b89 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18" status: 200 len: 1371 microversion: 2.1 time: 0.173503 Aug 24 11:35:19.537986 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 205/440] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:35:19 2022] GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18 => generated 1371 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:35:20.042780 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-67148a19-f4e3-45bb-8711-5c9d9c54823b tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:35:20.043399 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-67148a19-f4e3-45bb-8711-5c9d9c54823b tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] [instance: 0402b684-55db-4c63-8142-de3fd0cc1503] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:35:20.049970 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-67148a19-f4e3-45bb-8711-5c9d9c54823b tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:20.050442 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-67148a19-f4e3-45bb-8711-5c9d9c54823b tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:20.050871 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-67148a19-f4e3-45bb-8711-5c9d9c54823b tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:20.051660 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-67148a19-f4e3-45bb-8711-5c9d9c54823b tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:20.052240 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-67148a19-f4e3-45bb-8711-5c9d9c54823b tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:20.052701 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-67148a19-f4e3-45bb-8711-5c9d9c54823b tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:20.183074 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-67148a19-f4e3-45bb-8711-5c9d9c54823b tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5055ddeab8314c93bb2a664f9d1a7f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f910065fc9da40798c7f3d4366dab7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:35:20.190870 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-67148a19-f4e3-45bb-8711-5c9d9c54823b tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] 10.222.0.84 "GET /compute/v2.1/servers/0402b684-55db-4c63-8142-de3fd0cc1503" status: 200 len: 1515 microversion: 2.1 time: 0.152714 Aug 24 11:35:20.191428 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 236/441] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:35:20 2022] GET /compute/v2.1/servers/0402b684-55db-4c63-8142-de3fd0cc1503 => generated 1515 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:35:20.560973 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-fc69f378-6236-457f-ac97-2c73b29edb5b tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:35:20.561834 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-fc69f378-6236-457f-ac97-2c73b29edb5b tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: a8ce5b7f-1b02-4746-9aa5-0d826615df18] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:35:20.568634 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-fc69f378-6236-457f-ac97-2c73b29edb5b tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:20.569196 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-fc69f378-6236-457f-ac97-2c73b29edb5b tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:20.569638 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-fc69f378-6236-457f-ac97-2c73b29edb5b tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:20.570998 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-fc69f378-6236-457f-ac97-2c73b29edb5b tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:20.572240 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-fc69f378-6236-457f-ac97-2c73b29edb5b tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:20.572678 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-fc69f378-6236-457f-ac97-2c73b29edb5b tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:20.731151 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-fc69f378-6236-457f-ac97-2c73b29edb5b tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:35:20.740668 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-fc69f378-6236-457f-ac97-2c73b29edb5b tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18" status: 200 len: 1564 microversion: 2.1 time: 0.183701 Aug 24 11:35:20.741399 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 206/442] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:35:20 2022] GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18 => generated 1564 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:35:20.763263 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-c0b3ed2f-dfda-4ab3-8c62-fe352894d6f3 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:35:20.763747 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-c0b3ed2f-dfda-4ab3-8c62-fe352894d6f3 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: a8ce5b7f-1b02-4746-9aa5-0d826615df18] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:35:20.770605 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-c0b3ed2f-dfda-4ab3-8c62-fe352894d6f3 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:20.771443 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-c0b3ed2f-dfda-4ab3-8c62-fe352894d6f3 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:20.771925 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-c0b3ed2f-dfda-4ab3-8c62-fe352894d6f3 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:20.772963 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-c0b3ed2f-dfda-4ab3-8c62-fe352894d6f3 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:20.774449 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-c0b3ed2f-dfda-4ab3-8c62-fe352894d6f3 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:20.774900 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-c0b3ed2f-dfda-4ab3-8c62-fe352894d6f3 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:20.792826 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG dbcounter [-] [124769] Writing DB stats nova_cell1:SELECT=100 {{(pid=124769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:35:20.874165 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-c0b3ed2f-dfda-4ab3-8c62-fe352894d6f3 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.114861 Aug 24 11:35:20.874749 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 237/443] 10.222.0.84 () {58 vars in 1275 bytes} [Wed Aug 24 11:35:20 2022] GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18/os-interface => generated 284 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:35:21.215079 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-82227de0-3b4c-45bb-9e6e-6bc03ecc39b8 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:35:21.216288 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-82227de0-3b4c-45bb-9e6e-6bc03ecc39b8 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] [instance: 0402b684-55db-4c63-8142-de3fd0cc1503] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:35:21.224750 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-82227de0-3b4c-45bb-9e6e-6bc03ecc39b8 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:21.225212 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-82227de0-3b4c-45bb-9e6e-6bc03ecc39b8 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:21.225591 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-82227de0-3b4c-45bb-9e6e-6bc03ecc39b8 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:21.226316 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-82227de0-3b4c-45bb-9e6e-6bc03ecc39b8 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:21.226822 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-82227de0-3b4c-45bb-9e6e-6bc03ecc39b8 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:21.227942 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-82227de0-3b4c-45bb-9e6e-6bc03ecc39b8 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:21.408246 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-82227de0-3b4c-45bb-9e6e-6bc03ecc39b8 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5055ddeab8314c93bb2a664f9d1a7f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f910065fc9da40798c7f3d4366dab7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:35:21.417771 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-82227de0-3b4c-45bb-9e6e-6bc03ecc39b8 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] 10.222.0.84 "GET /compute/v2.1/servers/0402b684-55db-4c63-8142-de3fd0cc1503" status: 200 len: 1515 microversion: 2.1 time: 0.207757 Aug 24 11:35:21.420689 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 207/444] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:35:21 2022] GET /compute/v2.1/servers/0402b684-55db-4c63-8142-de3fd0cc1503 => generated 1515 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:35:22.125252 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [req-7de83800-ec02-4ffd-be72-b3c001e27222 req-d5ca8872-6ccf-44e2-8b58-b962c0d8a4b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8ce5b7f-1b02-4746-9aa5-0d826615df18", "tag": "808cd754-982d-460a-8dbd-1ce9354861d7"}]} {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:35:22.135037 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [req-7de83800-ec02-4ffd-be72-b3c001e27222 req-d5ca8872-6ccf-44e2-8b58-b962c0d8a4b1 service nova] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:22.136717 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [req-7de83800-ec02-4ffd-be72-b3c001e27222 req-d5ca8872-6ccf-44e2-8b58-b962c0d8a4b1 service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:22.136717 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [req-7de83800-ec02-4ffd-be72-b3c001e27222 req-d5ca8872-6ccf-44e2-8b58-b962c0d8a4b1 service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:22.151744 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.compute.server_external_events [req-7de83800-ec02-4ffd-be72-b3c001e27222 req-d5ca8872-6ccf-44e2-8b58-b962c0d8a4b1 service nova] Creating event network-changed:808cd754-982d-460a-8dbd-1ce9354861d7 for instance a8ce5b7f-1b02-4746-9aa5-0d826615df18 on hv-cinder-85427 Aug 24 11:35:22.157128 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [req-7de83800-ec02-4ffd-be72-b3c001e27222 req-d5ca8872-6ccf-44e2-8b58-b962c0d8a4b1 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036237 Aug 24 11:35:22.157818 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 238/445] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Aug 24 11:35:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:35:22.305412 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [req-1aa44d05-77f3-4641-9441-e33c45735702 req-84219fc1-fd40-47a6-9560-b20e652e93cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0402b684-55db-4c63-8142-de3fd0cc1503", "name": "network-vif-deleted", "tag": "e238f4c5-1b92-4a5f-873c-298914f522f1"}]} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:35:22.322786 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-1aa44d05-77f3-4641-9441-e33c45735702 req-84219fc1-fd40-47a6-9560-b20e652e93cb service nova] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:22.322786 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-1aa44d05-77f3-4641-9441-e33c45735702 req-84219fc1-fd40-47a6-9560-b20e652e93cb service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:22.322786 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-1aa44d05-77f3-4641-9441-e33c45735702 req-84219fc1-fd40-47a6-9560-b20e652e93cb service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:22.344037 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.compute.server_external_events [req-1aa44d05-77f3-4641-9441-e33c45735702 req-84219fc1-fd40-47a6-9560-b20e652e93cb service nova] Creating event network-vif-deleted:e238f4c5-1b92-4a5f-873c-298914f522f1 for instance 0402b684-55db-4c63-8142-de3fd0cc1503 on hv-cinder-85427 Aug 24 11:35:22.351750 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [req-1aa44d05-77f3-4641-9441-e33c45735702 req-84219fc1-fd40-47a6-9560-b20e652e93cb service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053381 Aug 24 11:35:22.352963 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 208/446] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Aug 24 11:35:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:35:22.442364 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-535a5367-cee4-4147-b542-a8b6d15cfa1c tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:35:22.443573 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-535a5367-cee4-4147-b542-a8b6d15cfa1c tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] [instance: 0402b684-55db-4c63-8142-de3fd0cc1503] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:35:22.452588 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-535a5367-cee4-4147-b542-a8b6d15cfa1c tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:22.453604 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-535a5367-cee4-4147-b542-a8b6d15cfa1c tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:22.454669 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-535a5367-cee4-4147-b542-a8b6d15cfa1c tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:22.455517 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-535a5367-cee4-4147-b542-a8b6d15cfa1c tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:22.455975 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-535a5367-cee4-4147-b542-a8b6d15cfa1c tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:22.456426 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-535a5367-cee4-4147-b542-a8b6d15cfa1c tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:22.558849 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-535a5367-cee4-4147-b542-a8b6d15cfa1c tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5055ddeab8314c93bb2a664f9d1a7f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f910065fc9da40798c7f3d4366dab7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:35:22.572788 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-535a5367-cee4-4147-b542-a8b6d15cfa1c tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] 10.222.0.84 "GET /compute/v2.1/servers/0402b684-55db-4c63-8142-de3fd0cc1503" status: 200 len: 1473 microversion: 2.1 time: 0.135366 Aug 24 11:35:22.573745 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 239/447] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:35:22 2022] GET /compute/v2.1/servers/0402b684-55db-4c63-8142-de3fd0cc1503 => generated 1473 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:35:23.597601 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-b013ea95-f86c-4538-90dc-e874f1c0bcfc tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:35:23.598307 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-b013ea95-f86c-4538-90dc-e874f1c0bcfc tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] [instance: 0402b684-55db-4c63-8142-de3fd0cc1503] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:35:23.605532 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b013ea95-f86c-4538-90dc-e874f1c0bcfc tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:23.611358 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b013ea95-f86c-4538-90dc-e874f1c0bcfc tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:23.611358 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b013ea95-f86c-4538-90dc-e874f1c0bcfc tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:23.611358 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b013ea95-f86c-4538-90dc-e874f1c0bcfc tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:23.611358 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b013ea95-f86c-4538-90dc-e874f1c0bcfc tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:23.611754 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b013ea95-f86c-4538-90dc-e874f1c0bcfc tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:23.649958 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b013ea95-f86c-4538-90dc-e874f1c0bcfc tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:23.650510 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b013ea95-f86c-4538-90dc-e874f1c0bcfc tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:23.650996 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b013ea95-f86c-4538-90dc-e874f1c0bcfc tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:23.666378 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.objects.instance [None req-b013ea95-f86c-4538-90dc-e874f1c0bcfc tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lazy-loading 'fault' on Instance uuid 0402b684-55db-4c63-8142-de3fd0cc1503 {{(pid=124770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:35:23.666378 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:35:23.715820 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-b013ea95-f86c-4538-90dc-e874f1c0bcfc tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5055ddeab8314c93bb2a664f9d1a7f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f910065fc9da40798c7f3d4366dab7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:35:23.724941 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-b013ea95-f86c-4538-90dc-e874f1c0bcfc tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] 10.222.0.84 "GET /compute/v2.1/servers/0402b684-55db-4c63-8142-de3fd0cc1503" status: 200 len: 1309 microversion: 2.1 time: 0.133806 Aug 24 11:35:23.725921 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 209/448] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:35:23 2022] GET /compute/v2.1/servers/0402b684-55db-4c63-8142-de3fd0cc1503 => generated 1309 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:35:24.749203 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-e2d3da0c-77f6-4cee-a8f5-64ac618bcb25 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:35:24.749931 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-e2d3da0c-77f6-4cee-a8f5-64ac618bcb25 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] [instance: 0402b684-55db-4c63-8142-de3fd0cc1503] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:35:24.757471 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-e2d3da0c-77f6-4cee-a8f5-64ac618bcb25 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:24.758047 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-e2d3da0c-77f6-4cee-a8f5-64ac618bcb25 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:24.758529 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-e2d3da0c-77f6-4cee-a8f5-64ac618bcb25 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:24.759324 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-e2d3da0c-77f6-4cee-a8f5-64ac618bcb25 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:24.759778 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-e2d3da0c-77f6-4cee-a8f5-64ac618bcb25 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:24.760195 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-e2d3da0c-77f6-4cee-a8f5-64ac618bcb25 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:24.775328 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.wsgi [None req-e2d3da0c-77f6-4cee-a8f5-64ac618bcb25 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] HTTP exception thrown: Instance 0402b684-55db-4c63-8142-de3fd0cc1503 could not be found. Aug 24 11:35:24.777065 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-e2d3da0c-77f6-4cee-a8f5-64ac618bcb25 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Request method failure captured: Aug 24 11:35:24.777065 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: request: GET /compute/v2.1/servers/0402b684-55db-4c63-8142-de3fd0cc1503 HTTP/1.1 Aug 24 11:35:24.777065 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Accept: application/json Aug 24 11:35:24.777065 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Accept-Encoding: identity Aug 24 11:35:24.777065 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Connection: close Aug 24 11:35:24.777065 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Content-Length: 0 Aug 24 11:35:24.777065 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Content-Type: application/json Aug 24 11:35:24.777065 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Host: 10.222.0.84 Aug 24 11:35:24.777065 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Openstack-System-Scope: None Aug 24 11:35:24.777065 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: User-Agent: python-urllib3/1.26.11 Aug 24 11:35:24.777065 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Auth-Token: gAAAAABjBgxP3_5ADR7cEK8xIVvnf9G4gqMp1Ns42nMVQGylI7LpqScZUTAPWBKLjV3ULRq6Bwb4QUvQ0Qg44SYELpXgwLSSmw-4BoQ5VgTXZrTDN22TzH-np9mamJ0hr9kbFifzlsonh7WogaR7W21ayk0SL2I7iRiJYjgM-nqDC_lCN6r_tQw Aug 24 11:35:24.777065 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Domain-Id: None Aug 24 11:35:24.777065 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Domain-Name: None Aug 24 11:35:24.777065 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Identity-Status: Confirmed Aug 24 11:35:24.777065 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Is-Admin-Project: True Aug 24 11:35:24.777065 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Project-Domain-Id: default Aug 24 11:35:24.777065 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Project-Domain-Name: Default Aug 24 11:35:24.777065 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Project-Id: f910065fc9da40798c7f3d4366dab7c6 Aug 24 11:35:24.777065 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Project-Name: tempest-VolumesSnapshotTestJSON-977680848 Aug 24 11:35:24.777065 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Role: reader,member Aug 24 11:35:24.777065 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Roles: reader,member Aug 24 11:35:24.793289 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/volume/v3/f910065fc9da40798c7f3d4366dab7c6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/volume/v3/f910065fc9da40798c7f3d4366dab7c6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/compute/v2/f910065fc9da40798c7f3d4366dab7c6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84:8080/v1/AUTH_f910065fc9da40798c7f3d4366dab7c6", "adminURL": "http://10.222.0.84:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/placement"}]}] Aug 24 11:35:24.793289 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Tenant: tempest-VolumesSnapshotTestJSON-977680848 Aug 24 11:35:24.793289 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Tenant-Id: f910065fc9da40798c7f3d4366dab7c6 Aug 24 11:35:24.793289 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-977680848 Aug 24 11:35:24.793289 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-User: tempest-VolumesSnapshotTestJSON-977680848-project Aug 24 11:35:24.793289 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-User-Domain-Id: default Aug 24 11:35:24.793289 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-User-Domain-Name: Default Aug 24 11:35:24.793289 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-User-Id: 5055ddeab8314c93bb2a664f9d1a7f3a Aug 24 11:35:24.793289 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-User-Name: tempest-VolumesSnapshotTestJSON-977680848-project Aug 24 11:35:24.793289 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: method: > Aug 24 11:35:24.793289 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: exception: Instance 0402b684-55db-4c63-8142-de3fd0cc1503 could not be found. Aug 24 11:35:24.793289 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: action_args: {'id': '0402b684-55db-4c63-8142-de3fd0cc1503'} Aug 24 11:35:24.794657 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:35:24.794657 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:35:24.794657 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:35:24.794657 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:35:24.794657 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:35:24.794657 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:35:24.794657 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:35:24.794657 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:35:24.794657 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:35:24.794657 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:35:24.794657 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0402b684-55db-4c63-8142-de3fd0cc1503 could not be found. Aug 24 11:35:24.794657 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Aug 24 11:35:24.794657 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:35:24.794657 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Aug 24 11:35:24.794657 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:35:24.794657 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:35:24.794657 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:35:24.794657 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:35:24.794657 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:35:24.794657 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:35:24.796933 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:35:24.796933 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:35:24.796933 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:35:24.796933 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:35:24.796933 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:35:24.796933 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:35:24.796933 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:35:24.796933 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0402b684-55db-4c63-8142-de3fd0cc1503 could not be found. Aug 24 11:35:24.796933 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Aug 24 11:35:24.796933 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:35:24.796933 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Aug 24 11:35:24.796933 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:35:24.796933 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:35:24.796933 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:35:24.796933 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:35:24.796933 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:35:24.796933 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0402b684-55db-4c63-8142-de3fd0cc1503 could not be found. Aug 24 11:35:24.796933 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Aug 24 11:35:24.798998 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-e2d3da0c-77f6-4cee-a8f5-64ac618bcb25 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Returning 404 to user: Instance 0402b684-55db-4c63-8142-de3fd0cc1503 could not be found. {{(pid=124769) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:35:24.798998 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-e2d3da0c-77f6-4cee-a8f5-64ac618bcb25 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] 10.222.0.84 "GET /compute/v2.1/servers/0402b684-55db-4c63-8142-de3fd0cc1503" status: 404 len: 111 microversion: 2.1 time: 0.033851 Aug 24 11:35:24.798998 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 240/449] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:35:24 2022] GET /compute/v2.1/servers/0402b684-55db-4c63-8142-de3fd0cc1503 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:35:48.547783 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-b013b602-b803-4fd5-888b-ccfe69dc953c tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-865027746", "imageRef": "028cad80-8f50-4139-b345-dfdca694dc6b", "flavorRef": "452", "networks": [{"uuid": "9b54afbf-84a1-4ef9-8659-c712d6618144"}]}} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:35:48.558394 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:35:48.612207 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.network.neutron [None req-b013b602-b803-4fd5-888b-ccfe69dc953c tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] validate_networks() for [('9b54afbf-84a1-4ef9-8659-c712d6618144', None, None, None, None, None)] {{(pid=124770) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 11:35:49.064155 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.virt.hardware [None req-b013b602-b803-4fd5-888b-ccfe69dc953c tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Flavor limits 0:0:0 {{(pid=124770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 11:35:49.064645 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.virt.hardware [None req-b013b602-b803-4fd5-888b-ccfe69dc953c tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Image limits 0:0:0 {{(pid=124770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 11:35:49.065213 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.virt.hardware [None req-b013b602-b803-4fd5-888b-ccfe69dc953c tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Flavor pref 0:0:0 {{(pid=124770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 11:35:49.065626 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.virt.hardware [None req-b013b602-b803-4fd5-888b-ccfe69dc953c tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Image pref 0:0:0 {{(pid=124770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 11:35:49.066098 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.virt.hardware [None req-b013b602-b803-4fd5-888b-ccfe69dc953c tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 11:35:49.077341 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b013b602-b803-4fd5-888b-ccfe69dc953c tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:49.077870 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b013b602-b803-4fd5-888b-ccfe69dc953c tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:49.078479 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b013b602-b803-4fd5-888b-ccfe69dc953c tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:49.079344 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b013b602-b803-4fd5-888b-ccfe69dc953c tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:49.079811 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b013b602-b803-4fd5-888b-ccfe69dc953c tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:49.080239 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b013b602-b803-4fd5-888b-ccfe69dc953c tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:49.102472 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.quota [None req-b013b602-b803-4fd5-888b-ccfe69dc953c tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Getting quotas for project f910065fc9da40798c7f3d4366dab7c6. Resources: {'ram', 'cores', 'instances'} {{(pid=124770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:35:49.111655 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.quota [None req-b013b602-b803-4fd5-888b-ccfe69dc953c tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Getting quotas for user 5055ddeab8314c93bb2a664f9d1a7f3a and project f910065fc9da40798c7f3d4366dab7c6. Resources: {'ram', 'cores', 'instances'} {{(pid=124770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:35:49.125850 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-b013b602-b803-4fd5-888b-ccfe69dc953c tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Going to run 1 instances... {{(pid=124770) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 11:35:49.128156 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-b013b602-b803-4fd5-888b-ccfe69dc953c tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] [instance: 703ce497-3db3-4bf1-a7bc-2224aef3e442] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='028cad80-8f50-4139-b345-dfdca694dc6b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124770) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 11:35:49.292948 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-b013b602-b803-4fd5-888b-ccfe69dc953c tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] 10.222.0.84 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.749533 Aug 24 11:35:49.293771 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 210/450] 10.222.0.84 () {60 vars in 1147 bytes} [Wed Aug 24 11:35:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 751 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 11:35:49.307911 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-f3617716-e12e-452a-bf4e-e5633c0b9446 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:35:49.321198 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-f3617716-e12e-452a-bf4e-e5633c0b9446 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] [instance: 703ce497-3db3-4bf1-a7bc-2224aef3e442] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:35:49.321198 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG dbcounter [-] [124769] Writing DB stats nova_api:SELECT=39 {{(pid=124769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:35:49.321198 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG dbcounter [-] [124769] Writing DB stats nova_cell1:SELECT=11 {{(pid=124769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:35:49.375832 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-f3617716-e12e-452a-bf4e-e5633c0b9446 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5055ddeab8314c93bb2a664f9d1a7f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f910065fc9da40798c7f3d4366dab7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:35:49.384441 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-f3617716-e12e-452a-bf4e-e5633c0b9446 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] 10.222.0.84 "GET /compute/v2.1/servers/703ce497-3db3-4bf1-a7bc-2224aef3e442" status: 200 len: 1218 microversion: 2.1 time: 0.083954 Aug 24 11:35:49.385222 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 241/451] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:35:49 2022] GET /compute/v2.1/servers/703ce497-3db3-4bf1-a7bc-2224aef3e442 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:35:50.408263 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-df19add9-033d-42f7-93fd-0fbec5525e20 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:35:50.409171 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-df19add9-033d-42f7-93fd-0fbec5525e20 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] [instance: 703ce497-3db3-4bf1-a7bc-2224aef3e442] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:35:50.481162 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-df19add9-033d-42f7-93fd-0fbec5525e20 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5055ddeab8314c93bb2a664f9d1a7f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f910065fc9da40798c7f3d4366dab7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:35:50.494288 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-df19add9-033d-42f7-93fd-0fbec5525e20 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] 10.222.0.84 "GET /compute/v2.1/servers/703ce497-3db3-4bf1-a7bc-2224aef3e442" status: 200 len: 1218 microversion: 2.1 time: 0.090673 Aug 24 11:35:50.494618 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 211/452] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:35:50 2022] GET /compute/v2.1/servers/703ce497-3db3-4bf1-a7bc-2224aef3e442 => generated 1218 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:35:51.517494 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-4d3b3c5a-dc68-482a-b008-585f8e65f80a tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:35:51.518524 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-4d3b3c5a-dc68-482a-b008-585f8e65f80a tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] [instance: 703ce497-3db3-4bf1-a7bc-2224aef3e442] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:35:51.526974 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-4d3b3c5a-dc68-482a-b008-585f8e65f80a tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:51.527453 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-4d3b3c5a-dc68-482a-b008-585f8e65f80a tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:51.527886 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-4d3b3c5a-dc68-482a-b008-585f8e65f80a tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:51.528580 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-4d3b3c5a-dc68-482a-b008-585f8e65f80a tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:51.529056 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-4d3b3c5a-dc68-482a-b008-585f8e65f80a tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:51.529473 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-4d3b3c5a-dc68-482a-b008-585f8e65f80a tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:51.614920 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-4d3b3c5a-dc68-482a-b008-585f8e65f80a tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5055ddeab8314c93bb2a664f9d1a7f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f910065fc9da40798c7f3d4366dab7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:35:51.631851 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-4d3b3c5a-dc68-482a-b008-585f8e65f80a tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] 10.222.0.84 "GET /compute/v2.1/servers/703ce497-3db3-4bf1-a7bc-2224aef3e442" status: 200 len: 1222 microversion: 2.1 time: 0.117925 Aug 24 11:35:51.634901 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 242/453] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:35:51 2022] GET /compute/v2.1/servers/703ce497-3db3-4bf1-a7bc-2224aef3e442 => generated 1222 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:35:52.667992 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-8ec179a7-60c8-406b-ad2b-ab168571edb2 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:35:52.668931 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-8ec179a7-60c8-406b-ad2b-ab168571edb2 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] [instance: 703ce497-3db3-4bf1-a7bc-2224aef3e442] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:35:52.681675 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8ec179a7-60c8-406b-ad2b-ab168571edb2 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:52.682199 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8ec179a7-60c8-406b-ad2b-ab168571edb2 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:52.682962 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8ec179a7-60c8-406b-ad2b-ab168571edb2 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:52.684282 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8ec179a7-60c8-406b-ad2b-ab168571edb2 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:52.685191 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8ec179a7-60c8-406b-ad2b-ab168571edb2 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:52.686000 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8ec179a7-60c8-406b-ad2b-ab168571edb2 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:52.773224 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-8ec179a7-60c8-406b-ad2b-ab168571edb2 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5055ddeab8314c93bb2a664f9d1a7f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f910065fc9da40798c7f3d4366dab7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:35:52.785597 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-8ec179a7-60c8-406b-ad2b-ab168571edb2 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] 10.222.0.84 "GET /compute/v2.1/servers/703ce497-3db3-4bf1-a7bc-2224aef3e442" status: 200 len: 1270 microversion: 2.1 time: 0.124603 Aug 24 11:35:52.786198 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 212/454] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:35:52 2022] GET /compute/v2.1/servers/703ce497-3db3-4bf1-a7bc-2224aef3e442 => generated 1270 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:35:53.808437 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-6ff552cf-aa79-47b3-9b80-ec6052950449 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:35:53.809286 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-6ff552cf-aa79-47b3-9b80-ec6052950449 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] [instance: 703ce497-3db3-4bf1-a7bc-2224aef3e442] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:35:53.815861 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-6ff552cf-aa79-47b3-9b80-ec6052950449 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:53.816525 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-6ff552cf-aa79-47b3-9b80-ec6052950449 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:53.817047 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-6ff552cf-aa79-47b3-9b80-ec6052950449 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:53.817759 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-6ff552cf-aa79-47b3-9b80-ec6052950449 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:53.818378 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-6ff552cf-aa79-47b3-9b80-ec6052950449 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:53.819467 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-6ff552cf-aa79-47b3-9b80-ec6052950449 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:53.914462 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-6ff552cf-aa79-47b3-9b80-ec6052950449 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5055ddeab8314c93bb2a664f9d1a7f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f910065fc9da40798c7f3d4366dab7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:35:53.930728 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-6ff552cf-aa79-47b3-9b80-ec6052950449 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] 10.222.0.84 "GET /compute/v2.1/servers/703ce497-3db3-4bf1-a7bc-2224aef3e442" status: 200 len: 1288 microversion: 2.1 time: 0.125958 Aug 24 11:35:53.931355 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 243/455] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:35:53 2022] GET /compute/v2.1/servers/703ce497-3db3-4bf1-a7bc-2224aef3e442 => generated 1288 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:35:54.965199 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-97df2c4b-1231-4cd9-b906-00a4fd8edda9 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:35:54.967229 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-97df2c4b-1231-4cd9-b906-00a4fd8edda9 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] [instance: 703ce497-3db3-4bf1-a7bc-2224aef3e442] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:35:54.976482 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-97df2c4b-1231-4cd9-b906-00a4fd8edda9 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:54.984533 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-97df2c4b-1231-4cd9-b906-00a4fd8edda9 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:54.984533 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-97df2c4b-1231-4cd9-b906-00a4fd8edda9 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:54.984533 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-97df2c4b-1231-4cd9-b906-00a4fd8edda9 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:54.984533 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-97df2c4b-1231-4cd9-b906-00a4fd8edda9 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:54.984956 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-97df2c4b-1231-4cd9-b906-00a4fd8edda9 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:55.256022 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-97df2c4b-1231-4cd9-b906-00a4fd8edda9 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5055ddeab8314c93bb2a664f9d1a7f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f910065fc9da40798c7f3d4366dab7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:35:55.266524 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-97df2c4b-1231-4cd9-b906-00a4fd8edda9 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] 10.222.0.84 "GET /compute/v2.1/servers/703ce497-3db3-4bf1-a7bc-2224aef3e442" status: 200 len: 1318 microversion: 2.1 time: 0.307329 Aug 24 11:35:55.267120 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 213/456] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:35:54 2022] GET /compute/v2.1/servers/703ce497-3db3-4bf1-a7bc-2224aef3e442 => generated 1318 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:35:56.037641 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [req-1bd0123d-1f47-458c-9394-14e3da021e8f req-0a5cdae8-14db-4189-9c21-b90c93d03c78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "703ce497-3db3-4bf1-a7bc-2224aef3e442", "tag": "3e2fe0a1-28c4-4219-827c-fbc569b6d010"}]} {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:35:56.053678 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [req-1bd0123d-1f47-458c-9394-14e3da021e8f req-0a5cdae8-14db-4189-9c21-b90c93d03c78 service nova] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:56.054946 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [req-1bd0123d-1f47-458c-9394-14e3da021e8f req-0a5cdae8-14db-4189-9c21-b90c93d03c78 service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:56.055733 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [req-1bd0123d-1f47-458c-9394-14e3da021e8f req-0a5cdae8-14db-4189-9c21-b90c93d03c78 service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:56.076735 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.compute.server_external_events [req-1bd0123d-1f47-458c-9394-14e3da021e8f req-0a5cdae8-14db-4189-9c21-b90c93d03c78 service nova] Creating event network-changed:3e2fe0a1-28c4-4219-827c-fbc569b6d010 for instance 703ce497-3db3-4bf1-a7bc-2224aef3e442 on hv-cinder-85427 Aug 24 11:35:56.086762 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [req-1bd0123d-1f47-458c-9394-14e3da021e8f req-0a5cdae8-14db-4189-9c21-b90c93d03c78 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054488 Aug 24 11:35:56.087686 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 244/457] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Aug 24 11:35:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:35:56.292435 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-ce88523a-0523-4301-bbb3-9491e9b8772e tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:35:56.293080 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-ce88523a-0523-4301-bbb3-9491e9b8772e tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] [instance: 703ce497-3db3-4bf1-a7bc-2224aef3e442] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:35:56.300133 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ce88523a-0523-4301-bbb3-9491e9b8772e tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:56.300724 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ce88523a-0523-4301-bbb3-9491e9b8772e tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:56.301191 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ce88523a-0523-4301-bbb3-9491e9b8772e tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:56.301903 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ce88523a-0523-4301-bbb3-9491e9b8772e tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:56.302361 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ce88523a-0523-4301-bbb3-9491e9b8772e tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:56.302789 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ce88523a-0523-4301-bbb3-9491e9b8772e tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:56.617091 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-ce88523a-0523-4301-bbb3-9491e9b8772e tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5055ddeab8314c93bb2a664f9d1a7f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f910065fc9da40798c7f3d4366dab7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:35:56.625124 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-ce88523a-0523-4301-bbb3-9491e9b8772e tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] 10.222.0.84 "GET /compute/v2.1/servers/703ce497-3db3-4bf1-a7bc-2224aef3e442" status: 200 len: 1318 microversion: 2.1 time: 0.337328 Aug 24 11:35:56.630991 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 214/458] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:35:56 2022] GET /compute/v2.1/servers/703ce497-3db3-4bf1-a7bc-2224aef3e442 => generated 1318 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:35:57.646705 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-dc1c849e-95ce-4ba3-aa71-f8fc02a8806b tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:35:57.647608 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-dc1c849e-95ce-4ba3-aa71-f8fc02a8806b tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] [instance: 703ce497-3db3-4bf1-a7bc-2224aef3e442] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:35:57.655204 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-dc1c849e-95ce-4ba3-aa71-f8fc02a8806b tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:57.655693 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-dc1c849e-95ce-4ba3-aa71-f8fc02a8806b tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:57.656127 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-dc1c849e-95ce-4ba3-aa71-f8fc02a8806b tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:57.656851 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-dc1c849e-95ce-4ba3-aa71-f8fc02a8806b tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:57.657304 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-dc1c849e-95ce-4ba3-aa71-f8fc02a8806b tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:57.657726 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-dc1c849e-95ce-4ba3-aa71-f8fc02a8806b tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:57.806322 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-dc1c849e-95ce-4ba3-aa71-f8fc02a8806b tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5055ddeab8314c93bb2a664f9d1a7f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f910065fc9da40798c7f3d4366dab7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:35:57.814101 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-dc1c849e-95ce-4ba3-aa71-f8fc02a8806b tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] 10.222.0.84 "GET /compute/v2.1/servers/703ce497-3db3-4bf1-a7bc-2224aef3e442" status: 200 len: 1318 microversion: 2.1 time: 0.172064 Aug 24 11:35:57.814675 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 245/459] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:35:57 2022] GET /compute/v2.1/servers/703ce497-3db3-4bf1-a7bc-2224aef3e442 => generated 1318 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:35:58.835119 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-decefede-86a8-435b-bbb5-cac06c55944d tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:35:58.835734 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-decefede-86a8-435b-bbb5-cac06c55944d tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] [instance: 703ce497-3db3-4bf1-a7bc-2224aef3e442] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:35:58.842456 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-decefede-86a8-435b-bbb5-cac06c55944d tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:58.842949 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-decefede-86a8-435b-bbb5-cac06c55944d tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:58.843385 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-decefede-86a8-435b-bbb5-cac06c55944d tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:58.844118 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-decefede-86a8-435b-bbb5-cac06c55944d tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:58.844569 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-decefede-86a8-435b-bbb5-cac06c55944d tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:58.845191 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-decefede-86a8-435b-bbb5-cac06c55944d tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:58.991422 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-decefede-86a8-435b-bbb5-cac06c55944d tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5055ddeab8314c93bb2a664f9d1a7f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f910065fc9da40798c7f3d4366dab7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:35:58.999586 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-decefede-86a8-435b-bbb5-cac06c55944d tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] 10.222.0.84 "GET /compute/v2.1/servers/703ce497-3db3-4bf1-a7bc-2224aef3e442" status: 200 len: 1318 microversion: 2.1 time: 0.168637 Aug 24 11:35:59.000154 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 215/460] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:35:58 2022] GET /compute/v2.1/servers/703ce497-3db3-4bf1-a7bc-2224aef3e442 => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:36:00.023090 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-4da1dfdb-5e9a-4a9d-b7f2-d066fd16d85d tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:36:00.023771 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-4da1dfdb-5e9a-4a9d-b7f2-d066fd16d85d tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] [instance: 703ce497-3db3-4bf1-a7bc-2224aef3e442] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:36:00.026301 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG dbcounter [-] [124769] Writing DB stats nova_cell0:SELECT=2 {{(pid=124769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:36:00.031527 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-4da1dfdb-5e9a-4a9d-b7f2-d066fd16d85d tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:00.034432 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-4da1dfdb-5e9a-4a9d-b7f2-d066fd16d85d tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:00.034432 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-4da1dfdb-5e9a-4a9d-b7f2-d066fd16d85d tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:00.034432 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-4da1dfdb-5e9a-4a9d-b7f2-d066fd16d85d tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:00.034432 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-4da1dfdb-5e9a-4a9d-b7f2-d066fd16d85d tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:00.034782 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-4da1dfdb-5e9a-4a9d-b7f2-d066fd16d85d tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:00.177828 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-4da1dfdb-5e9a-4a9d-b7f2-d066fd16d85d tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5055ddeab8314c93bb2a664f9d1a7f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f910065fc9da40798c7f3d4366dab7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:36:00.191090 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-4da1dfdb-5e9a-4a9d-b7f2-d066fd16d85d tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] 10.222.0.84 "GET /compute/v2.1/servers/703ce497-3db3-4bf1-a7bc-2224aef3e442" status: 200 len: 1318 microversion: 2.1 time: 0.168468 Aug 24 11:36:00.191090 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 246/461] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:36:00 2022] GET /compute/v2.1/servers/703ce497-3db3-4bf1-a7bc-2224aef3e442 => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:36:01.209609 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-41c15a1c-c6ad-4b36-85c9-435a93d0bde7 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:36:01.210335 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-41c15a1c-c6ad-4b36-85c9-435a93d0bde7 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] [instance: 703ce497-3db3-4bf1-a7bc-2224aef3e442] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:36:01.213550 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_cell0:SELECT=2 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:36:01.215081 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_cell0:SELECT=8 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:36:01.220517 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-41c15a1c-c6ad-4b36-85c9-435a93d0bde7 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:01.221748 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-41c15a1c-c6ad-4b36-85c9-435a93d0bde7 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:01.221748 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-41c15a1c-c6ad-4b36-85c9-435a93d0bde7 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:01.224388 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-41c15a1c-c6ad-4b36-85c9-435a93d0bde7 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:01.224388 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-41c15a1c-c6ad-4b36-85c9-435a93d0bde7 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:01.224388 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-41c15a1c-c6ad-4b36-85c9-435a93d0bde7 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:01.391535 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-41c15a1c-c6ad-4b36-85c9-435a93d0bde7 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5055ddeab8314c93bb2a664f9d1a7f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f910065fc9da40798c7f3d4366dab7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:36:01.401937 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-41c15a1c-c6ad-4b36-85c9-435a93d0bde7 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] 10.222.0.84 "GET /compute/v2.1/servers/703ce497-3db3-4bf1-a7bc-2224aef3e442" status: 200 len: 1318 microversion: 2.1 time: 0.196631 Aug 24 11:36:01.402521 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 216/462] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:36:01 2022] GET /compute/v2.1/servers/703ce497-3db3-4bf1-a7bc-2224aef3e442 => generated 1318 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:36:02.424734 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-f2fe0d85-6c69-4978-bbf2-3379397fb4a7 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:36:02.425376 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-f2fe0d85-6c69-4978-bbf2-3379397fb4a7 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] [instance: 703ce497-3db3-4bf1-a7bc-2224aef3e442] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:36:02.432059 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f2fe0d85-6c69-4978-bbf2-3379397fb4a7 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:02.432540 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f2fe0d85-6c69-4978-bbf2-3379397fb4a7 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:02.433009 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f2fe0d85-6c69-4978-bbf2-3379397fb4a7 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:02.433707 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f2fe0d85-6c69-4978-bbf2-3379397fb4a7 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:02.434155 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f2fe0d85-6c69-4978-bbf2-3379397fb4a7 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:02.434572 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f2fe0d85-6c69-4978-bbf2-3379397fb4a7 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:02.603170 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-f2fe0d85-6c69-4978-bbf2-3379397fb4a7 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5055ddeab8314c93bb2a664f9d1a7f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f910065fc9da40798c7f3d4366dab7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:36:02.611491 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-f2fe0d85-6c69-4978-bbf2-3379397fb4a7 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] 10.222.0.84 "GET /compute/v2.1/servers/703ce497-3db3-4bf1-a7bc-2224aef3e442" status: 200 len: 1318 microversion: 2.1 time: 0.191072 Aug 24 11:36:02.612055 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 247/463] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:36:02 2022] GET /compute/v2.1/servers/703ce497-3db3-4bf1-a7bc-2224aef3e442 => generated 1318 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:36:03.635647 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-3d642728-e43e-4464-a517-c10ccf625f1d tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:36:03.636285 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-3d642728-e43e-4464-a517-c10ccf625f1d tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] [instance: 703ce497-3db3-4bf1-a7bc-2224aef3e442] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:36:03.643941 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-3d642728-e43e-4464-a517-c10ccf625f1d tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:03.644341 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-3d642728-e43e-4464-a517-c10ccf625f1d tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:03.644783 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-3d642728-e43e-4464-a517-c10ccf625f1d tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:03.645523 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-3d642728-e43e-4464-a517-c10ccf625f1d tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:03.645986 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-3d642728-e43e-4464-a517-c10ccf625f1d tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:03.646418 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-3d642728-e43e-4464-a517-c10ccf625f1d tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:03.811957 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-3d642728-e43e-4464-a517-c10ccf625f1d tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5055ddeab8314c93bb2a664f9d1a7f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f910065fc9da40798c7f3d4366dab7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:36:03.821591 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-3d642728-e43e-4464-a517-c10ccf625f1d tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] 10.222.0.84 "GET /compute/v2.1/servers/703ce497-3db3-4bf1-a7bc-2224aef3e442" status: 200 len: 1318 microversion: 2.1 time: 0.191547 Aug 24 11:36:03.822146 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 217/464] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:36:03 2022] GET /compute/v2.1/servers/703ce497-3db3-4bf1-a7bc-2224aef3e442 => generated 1318 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:36:04.843868 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-4bc1aa41-6dd2-4357-a416-d891a8cb0f3b tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:36:04.844633 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-4bc1aa41-6dd2-4357-a416-d891a8cb0f3b tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] [instance: 703ce497-3db3-4bf1-a7bc-2224aef3e442] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:36:04.854374 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-4bc1aa41-6dd2-4357-a416-d891a8cb0f3b tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:04.854879 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-4bc1aa41-6dd2-4357-a416-d891a8cb0f3b tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:04.855313 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-4bc1aa41-6dd2-4357-a416-d891a8cb0f3b tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:04.856092 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-4bc1aa41-6dd2-4357-a416-d891a8cb0f3b tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:04.856605 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-4bc1aa41-6dd2-4357-a416-d891a8cb0f3b tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:04.857127 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-4bc1aa41-6dd2-4357-a416-d891a8cb0f3b tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:05.006891 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-4bc1aa41-6dd2-4357-a416-d891a8cb0f3b tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5055ddeab8314c93bb2a664f9d1a7f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f910065fc9da40798c7f3d4366dab7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:36:05.015068 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-4bc1aa41-6dd2-4357-a416-d891a8cb0f3b tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] 10.222.0.84 "GET /compute/v2.1/servers/703ce497-3db3-4bf1-a7bc-2224aef3e442" status: 200 len: 1318 microversion: 2.1 time: 0.175238 Aug 24 11:36:05.018879 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 248/465] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:36:04 2022] GET /compute/v2.1/servers/703ce497-3db3-4bf1-a7bc-2224aef3e442 => generated 1318 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:36:06.036621 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-65b06522-b2dd-4b8e-ab61-951f73d7ca1a tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:36:06.037938 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-65b06522-b2dd-4b8e-ab61-951f73d7ca1a tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] [instance: 703ce497-3db3-4bf1-a7bc-2224aef3e442] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:36:06.044330 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-65b06522-b2dd-4b8e-ab61-951f73d7ca1a tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:06.044839 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-65b06522-b2dd-4b8e-ab61-951f73d7ca1a tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:06.045267 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-65b06522-b2dd-4b8e-ab61-951f73d7ca1a tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:06.045943 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-65b06522-b2dd-4b8e-ab61-951f73d7ca1a tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:06.046415 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-65b06522-b2dd-4b8e-ab61-951f73d7ca1a tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:06.046831 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-65b06522-b2dd-4b8e-ab61-951f73d7ca1a tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:06.185341 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-65b06522-b2dd-4b8e-ab61-951f73d7ca1a tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5055ddeab8314c93bb2a664f9d1a7f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f910065fc9da40798c7f3d4366dab7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:36:06.193776 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-65b06522-b2dd-4b8e-ab61-951f73d7ca1a tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] 10.222.0.84 "GET /compute/v2.1/servers/703ce497-3db3-4bf1-a7bc-2224aef3e442" status: 200 len: 1318 microversion: 2.1 time: 0.160568 Aug 24 11:36:06.194353 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 218/466] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:36:06 2022] GET /compute/v2.1/servers/703ce497-3db3-4bf1-a7bc-2224aef3e442 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:36:07.024283 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [req-27c0f84e-a47d-45d5-8780-e26bd328fda8 req-bdea9069-e1f2-405c-8ac9-062c59cbcd7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "703ce497-3db3-4bf1-a7bc-2224aef3e442", "name": "network-vif-plugged", "status": "completed", "tag": "3e2fe0a1-28c4-4219-827c-fbc569b6d010"}]} {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:36:07.035226 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [req-27c0f84e-a47d-45d5-8780-e26bd328fda8 req-bdea9069-e1f2-405c-8ac9-062c59cbcd7d service nova] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:07.035821 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [req-27c0f84e-a47d-45d5-8780-e26bd328fda8 req-bdea9069-e1f2-405c-8ac9-062c59cbcd7d service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:07.036420 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [req-27c0f84e-a47d-45d5-8780-e26bd328fda8 req-bdea9069-e1f2-405c-8ac9-062c59cbcd7d service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:07.049984 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.compute.server_external_events [req-27c0f84e-a47d-45d5-8780-e26bd328fda8 req-bdea9069-e1f2-405c-8ac9-062c59cbcd7d service nova] Creating event network-vif-plugged:3e2fe0a1-28c4-4219-827c-fbc569b6d010 for instance 703ce497-3db3-4bf1-a7bc-2224aef3e442 on hv-cinder-85427 Aug 24 11:36:07.055905 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [req-27c0f84e-a47d-45d5-8780-e26bd328fda8 req-bdea9069-e1f2-405c-8ac9-062c59cbcd7d service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037643 Aug 24 11:36:07.056656 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 249/467] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Aug 24 11:36:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:36:07.216637 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-b777c339-80ec-4a2f-86cf-41d440a32d8c tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:36:07.217896 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-b777c339-80ec-4a2f-86cf-41d440a32d8c tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] [instance: 703ce497-3db3-4bf1-a7bc-2224aef3e442] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:36:07.226250 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b777c339-80ec-4a2f-86cf-41d440a32d8c tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:07.226741 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b777c339-80ec-4a2f-86cf-41d440a32d8c tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:07.227173 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b777c339-80ec-4a2f-86cf-41d440a32d8c tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:07.227898 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b777c339-80ec-4a2f-86cf-41d440a32d8c tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:07.229018 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b777c339-80ec-4a2f-86cf-41d440a32d8c tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:07.229658 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b777c339-80ec-4a2f-86cf-41d440a32d8c tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:07.429541 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-b777c339-80ec-4a2f-86cf-41d440a32d8c tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5055ddeab8314c93bb2a664f9d1a7f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f910065fc9da40798c7f3d4366dab7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:36:07.437269 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-b777c339-80ec-4a2f-86cf-41d440a32d8c tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] 10.222.0.84 "GET /compute/v2.1/servers/703ce497-3db3-4bf1-a7bc-2224aef3e442" status: 200 len: 1318 microversion: 2.1 time: 0.225541 Aug 24 11:36:07.437833 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 219/468] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:36:07 2022] GET /compute/v2.1/servers/703ce497-3db3-4bf1-a7bc-2224aef3e442 => generated 1318 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:36:08.460500 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-76f19e38-369a-42e5-b071-70d90be54f84 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:36:08.461156 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-76f19e38-369a-42e5-b071-70d90be54f84 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] [instance: 703ce497-3db3-4bf1-a7bc-2224aef3e442] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:36:08.467423 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-76f19e38-369a-42e5-b071-70d90be54f84 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:08.467894 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-76f19e38-369a-42e5-b071-70d90be54f84 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:08.468324 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-76f19e38-369a-42e5-b071-70d90be54f84 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:08.469026 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-76f19e38-369a-42e5-b071-70d90be54f84 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:08.469475 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-76f19e38-369a-42e5-b071-70d90be54f84 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:08.469956 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-76f19e38-369a-42e5-b071-70d90be54f84 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:08.611290 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-76f19e38-369a-42e5-b071-70d90be54f84 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5055ddeab8314c93bb2a664f9d1a7f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f910065fc9da40798c7f3d4366dab7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:36:08.620531 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-76f19e38-369a-42e5-b071-70d90be54f84 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] 10.222.0.84 "GET /compute/v2.1/servers/703ce497-3db3-4bf1-a7bc-2224aef3e442" status: 200 len: 1318 microversion: 2.1 time: 0.165142 Aug 24 11:36:08.622210 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 250/469] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:36:08 2022] GET /compute/v2.1/servers/703ce497-3db3-4bf1-a7bc-2224aef3e442 => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:36:09.645927 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-2b3fe72d-e64b-441c-b882-0b95ecb7742e tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:36:09.655279 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-2b3fe72d-e64b-441c-b882-0b95ecb7742e tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] [instance: 703ce497-3db3-4bf1-a7bc-2224aef3e442] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:36:09.655279 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-2b3fe72d-e64b-441c-b882-0b95ecb7742e tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:09.655279 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-2b3fe72d-e64b-441c-b882-0b95ecb7742e tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:09.655279 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-2b3fe72d-e64b-441c-b882-0b95ecb7742e tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:09.656204 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-2b3fe72d-e64b-441c-b882-0b95ecb7742e tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:09.656556 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-2b3fe72d-e64b-441c-b882-0b95ecb7742e tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:09.657007 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-2b3fe72d-e64b-441c-b882-0b95ecb7742e tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:09.796229 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-2b3fe72d-e64b-441c-b882-0b95ecb7742e tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5055ddeab8314c93bb2a664f9d1a7f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f910065fc9da40798c7f3d4366dab7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:36:09.804044 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-2b3fe72d-e64b-441c-b882-0b95ecb7742e tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] 10.222.0.84 "GET /compute/v2.1/servers/703ce497-3db3-4bf1-a7bc-2224aef3e442" status: 200 len: 1318 microversion: 2.1 time: 0.162004 Aug 24 11:36:09.804931 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 220/470] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:36:09 2022] GET /compute/v2.1/servers/703ce497-3db3-4bf1-a7bc-2224aef3e442 => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:36:10.825226 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-2438cce1-c7e9-44a8-910b-51da1eb44339 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:36:10.825837 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-2438cce1-c7e9-44a8-910b-51da1eb44339 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] [instance: 703ce497-3db3-4bf1-a7bc-2224aef3e442] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:36:10.832611 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-2438cce1-c7e9-44a8-910b-51da1eb44339 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:10.833113 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-2438cce1-c7e9-44a8-910b-51da1eb44339 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:10.833553 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-2438cce1-c7e9-44a8-910b-51da1eb44339 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:10.835118 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-2438cce1-c7e9-44a8-910b-51da1eb44339 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:10.835459 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-2438cce1-c7e9-44a8-910b-51da1eb44339 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:10.836299 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-2438cce1-c7e9-44a8-910b-51da1eb44339 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:10.979143 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-2438cce1-c7e9-44a8-910b-51da1eb44339 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5055ddeab8314c93bb2a664f9d1a7f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f910065fc9da40798c7f3d4366dab7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:36:10.988551 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-2438cce1-c7e9-44a8-910b-51da1eb44339 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] 10.222.0.84 "GET /compute/v2.1/servers/703ce497-3db3-4bf1-a7bc-2224aef3e442" status: 200 len: 1318 microversion: 2.1 time: 0.167031 Aug 24 11:36:10.989165 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 251/471] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:36:10 2022] GET /compute/v2.1/servers/703ce497-3db3-4bf1-a7bc-2224aef3e442 => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:36:12.012669 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-9827c61e-224a-4e53-b348-737c6ceaef68 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:36:12.013306 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-9827c61e-224a-4e53-b348-737c6ceaef68 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] [instance: 703ce497-3db3-4bf1-a7bc-2224aef3e442] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:36:12.019677 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9827c61e-224a-4e53-b348-737c6ceaef68 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:12.020150 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9827c61e-224a-4e53-b348-737c6ceaef68 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:12.020578 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9827c61e-224a-4e53-b348-737c6ceaef68 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:12.022155 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9827c61e-224a-4e53-b348-737c6ceaef68 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:12.022627 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9827c61e-224a-4e53-b348-737c6ceaef68 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:12.023048 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9827c61e-224a-4e53-b348-737c6ceaef68 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:12.163685 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-9827c61e-224a-4e53-b348-737c6ceaef68 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5055ddeab8314c93bb2a664f9d1a7f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f910065fc9da40798c7f3d4366dab7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:36:12.172296 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-9827c61e-224a-4e53-b348-737c6ceaef68 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] 10.222.0.84 "GET /compute/v2.1/servers/703ce497-3db3-4bf1-a7bc-2224aef3e442" status: 200 len: 1507 microversion: 2.1 time: 0.163372 Aug 24 11:36:12.172873 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 221/472] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:36:12 2022] GET /compute/v2.1/servers/703ce497-3db3-4bf1-a7bc-2224aef3e442 => generated 1507 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:36:12.202316 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-2668a621-1f50-4660-936c-1fdbac50fe08 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "22402fc1-eb10-4577-b46e-ce2a9c83a265", "device": "/dev/sdb"}} {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:36:12.204745 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-2668a621-1f50-4660-936c-1fdbac50fe08 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] [instance: 703ce497-3db3-4bf1-a7bc-2224aef3e442] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:36:12.212783 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-2668a621-1f50-4660-936c-1fdbac50fe08 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:12.213398 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-2668a621-1f50-4660-936c-1fdbac50fe08 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:12.213888 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-2668a621-1f50-4660-936c-1fdbac50fe08 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:12.214651 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-2668a621-1f50-4660-936c-1fdbac50fe08 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:12.215213 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-2668a621-1f50-4660-936c-1fdbac50fe08 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:12.215733 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-2668a621-1f50-4660-936c-1fdbac50fe08 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:13.947688 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-2668a621-1f50-4660-936c-1fdbac50fe08 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] 10.222.0.84 "POST /compute/v2.1/servers/703ce497-3db3-4bf1-a7bc-2224aef3e442/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.749193 Aug 24 11:36:13.948346 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 252/473] 10.222.0.84 () {60 vars in 1323 bytes} [Wed Aug 24 11:36:12 2022] POST /compute/v2.1/servers/703ce497-3db3-4bf1-a7bc-2224aef3e442/os-volume_attachments => generated 194 bytes in 1751 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:36:22.740599 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-def44fb6-477d-4ef3-841e-326828377bd0 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:36:22.743453 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-def44fb6-477d-4ef3-841e-326828377bd0 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: 2e661217-fb1a-48ad-9f1b-47985a4074de] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:36:22.746279 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:36:22.746942 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_cell1:SELECT=65 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:36:22.751884 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-def44fb6-477d-4ef3-841e-326828377bd0 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:22.752375 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-def44fb6-477d-4ef3-841e-326828377bd0 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:22.752886 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-def44fb6-477d-4ef3-841e-326828377bd0 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:22.753588 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-def44fb6-477d-4ef3-841e-326828377bd0 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:22.754046 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-def44fb6-477d-4ef3-841e-326828377bd0 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:22.754464 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-def44fb6-477d-4ef3-841e-326828377bd0 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:22.877497 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-def44fb6-477d-4ef3-841e-326828377bd0 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "POST /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de/action" status: 200 len: 28650 microversion: 2.20 time: 0.140277 Aug 24 11:36:22.877916 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 222/474] 10.222.0.84 () {62 vars in 1319 bytes} [Wed Aug 24 11:36:22 2022] POST /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de/action => generated 28650 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:36:26.874696 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG dbcounter [-] [124769] Writing DB stats nova_api:SELECT=26 {{(pid=124769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:36:26.876197 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG dbcounter [-] [124769] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:36:26.881850 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-85a81d53-59ac-4462-889e-72775f740a7c tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:36:26.886261 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-85a81d53-59ac-4462-889e-72775f740a7c tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:36:26.896854 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-85a81d53-59ac-4462-889e-72775f740a7c tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:26.898187 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-85a81d53-59ac-4462-889e-72775f740a7c tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:26.898912 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-85a81d53-59ac-4462-889e-72775f740a7c tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:26.899846 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-85a81d53-59ac-4462-889e-72775f740a7c tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:26.900599 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-85a81d53-59ac-4462-889e-72775f740a7c tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:26.901329 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-85a81d53-59ac-4462-889e-72775f740a7c tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:29.488637 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-85a81d53-59ac-4462-889e-72775f740a7c tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "POST /compute/v2.1/servers/e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311/action" status: 200 len: 28639 microversion: 2.1 time: 2.615405 Aug 24 11:36:29.494722 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 253/475] 10.222.0.84 () {60 vars in 1278 bytes} [Wed Aug 24 11:36:26 2022] POST /compute/v2.1/servers/e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311/action => generated 28639 bytes in 2618 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 11:36:31.195359 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-37e58268-f63f-464e-bc7a-b3d64956ae21 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:36:31.199067 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-37e58268-f63f-464e-bc7a-b3d64956ae21 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] [instance: 15d4a46e-9504-4897-918d-39aafc20d22a] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:36:31.207837 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-37e58268-f63f-464e-bc7a-b3d64956ae21 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:31.208609 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-37e58268-f63f-464e-bc7a-b3d64956ae21 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:31.209666 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-37e58268-f63f-464e-bc7a-b3d64956ae21 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:31.210922 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-37e58268-f63f-464e-bc7a-b3d64956ae21 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:31.211554 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-37e58268-f63f-464e-bc7a-b3d64956ae21 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:31.212469 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-37e58268-f63f-464e-bc7a-b3d64956ae21 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:31.360525 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-37e58268-f63f-464e-bc7a-b3d64956ae21 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] 10.222.0.84 "POST /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a/action" status: 200 len: 29819 microversion: 2.1 time: 0.170001 Aug 24 11:36:31.367111 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 223/476] 10.222.0.84 () {60 vars in 1278 bytes} [Wed Aug 24 11:36:31 2022] POST /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a/action => generated 29819 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 11:36:41.213674 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG dbcounter [-] [124769] Writing DB stats nova_api:SELECT=2 {{(pid=124769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:36:41.215148 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG dbcounter [-] [124769] Writing DB stats nova_cell1:SELECT=4 {{(pid=124769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:36:41.543168 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-c6a46205-a99e-4b23-9d08-c97d8887a628 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Action: 'create', calling method: .version_select at 0x7f0e2a6a4040>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1852951757", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDP7YdLwORtbrwP/Wm+TJLTbHJddFKaayH+Ys3rPpTDQlI0uARAvtgAp+fh6TaUEvqP6V7qWMJ640OdP9K3GNyGz11GEF4K1//82KT1KqgN9Wim/y9a2kwGqvSCI/NErgg=="}} {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:36:41.576423 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.quota [None req-c6a46205-a99e-4b23-9d08-c97d8887a628 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Getting quotas for project c4ef3fc15a0147e39228729d2b5b2631. Resources: {'key_pairs'} {{(pid=124769) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:36:41.586125 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.quota [None req-c6a46205-a99e-4b23-9d08-c97d8887a628 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Getting quotas for user 0b82b6f568bd41fa9d6b44facb766e0b and project c4ef3fc15a0147e39228729d2b5b2631. Resources: {'key_pairs'} {{(pid=124769) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:36:41.790335 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-c6a46205-a99e-4b23-9d08-c97d8887a628 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] 10.222.0.84 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.589555 Aug 24 11:36:41.790948 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 254/477] 10.222.0.84 () {60 vars in 1159 bytes} [Wed Aug 24 11:36:41 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:36:45.451411 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-da61e12c-7407-4754-8519-6c10ef901a41 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:36:45.455687 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-da61e12c-7407-4754-8519-6c10ef901a41 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] [instance: 703ce497-3db3-4bf1-a7bc-2224aef3e442] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:36:45.462915 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_api:SELECT=4 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:36:45.463874 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_cell1:SELECT=8 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:36:45.465902 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-da61e12c-7407-4754-8519-6c10ef901a41 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:45.466598 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-da61e12c-7407-4754-8519-6c10ef901a41 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:45.467196 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-da61e12c-7407-4754-8519-6c10ef901a41 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:45.468119 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-da61e12c-7407-4754-8519-6c10ef901a41 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:45.468734 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-da61e12c-7407-4754-8519-6c10ef901a41 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:45.469381 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-da61e12c-7407-4754-8519-6c10ef901a41 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:45.719558 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.objects.instance [None req-da61e12c-7407-4754-8519-6c10ef901a41 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lazy-loading 'services' on Instance uuid 703ce497-3db3-4bf1-a7bc-2224aef3e442 {{(pid=124770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:36:46.029595 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-da61e12c-7407-4754-8519-6c10ef901a41 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] 10.222.0.84 "DELETE /compute/v2.1/servers/703ce497-3db3-4bf1-a7bc-2224aef3e442/os-volume_attachments/22402fc1-eb10-4577-b46e-ce2a9c83a265" status: 202 len: 0 microversion: 2.1 time: 0.588385 Aug 24 11:36:46.030242 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 224/478] 10.222.0.84 () {58 vars in 1416 bytes} [Wed Aug 24 11:36:45 2022] DELETE /compute/v2.1/servers/703ce497-3db3-4bf1-a7bc-2224aef3e442/os-volume_attachments/22402fc1-eb10-4577-b46e-ce2a9c83a265 => generated 0 bytes in 591 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 11:36:46.600899 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 11:36:46.608139 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Wed Aug 24 11:36:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 11:36:48.246252 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-b58252d7-f488-436b-8e45-7a663f62aadd tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:36:48.246873 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-b58252d7-f488-436b-8e45-7a663f62aadd tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] [instance: 703ce497-3db3-4bf1-a7bc-2224aef3e442] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:36:48.253680 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-b58252d7-f488-436b-8e45-7a663f62aadd tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:48.254159 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-b58252d7-f488-436b-8e45-7a663f62aadd tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:48.254601 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-b58252d7-f488-436b-8e45-7a663f62aadd tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:48.255289 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-b58252d7-f488-436b-8e45-7a663f62aadd tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:48.255743 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-b58252d7-f488-436b-8e45-7a663f62aadd tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:48.256167 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-b58252d7-f488-436b-8e45-7a663f62aadd tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:48.285077 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-b58252d7-f488-436b-8e45-7a663f62aadd tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] [instance: 703ce497-3db3-4bf1-a7bc-2224aef3e442] Going to try to terminate instance {{(pid=124769) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 11:36:48.816823 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-b58252d7-f488-436b-8e45-7a663f62aadd tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] 10.222.0.84 "DELETE /compute/v2.1/servers/703ce497-3db3-4bf1-a7bc-2224aef3e442" status: 204 len: 0 microversion: 2.1 time: 0.575318 Aug 24 11:36:48.818551 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 255/479] 10.222.0.84 () {58 vars in 1239 bytes} [Wed Aug 24 11:36:48 2022] DELETE /compute/v2.1/servers/703ce497-3db3-4bf1-a7bc-2224aef3e442 => generated 0 bytes in 578 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 11:36:48.829502 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-c50ea13c-a662-4d3f-b796-7f25235f7f0e tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:36:48.830341 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-c50ea13c-a662-4d3f-b796-7f25235f7f0e tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] [instance: 703ce497-3db3-4bf1-a7bc-2224aef3e442] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:36:48.838491 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c50ea13c-a662-4d3f-b796-7f25235f7f0e tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:48.838993 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c50ea13c-a662-4d3f-b796-7f25235f7f0e tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:48.839434 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c50ea13c-a662-4d3f-b796-7f25235f7f0e tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:48.840602 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c50ea13c-a662-4d3f-b796-7f25235f7f0e tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:48.841724 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c50ea13c-a662-4d3f-b796-7f25235f7f0e tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:48.842537 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c50ea13c-a662-4d3f-b796-7f25235f7f0e tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:49.012726 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-c50ea13c-a662-4d3f-b796-7f25235f7f0e tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5055ddeab8314c93bb2a664f9d1a7f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f910065fc9da40798c7f3d4366dab7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:36:49.023335 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-c50ea13c-a662-4d3f-b796-7f25235f7f0e tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] 10.222.0.84 "GET /compute/v2.1/servers/703ce497-3db3-4bf1-a7bc-2224aef3e442" status: 200 len: 1513 microversion: 2.1 time: 0.198982 Aug 24 11:36:49.024351 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 225/480] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:36:48 2022] GET /compute/v2.1/servers/703ce497-3db3-4bf1-a7bc-2224aef3e442 => generated 1513 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:36:49.524230 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 11:36:49.525113 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Wed Aug 24 11:36:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 11:36:50.050122 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-fce524f3-6e48-43ba-9d6b-b0cd3a9458e0 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:36:50.050818 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-fce524f3-6e48-43ba-9d6b-b0cd3a9458e0 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] [instance: 703ce497-3db3-4bf1-a7bc-2224aef3e442] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:36:50.058733 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-fce524f3-6e48-43ba-9d6b-b0cd3a9458e0 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:50.059287 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-fce524f3-6e48-43ba-9d6b-b0cd3a9458e0 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:50.059739 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-fce524f3-6e48-43ba-9d6b-b0cd3a9458e0 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:50.060446 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-fce524f3-6e48-43ba-9d6b-b0cd3a9458e0 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:50.060937 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-fce524f3-6e48-43ba-9d6b-b0cd3a9458e0 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:50.061487 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-fce524f3-6e48-43ba-9d6b-b0cd3a9458e0 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:50.368245 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-fce524f3-6e48-43ba-9d6b-b0cd3a9458e0 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5055ddeab8314c93bb2a664f9d1a7f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f910065fc9da40798c7f3d4366dab7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:36:50.376726 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-fce524f3-6e48-43ba-9d6b-b0cd3a9458e0 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] 10.222.0.84 "GET /compute/v2.1/servers/703ce497-3db3-4bf1-a7bc-2224aef3e442" status: 200 len: 1513 microversion: 2.1 time: 0.331936 Aug 24 11:36:50.377337 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 256/481] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:36:50 2022] GET /compute/v2.1/servers/703ce497-3db3-4bf1-a7bc-2224aef3e442 => generated 1513 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:36:51.406281 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-38c6f770-0886-44d1-a49c-114e2acf5298 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:36:51.406932 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-38c6f770-0886-44d1-a49c-114e2acf5298 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] [instance: 703ce497-3db3-4bf1-a7bc-2224aef3e442] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:36:51.413797 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-38c6f770-0886-44d1-a49c-114e2acf5298 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:51.414292 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-38c6f770-0886-44d1-a49c-114e2acf5298 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:51.414727 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-38c6f770-0886-44d1-a49c-114e2acf5298 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:51.415460 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-38c6f770-0886-44d1-a49c-114e2acf5298 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:51.415859 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-38c6f770-0886-44d1-a49c-114e2acf5298 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:51.416278 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-38c6f770-0886-44d1-a49c-114e2acf5298 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:51.568924 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-38c6f770-0886-44d1-a49c-114e2acf5298 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5055ddeab8314c93bb2a664f9d1a7f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f910065fc9da40798c7f3d4366dab7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:36:51.577175 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-38c6f770-0886-44d1-a49c-114e2acf5298 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] 10.222.0.84 "GET /compute/v2.1/servers/703ce497-3db3-4bf1-a7bc-2224aef3e442" status: 200 len: 1513 microversion: 2.1 time: 0.175012 Aug 24 11:36:51.577738 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 226/482] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:36:51 2022] GET /compute/v2.1/servers/703ce497-3db3-4bf1-a7bc-2224aef3e442 => generated 1513 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:36:52.488909 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [req-4a172cb9-50ce-4a1c-b722-f4853e91e00a req-067a578a-94fe-4cb1-9ea8-167059ee481d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "703ce497-3db3-4bf1-a7bc-2224aef3e442", "name": "network-vif-deleted", "tag": "3e2fe0a1-28c4-4219-827c-fbc569b6d010"}]} {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:36:52.496920 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG dbcounter [-] [124769] Writing DB stats nova_cell0:SELECT=4 {{(pid=124769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:36:52.501393 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [req-4a172cb9-50ce-4a1c-b722-f4853e91e00a req-067a578a-94fe-4cb1-9ea8-167059ee481d service nova] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:52.501901 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [req-4a172cb9-50ce-4a1c-b722-f4853e91e00a req-067a578a-94fe-4cb1-9ea8-167059ee481d service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:52.502343 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [req-4a172cb9-50ce-4a1c-b722-f4853e91e00a req-067a578a-94fe-4cb1-9ea8-167059ee481d service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:52.516958 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.compute.server_external_events [req-4a172cb9-50ce-4a1c-b722-f4853e91e00a req-067a578a-94fe-4cb1-9ea8-167059ee481d service nova] Creating event network-vif-deleted:3e2fe0a1-28c4-4219-827c-fbc569b6d010 for instance 703ce497-3db3-4bf1-a7bc-2224aef3e442 on hv-cinder-85427 Aug 24 11:36:52.523183 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [req-4a172cb9-50ce-4a1c-b722-f4853e91e00a req-067a578a-94fe-4cb1-9ea8-167059ee481d service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037931 Aug 24 11:36:52.523810 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 257/483] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Aug 24 11:36:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:36:52.601615 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-038bf47c-5c47-4c69-aba8-677af7220d79 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:36:52.602230 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-038bf47c-5c47-4c69-aba8-677af7220d79 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] [instance: 703ce497-3db3-4bf1-a7bc-2224aef3e442] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:36:52.609666 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-038bf47c-5c47-4c69-aba8-677af7220d79 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:52.610312 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-038bf47c-5c47-4c69-aba8-677af7220d79 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:52.610784 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-038bf47c-5c47-4c69-aba8-677af7220d79 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:52.611496 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-038bf47c-5c47-4c69-aba8-677af7220d79 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:52.612036 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-038bf47c-5c47-4c69-aba8-677af7220d79 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:52.612516 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-038bf47c-5c47-4c69-aba8-677af7220d79 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:52.689899 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-038bf47c-5c47-4c69-aba8-677af7220d79 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5055ddeab8314c93bb2a664f9d1a7f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f910065fc9da40798c7f3d4366dab7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:36:52.702299 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-038bf47c-5c47-4c69-aba8-677af7220d79 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] 10.222.0.84 "GET /compute/v2.1/servers/703ce497-3db3-4bf1-a7bc-2224aef3e442" status: 200 len: 1471 microversion: 2.1 time: 0.105572 Aug 24 11:36:52.702299 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 227/484] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:36:52 2022] GET /compute/v2.1/servers/703ce497-3db3-4bf1-a7bc-2224aef3e442 => generated 1471 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:36:53.724903 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-be2e14b8-912c-4954-8c9d-463db52e9c92 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:36:53.725752 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-be2e14b8-912c-4954-8c9d-463db52e9c92 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] [instance: 703ce497-3db3-4bf1-a7bc-2224aef3e442] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:36:53.749338 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-be2e14b8-912c-4954-8c9d-463db52e9c92 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:53.751078 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-be2e14b8-912c-4954-8c9d-463db52e9c92 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:53.752035 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-be2e14b8-912c-4954-8c9d-463db52e9c92 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:53.754312 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-be2e14b8-912c-4954-8c9d-463db52e9c92 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:53.755439 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-be2e14b8-912c-4954-8c9d-463db52e9c92 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:53.756759 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-be2e14b8-912c-4954-8c9d-463db52e9c92 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:53.806573 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-be2e14b8-912c-4954-8c9d-463db52e9c92 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:53.807103 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-be2e14b8-912c-4954-8c9d-463db52e9c92 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:53.807585 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-be2e14b8-912c-4954-8c9d-463db52e9c92 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:53.808117 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.objects.instance [None req-be2e14b8-912c-4954-8c9d-463db52e9c92 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lazy-loading 'fault' on Instance uuid 703ce497-3db3-4bf1-a7bc-2224aef3e442 {{(pid=124769) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:36:53.862915 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-be2e14b8-912c-4954-8c9d-463db52e9c92 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5055ddeab8314c93bb2a664f9d1a7f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f910065fc9da40798c7f3d4366dab7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:36:53.873817 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-be2e14b8-912c-4954-8c9d-463db52e9c92 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] 10.222.0.84 "GET /compute/v2.1/servers/703ce497-3db3-4bf1-a7bc-2224aef3e442" status: 200 len: 1308 microversion: 2.1 time: 0.154810 Aug 24 11:36:53.874591 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 258/485] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:36:53 2022] GET /compute/v2.1/servers/703ce497-3db3-4bf1-a7bc-2224aef3e442 => generated 1308 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:36:54.898757 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-020880d8-24b5-484e-9a0a-0c9d130b7705 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:36:54.899904 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-020880d8-24b5-484e-9a0a-0c9d130b7705 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] [instance: 703ce497-3db3-4bf1-a7bc-2224aef3e442] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:36:54.908908 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-020880d8-24b5-484e-9a0a-0c9d130b7705 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:54.909691 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-020880d8-24b5-484e-9a0a-0c9d130b7705 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:54.910404 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-020880d8-24b5-484e-9a0a-0c9d130b7705 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:54.912127 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-020880d8-24b5-484e-9a0a-0c9d130b7705 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:54.912915 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-020880d8-24b5-484e-9a0a-0c9d130b7705 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:54.913637 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-020880d8-24b5-484e-9a0a-0c9d130b7705 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:54.934908 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.wsgi [None req-020880d8-24b5-484e-9a0a-0c9d130b7705 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] HTTP exception thrown: Instance 703ce497-3db3-4bf1-a7bc-2224aef3e442 could not be found. Aug 24 11:36:54.937179 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-020880d8-24b5-484e-9a0a-0c9d130b7705 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Request method failure captured: Aug 24 11:36:54.937179 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: request: GET /compute/v2.1/servers/703ce497-3db3-4bf1-a7bc-2224aef3e442 HTTP/1.1 Aug 24 11:36:54.937179 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Accept: application/json Aug 24 11:36:54.937179 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Accept-Encoding: identity Aug 24 11:36:54.937179 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Connection: close Aug 24 11:36:54.937179 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Content-Length: 0 Aug 24 11:36:54.937179 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Content-Type: application/json Aug 24 11:36:54.937179 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Host: 10.222.0.84 Aug 24 11:36:54.937179 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Openstack-System-Scope: None Aug 24 11:36:54.937179 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: User-Agent: python-urllib3/1.26.11 Aug 24 11:36:54.937179 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Auth-Token: gAAAAABjBgxP3_5ADR7cEK8xIVvnf9G4gqMp1Ns42nMVQGylI7LpqScZUTAPWBKLjV3ULRq6Bwb4QUvQ0Qg44SYELpXgwLSSmw-4BoQ5VgTXZrTDN22TzH-np9mamJ0hr9kbFifzlsonh7WogaR7W21ayk0SL2I7iRiJYjgM-nqDC_lCN6r_tQw Aug 24 11:36:54.937179 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Domain-Id: None Aug 24 11:36:54.937179 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Domain-Name: None Aug 24 11:36:54.937179 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Identity-Status: Confirmed Aug 24 11:36:54.937179 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Is-Admin-Project: True Aug 24 11:36:54.937179 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Project-Domain-Id: default Aug 24 11:36:54.937179 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Project-Domain-Name: Default Aug 24 11:36:54.937179 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Project-Id: f910065fc9da40798c7f3d4366dab7c6 Aug 24 11:36:54.937179 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Project-Name: tempest-VolumesSnapshotTestJSON-977680848 Aug 24 11:36:54.937179 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Role: reader,member Aug 24 11:36:54.937179 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Roles: reader,member Aug 24 11:36:54.938771 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/volume/v3/f910065fc9da40798c7f3d4366dab7c6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/volume/v3/f910065fc9da40798c7f3d4366dab7c6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/compute/v2/f910065fc9da40798c7f3d4366dab7c6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84:8080/v1/AUTH_f910065fc9da40798c7f3d4366dab7c6", "adminURL": "http://10.222.0.84:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/placement"}]}] Aug 24 11:36:54.938771 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Tenant: tempest-VolumesSnapshotTestJSON-977680848 Aug 24 11:36:54.938771 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Tenant-Id: f910065fc9da40798c7f3d4366dab7c6 Aug 24 11:36:54.938771 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-977680848 Aug 24 11:36:54.938771 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User: tempest-VolumesSnapshotTestJSON-977680848-project Aug 24 11:36:54.938771 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User-Domain-Id: default Aug 24 11:36:54.938771 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User-Domain-Name: Default Aug 24 11:36:54.938771 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User-Id: 5055ddeab8314c93bb2a664f9d1a7f3a Aug 24 11:36:54.938771 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User-Name: tempest-VolumesSnapshotTestJSON-977680848-project Aug 24 11:36:54.938771 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: method: > Aug 24 11:36:54.938771 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: exception: Instance 703ce497-3db3-4bf1-a7bc-2224aef3e442 could not be found. Aug 24 11:36:54.938771 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: action_args: {'id': '703ce497-3db3-4bf1-a7bc-2224aef3e442'} Aug 24 11:36:54.939643 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:36:54.939643 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:36:54.939643 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:36:54.939643 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:36:54.939643 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:36:54.939643 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:36:54.939643 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:36:54.939643 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:36:54.939643 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:36:54.939643 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:36:54.939643 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 703ce497-3db3-4bf1-a7bc-2224aef3e442 could not be found. Aug 24 11:36:54.939643 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:36:54.939643 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:36:54.939643 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:36:54.939643 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:36:54.939643 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:36:54.939643 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:36:54.939643 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:36:54.939643 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:36:54.939643 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:36:54.941101 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:36:54.941101 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:36:54.941101 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:36:54.941101 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:36:54.941101 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:36:54.941101 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:36:54.941101 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:36:54.941101 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 703ce497-3db3-4bf1-a7bc-2224aef3e442 could not be found. Aug 24 11:36:54.941101 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:36:54.941101 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:36:54.941101 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:36:54.941101 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:36:54.941101 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:36:54.941101 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:36:54.941101 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:36:54.941101 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:36:54.941101 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 703ce497-3db3-4bf1-a7bc-2224aef3e442 could not be found. Aug 24 11:36:54.941101 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:36:54.942636 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-020880d8-24b5-484e-9a0a-0c9d130b7705 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] Returning 404 to user: Instance 703ce497-3db3-4bf1-a7bc-2224aef3e442 could not be found. {{(pid=124770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:36:54.942636 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-020880d8-24b5-484e-9a0a-0c9d130b7705 tempest-VolumesSnapshotTestJSON-977680848 tempest-VolumesSnapshotTestJSON-977680848-project] 10.222.0.84 "GET /compute/v2.1/servers/703ce497-3db3-4bf1-a7bc-2224aef3e442" status: 404 len: 111 microversion: 2.1 time: 0.045630 Aug 24 11:36:54.942636 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 228/486] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:36:54 2022] GET /compute/v2.1/servers/703ce497-3db3-4bf1-a7bc-2224aef3e442 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:37:02.217864 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-dd3c2866-fb6f-49f0-8a06-5f513bdabe8b tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:02.218370 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-dd3c2866-fb6f-49f0-8a06-5f513bdabe8b tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: 2e661217-fb1a-48ad-9f1b-47985a4074de] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:02.225312 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-dd3c2866-fb6f-49f0-8a06-5f513bdabe8b tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:02.225803 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-dd3c2866-fb6f-49f0-8a06-5f513bdabe8b tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:02.226238 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-dd3c2866-fb6f-49f0-8a06-5f513bdabe8b tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:02.226937 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-dd3c2866-fb6f-49f0-8a06-5f513bdabe8b tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:02.227395 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-dd3c2866-fb6f-49f0-8a06-5f513bdabe8b tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:02.227819 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-dd3c2866-fb6f-49f0-8a06-5f513bdabe8b tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:02.255020 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-dd3c2866-fb6f-49f0-8a06-5f513bdabe8b tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de/ips" status: 200 len: 153 microversion: 2.20 time: 0.301331 Aug 24 11:37:02.255562 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 259/487] 10.222.0.84 () {60 vars in 1289 bytes} [Wed Aug 24 11:37:01 2022] GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de/ips => generated 153 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 11:37:08.352221 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_api:SELECT=10 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:37:08.353026 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_cell1:SELECT=29,nova_cell1:INSERT=1 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:37:08.486674 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-86f0e57e-b0c7-4140-badf-db1c5df02c35 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:08.487183 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-86f0e57e-b0c7-4140-badf-db1c5df02c35 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:08.494140 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-86f0e57e-b0c7-4140-badf-db1c5df02c35 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:08.494691 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-86f0e57e-b0c7-4140-badf-db1c5df02c35 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:08.495191 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-86f0e57e-b0c7-4140-badf-db1c5df02c35 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:08.496381 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-86f0e57e-b0c7-4140-badf-db1c5df02c35 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:08.497280 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-86f0e57e-b0c7-4140-badf-db1c5df02c35 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:08.498065 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-86f0e57e-b0c7-4140-badf-db1c5df02c35 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:08.525229 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-86f0e57e-b0c7-4140-badf-db1c5df02c35 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "GET /compute/v2.1/servers/e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311/ips" status: 200 len: 149 microversion: 2.1 time: 0.178300 Aug 24 11:37:08.534276 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 229/488] 10.222.0.84 () {58 vars in 1248 bytes} [Wed Aug 24 11:37:08 2022] GET /compute/v2.1/servers/e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311/ips => generated 149 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:37:10.326770 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-c91d9c84-c8e4-44f5-b129-de61c9781ed5 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:37:10.327625 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-c91d9c84-c8e4-44f5-b129-de61c9781ed5 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: 2e661217-fb1a-48ad-9f1b-47985a4074de] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:10.335595 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-c91d9c84-c8e4-44f5-b129-de61c9781ed5 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:10.336261 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-c91d9c84-c8e4-44f5-b129-de61c9781ed5 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:10.336704 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-c91d9c84-c8e4-44f5-b129-de61c9781ed5 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:10.337637 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-c91d9c84-c8e4-44f5-b129-de61c9781ed5 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:10.337878 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-c91d9c84-c8e4-44f5-b129-de61c9781ed5 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:10.338303 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-c91d9c84-c8e4-44f5-b129-de61c9781ed5 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:10.363737 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.objects.instance [None req-c91d9c84-c8e4-44f5-b129-de61c9781ed5 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lazy-loading 'flavor' on Instance uuid 2e661217-fb1a-48ad-9f1b-47985a4074de {{(pid=124769) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:37:10.761016 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-7526ac68-996a-496b-a35a-679fdb8436e5 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:10.761947 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-7526ac68-996a-496b-a35a-679fdb8436e5 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] [instance: 15d4a46e-9504-4897-918d-39aafc20d22a] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:10.777525 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-7526ac68-996a-496b-a35a-679fdb8436e5 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:10.778519 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-7526ac68-996a-496b-a35a-679fdb8436e5 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:10.779732 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-7526ac68-996a-496b-a35a-679fdb8436e5 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:10.780742 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-7526ac68-996a-496b-a35a-679fdb8436e5 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:10.781597 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-7526ac68-996a-496b-a35a-679fdb8436e5 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:10.782346 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-7526ac68-996a-496b-a35a-679fdb8436e5 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:10.817647 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-7526ac68-996a-496b-a35a-679fdb8436e5 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] 10.222.0.84 "GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a/ips" status: 200 len: 145 microversion: 2.1 time: 0.183566 Aug 24 11:37:10.819087 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 230/489] 10.222.0.84 () {58 vars in 1248 bytes} [Wed Aug 24 11:37:10 2022] GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a/ips => generated 145 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:37:11.090132 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-c91d9c84-c8e4-44f5-b129-de61c9781ed5 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "POST /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de/action" status: 202 len: 0 microversion: 2.20 time: 0.767639 Aug 24 11:37:11.090750 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 260/490] 10.222.0.84 () {62 vars in 1319 bytes} [Wed Aug 24 11:37:10 2022] POST /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de/action => generated 0 bytes in 769 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 11:37:11.100756 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-783a6b64-0a50-457a-ae2c-0008f4ad8a4c tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:11.101405 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-783a6b64-0a50-457a-ae2c-0008f4ad8a4c tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: 2e661217-fb1a-48ad-9f1b-47985a4074de] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:11.113366 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-783a6b64-0a50-457a-ae2c-0008f4ad8a4c tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:11.114242 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-783a6b64-0a50-457a-ae2c-0008f4ad8a4c tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:11.114766 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-783a6b64-0a50-457a-ae2c-0008f4ad8a4c tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:11.115549 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-783a6b64-0a50-457a-ae2c-0008f4ad8a4c tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:11.116111 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-783a6b64-0a50-457a-ae2c-0008f4ad8a4c tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:11.116601 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-783a6b64-0a50-457a-ae2c-0008f4ad8a4c tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:11.256902 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-783a6b64-0a50-457a-ae2c-0008f4ad8a4c tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:11.265236 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-783a6b64-0a50-457a-ae2c-0008f4ad8a4c tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:11.285047 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-783a6b64-0a50-457a-ae2c-0008f4ad8a4c tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:11.285047 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-783a6b64-0a50-457a-ae2c-0008f4ad8a4c tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de" status: 200 len: 1726 microversion: 2.20 time: 0.172543 Aug 24 11:37:11.285047 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 231/491] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:37:11 2022] GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de => generated 1726 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 11:37:12.294139 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-0fbabd25-2e6d-4cc7-b523-ce184313a2ed tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:12.294834 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-0fbabd25-2e6d-4cc7-b523-ce184313a2ed tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: 2e661217-fb1a-48ad-9f1b-47985a4074de] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:12.302604 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-0fbabd25-2e6d-4cc7-b523-ce184313a2ed tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:12.302994 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-0fbabd25-2e6d-4cc7-b523-ce184313a2ed tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:12.303434 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-0fbabd25-2e6d-4cc7-b523-ce184313a2ed tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:12.304143 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-0fbabd25-2e6d-4cc7-b523-ce184313a2ed tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:12.304597 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-0fbabd25-2e6d-4cc7-b523-ce184313a2ed tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:12.305053 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-0fbabd25-2e6d-4cc7-b523-ce184313a2ed tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:12.488911 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-0fbabd25-2e6d-4cc7-b523-ce184313a2ed tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:12.498545 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-0fbabd25-2e6d-4cc7-b523-ce184313a2ed tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:12.500113 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-0fbabd25-2e6d-4cc7-b523-ce184313a2ed tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:12.501398 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-0fbabd25-2e6d-4cc7-b523-ce184313a2ed tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de" status: 200 len: 1726 microversion: 2.20 time: 0.212080 Aug 24 11:37:12.501958 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 261/492] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:37:12 2022] GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de => generated 1726 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:37:12.954331 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-a4cd0468-7029-45f2-bb0a-69009916f27b tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dadd263d-3941-44f8-8b67-c190cf334748"}} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:37:12.956877 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-a4cd0468-7029-45f2-bb0a-69009916f27b tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:12.964237 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a4cd0468-7029-45f2-bb0a-69009916f27b tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:12.964768 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a4cd0468-7029-45f2-bb0a-69009916f27b tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:12.965230 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a4cd0468-7029-45f2-bb0a-69009916f27b tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:12.965931 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a4cd0468-7029-45f2-bb0a-69009916f27b tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:12.966427 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a4cd0468-7029-45f2-bb0a-69009916f27b tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:12.966844 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a4cd0468-7029-45f2-bb0a-69009916f27b tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:13.541475 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-5313bba3-bc97-4e93-bae7-366ccff7d3c3 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:13.542307 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-5313bba3-bc97-4e93-bae7-366ccff7d3c3 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: 2e661217-fb1a-48ad-9f1b-47985a4074de] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:13.550675 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-5313bba3-bc97-4e93-bae7-366ccff7d3c3 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:13.552087 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-5313bba3-bc97-4e93-bae7-366ccff7d3c3 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:13.552872 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-5313bba3-bc97-4e93-bae7-366ccff7d3c3 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:13.553867 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-5313bba3-bc97-4e93-bae7-366ccff7d3c3 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:13.554458 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-5313bba3-bc97-4e93-bae7-366ccff7d3c3 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:13.555007 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-5313bba3-bc97-4e93-bae7-366ccff7d3c3 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:13.737036 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-5313bba3-bc97-4e93-bae7-366ccff7d3c3 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:13.749101 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-5313bba3-bc97-4e93-bae7-366ccff7d3c3 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:13.750627 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-5313bba3-bc97-4e93-bae7-366ccff7d3c3 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:13.752172 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-5313bba3-bc97-4e93-bae7-366ccff7d3c3 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de" status: 200 len: 1726 microversion: 2.20 time: 0.217349 Aug 24 11:37:13.752828 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 262/493] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:37:13 2022] GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de => generated 1726 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 11:37:14.215657 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-a4cd0468-7029-45f2-bb0a-69009916f27b tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "POST /compute/v2.1/servers/e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.264951 Aug 24 11:37:14.216513 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 232/494] 10.222.0.84 () {60 vars in 1323 bytes} [Wed Aug 24 11:37:12 2022] POST /compute/v2.1/servers/e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311/os-volume_attachments => generated 194 bytes in 1267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:37:14.706853 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-fa7e0878-9ff4-45bc-8fb5-10c1b23f4cb8 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c8978236-e2cb-4be5-bda9-9fe571421f02"}} {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:37:14.711354 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-fa7e0878-9ff4-45bc-8fb5-10c1b23f4cb8 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] [instance: 15d4a46e-9504-4897-918d-39aafc20d22a] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:14.723672 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-fa7e0878-9ff4-45bc-8fb5-10c1b23f4cb8 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:14.724239 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-fa7e0878-9ff4-45bc-8fb5-10c1b23f4cb8 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:14.724746 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-fa7e0878-9ff4-45bc-8fb5-10c1b23f4cb8 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:14.725564 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-fa7e0878-9ff4-45bc-8fb5-10c1b23f4cb8 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:14.726077 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-fa7e0878-9ff4-45bc-8fb5-10c1b23f4cb8 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:14.726574 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-fa7e0878-9ff4-45bc-8fb5-10c1b23f4cb8 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:14.783188 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-c4b6c687-a756-43ca-a56f-c91320b3cf23 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:14.784320 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-c4b6c687-a756-43ca-a56f-c91320b3cf23 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: 2e661217-fb1a-48ad-9f1b-47985a4074de] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:14.797668 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c4b6c687-a756-43ca-a56f-c91320b3cf23 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:14.798494 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c4b6c687-a756-43ca-a56f-c91320b3cf23 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:14.799490 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c4b6c687-a756-43ca-a56f-c91320b3cf23 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:14.800666 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c4b6c687-a756-43ca-a56f-c91320b3cf23 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:14.802214 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c4b6c687-a756-43ca-a56f-c91320b3cf23 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:14.803013 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c4b6c687-a756-43ca-a56f-c91320b3cf23 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:14.968085 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-c4b6c687-a756-43ca-a56f-c91320b3cf23 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:14.978525 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-c4b6c687-a756-43ca-a56f-c91320b3cf23 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:14.980043 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-c4b6c687-a756-43ca-a56f-c91320b3cf23 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:14.981277 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-c4b6c687-a756-43ca-a56f-c91320b3cf23 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de" status: 200 len: 1726 microversion: 2.20 time: 0.205629 Aug 24 11:37:14.981855 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 233/495] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:37:14 2022] GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de => generated 1726 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:37:16.007241 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-234ffd88-876a-4b0d-bb78-be596b4163bb tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:16.008139 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-234ffd88-876a-4b0d-bb78-be596b4163bb tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: 2e661217-fb1a-48ad-9f1b-47985a4074de] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:16.015216 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-234ffd88-876a-4b0d-bb78-be596b4163bb tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:16.015860 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-234ffd88-876a-4b0d-bb78-be596b4163bb tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:16.016294 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-234ffd88-876a-4b0d-bb78-be596b4163bb tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:16.017025 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-234ffd88-876a-4b0d-bb78-be596b4163bb tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:16.017475 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-234ffd88-876a-4b0d-bb78-be596b4163bb tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:16.017944 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-234ffd88-876a-4b0d-bb78-be596b4163bb tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:16.167611 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-234ffd88-876a-4b0d-bb78-be596b4163bb tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:16.175511 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-234ffd88-876a-4b0d-bb78-be596b4163bb tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:16.178027 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-234ffd88-876a-4b0d-bb78-be596b4163bb tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:16.179212 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-234ffd88-876a-4b0d-bb78-be596b4163bb tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de" status: 200 len: 1726 microversion: 2.20 time: 0.177019 Aug 24 11:37:16.179770 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 234/496] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:37:16 2022] GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de => generated 1726 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 11:37:17.205927 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-39b6e72f-e0ef-40e0-bbc6-343b5ef48087 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:17.206702 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-39b6e72f-e0ef-40e0-bbc6-343b5ef48087 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: 2e661217-fb1a-48ad-9f1b-47985a4074de] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:17.217082 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-39b6e72f-e0ef-40e0-bbc6-343b5ef48087 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:17.217471 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-39b6e72f-e0ef-40e0-bbc6-343b5ef48087 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:17.217949 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-39b6e72f-e0ef-40e0-bbc6-343b5ef48087 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:17.218724 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-39b6e72f-e0ef-40e0-bbc6-343b5ef48087 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:17.219244 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-39b6e72f-e0ef-40e0-bbc6-343b5ef48087 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:17.219727 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-39b6e72f-e0ef-40e0-bbc6-343b5ef48087 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:17.329114 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-fa7e0878-9ff4-45bc-8fb5-10c1b23f4cb8 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] 10.222.0.84 "POST /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.630179 Aug 24 11:37:17.329964 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 263/497] 10.222.0.84 () {60 vars in 1323 bytes} [Wed Aug 24 11:37:14 2022] POST /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a/os-volume_attachments => generated 194 bytes in 2632 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:37:17.365069 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-39b6e72f-e0ef-40e0-bbc6-343b5ef48087 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:17.374892 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-39b6e72f-e0ef-40e0-bbc6-343b5ef48087 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:17.381401 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-39b6e72f-e0ef-40e0-bbc6-343b5ef48087 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:17.381401 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-39b6e72f-e0ef-40e0-bbc6-343b5ef48087 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de" status: 200 len: 1726 microversion: 2.20 time: 0.177515 Aug 24 11:37:17.381401 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 235/498] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:37:17 2022] GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de => generated 1726 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 11:37:18.407552 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-d24c33c2-225f-4917-b8e6-4b7f113a7493 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:18.408682 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-d24c33c2-225f-4917-b8e6-4b7f113a7493 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: 2e661217-fb1a-48ad-9f1b-47985a4074de] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:18.412424 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG dbcounter [-] [124769] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=124769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:37:18.421935 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-d24c33c2-225f-4917-b8e6-4b7f113a7493 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:18.422594 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-d24c33c2-225f-4917-b8e6-4b7f113a7493 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:18.423304 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-d24c33c2-225f-4917-b8e6-4b7f113a7493 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:18.424436 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-d24c33c2-225f-4917-b8e6-4b7f113a7493 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:18.425456 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-d24c33c2-225f-4917-b8e6-4b7f113a7493 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:18.426204 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-d24c33c2-225f-4917-b8e6-4b7f113a7493 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:18.433549 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG dbcounter [-] [124769] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=124769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:37:18.590394 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-d24c33c2-225f-4917-b8e6-4b7f113a7493 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:18.601182 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-d24c33c2-225f-4917-b8e6-4b7f113a7493 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:18.602672 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-d24c33c2-225f-4917-b8e6-4b7f113a7493 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:18.603827 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-d24c33c2-225f-4917-b8e6-4b7f113a7493 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de" status: 200 len: 1726 microversion: 2.20 time: 0.204327 Aug 24 11:37:18.604397 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 264/499] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:37:18 2022] GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de => generated 1726 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:37:19.627301 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-6caab619-2959-42ce-a01b-d255d5fc46be tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:19.627905 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-6caab619-2959-42ce-a01b-d255d5fc46be tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: 2e661217-fb1a-48ad-9f1b-47985a4074de] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:19.644453 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6caab619-2959-42ce-a01b-d255d5fc46be tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:19.644453 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6caab619-2959-42ce-a01b-d255d5fc46be tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:19.644453 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6caab619-2959-42ce-a01b-d255d5fc46be tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:19.644453 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6caab619-2959-42ce-a01b-d255d5fc46be tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:19.645414 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6caab619-2959-42ce-a01b-d255d5fc46be tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:19.645414 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6caab619-2959-42ce-a01b-d255d5fc46be tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:19.778017 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-6caab619-2959-42ce-a01b-d255d5fc46be tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:19.787068 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-6caab619-2959-42ce-a01b-d255d5fc46be tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:19.788549 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-6caab619-2959-42ce-a01b-d255d5fc46be tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:19.789712 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-6caab619-2959-42ce-a01b-d255d5fc46be tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de" status: 200 len: 1726 microversion: 2.20 time: 0.166361 Aug 24 11:37:19.790276 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 236/500] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:37:19 2022] GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de => generated 1726 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:37:20.813101 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-dc60e0ae-a615-4fb1-9083-814b6a085c3f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:20.813637 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-dc60e0ae-a615-4fb1-9083-814b6a085c3f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: 2e661217-fb1a-48ad-9f1b-47985a4074de] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:20.822382 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-dc60e0ae-a615-4fb1-9083-814b6a085c3f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:20.822868 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-dc60e0ae-a615-4fb1-9083-814b6a085c3f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:20.823311 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-dc60e0ae-a615-4fb1-9083-814b6a085c3f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:20.824006 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-dc60e0ae-a615-4fb1-9083-814b6a085c3f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:20.824461 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-dc60e0ae-a615-4fb1-9083-814b6a085c3f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:20.824916 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-dc60e0ae-a615-4fb1-9083-814b6a085c3f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:20.970283 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-dc60e0ae-a615-4fb1-9083-814b6a085c3f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:20.979778 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-dc60e0ae-a615-4fb1-9083-814b6a085c3f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:20.981334 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-dc60e0ae-a615-4fb1-9083-814b6a085c3f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:20.985324 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-dc60e0ae-a615-4fb1-9083-814b6a085c3f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de" status: 200 len: 1726 microversion: 2.20 time: 0.173395 Aug 24 11:37:20.985324 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 265/501] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:37:20 2022] GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de => generated 1726 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:37:22.009103 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-7ae065c8-9b51-477d-869a-5d4db581275a tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:22.010575 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-7ae065c8-9b51-477d-869a-5d4db581275a tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: 2e661217-fb1a-48ad-9f1b-47985a4074de] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:22.018354 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-7ae065c8-9b51-477d-869a-5d4db581275a tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:22.018875 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-7ae065c8-9b51-477d-869a-5d4db581275a tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:22.019347 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-7ae065c8-9b51-477d-869a-5d4db581275a tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:22.020574 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-7ae065c8-9b51-477d-869a-5d4db581275a tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:22.021249 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-7ae065c8-9b51-477d-869a-5d4db581275a tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:22.021701 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-7ae065c8-9b51-477d-869a-5d4db581275a tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:22.187689 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-7ae065c8-9b51-477d-869a-5d4db581275a tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:22.198945 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-7ae065c8-9b51-477d-869a-5d4db581275a tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:22.200423 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-7ae065c8-9b51-477d-869a-5d4db581275a tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:22.201612 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-7ae065c8-9b51-477d-869a-5d4db581275a tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de" status: 200 len: 1726 microversion: 2.20 time: 0.197683 Aug 24 11:37:22.202172 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 237/502] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:37:22 2022] GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de => generated 1726 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:37:23.226492 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-168cd050-4bbe-421a-9a5c-e0376ac7e237 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:23.227099 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-168cd050-4bbe-421a-9a5c-e0376ac7e237 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: 2e661217-fb1a-48ad-9f1b-47985a4074de] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:23.234770 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-168cd050-4bbe-421a-9a5c-e0376ac7e237 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:23.235189 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-168cd050-4bbe-421a-9a5c-e0376ac7e237 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:23.235627 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-168cd050-4bbe-421a-9a5c-e0376ac7e237 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:23.236329 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-168cd050-4bbe-421a-9a5c-e0376ac7e237 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:23.236782 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-168cd050-4bbe-421a-9a5c-e0376ac7e237 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:23.237231 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-168cd050-4bbe-421a-9a5c-e0376ac7e237 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:23.381181 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-168cd050-4bbe-421a-9a5c-e0376ac7e237 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:23.389812 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-168cd050-4bbe-421a-9a5c-e0376ac7e237 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:23.394698 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-168cd050-4bbe-421a-9a5c-e0376ac7e237 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:23.394698 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-168cd050-4bbe-421a-9a5c-e0376ac7e237 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de" status: 200 len: 1726 microversion: 2.20 time: 0.170791 Aug 24 11:37:23.394698 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 266/503] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:37:23 2022] GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de => generated 1726 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:37:24.415638 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-df91f4d1-845a-4a70-a13e-fc4e02882898 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:24.416230 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-df91f4d1-845a-4a70-a13e-fc4e02882898 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: 2e661217-fb1a-48ad-9f1b-47985a4074de] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:24.422784 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-df91f4d1-845a-4a70-a13e-fc4e02882898 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:24.423264 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-df91f4d1-845a-4a70-a13e-fc4e02882898 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:24.423694 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-df91f4d1-845a-4a70-a13e-fc4e02882898 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:24.424385 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-df91f4d1-845a-4a70-a13e-fc4e02882898 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:24.424858 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-df91f4d1-845a-4a70-a13e-fc4e02882898 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:24.425279 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-df91f4d1-845a-4a70-a13e-fc4e02882898 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:24.556903 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-df91f4d1-845a-4a70-a13e-fc4e02882898 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:24.565117 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-df91f4d1-845a-4a70-a13e-fc4e02882898 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:24.567311 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-df91f4d1-845a-4a70-a13e-fc4e02882898 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:24.568454 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-df91f4d1-845a-4a70-a13e-fc4e02882898 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de" status: 200 len: 1726 microversion: 2.20 time: 0.156732 Aug 24 11:37:24.569038 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 238/504] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:37:24 2022] GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de => generated 1726 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:37:25.592160 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-1764d539-e5e8-40ad-87d6-a0946081c6fe tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:25.592783 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-1764d539-e5e8-40ad-87d6-a0946081c6fe tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: 2e661217-fb1a-48ad-9f1b-47985a4074de] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:25.600222 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-1764d539-e5e8-40ad-87d6-a0946081c6fe tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:25.600712 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-1764d539-e5e8-40ad-87d6-a0946081c6fe tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:25.601177 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-1764d539-e5e8-40ad-87d6-a0946081c6fe tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:25.601882 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-1764d539-e5e8-40ad-87d6-a0946081c6fe tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:25.602332 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-1764d539-e5e8-40ad-87d6-a0946081c6fe tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:25.602755 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-1764d539-e5e8-40ad-87d6-a0946081c6fe tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:25.747789 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-1764d539-e5e8-40ad-87d6-a0946081c6fe tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:25.756482 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-1764d539-e5e8-40ad-87d6-a0946081c6fe tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:25.758032 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-1764d539-e5e8-40ad-87d6-a0946081c6fe tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:25.759266 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-1764d539-e5e8-40ad-87d6-a0946081c6fe tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de" status: 200 len: 1726 microversion: 2.20 time: 0.171042 Aug 24 11:37:25.768318 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 267/505] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:37:25 2022] GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de => generated 1726 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:37:26.783048 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-11671075-13b6-4ece-bde4-02fdd045f976 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:26.783658 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-11671075-13b6-4ece-bde4-02fdd045f976 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: 2e661217-fb1a-48ad-9f1b-47985a4074de] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:26.791209 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-11671075-13b6-4ece-bde4-02fdd045f976 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:26.791729 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-11671075-13b6-4ece-bde4-02fdd045f976 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:26.792191 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-11671075-13b6-4ece-bde4-02fdd045f976 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:26.792922 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-11671075-13b6-4ece-bde4-02fdd045f976 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:26.793375 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-11671075-13b6-4ece-bde4-02fdd045f976 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:26.793796 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-11671075-13b6-4ece-bde4-02fdd045f976 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:26.931717 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-11671075-13b6-4ece-bde4-02fdd045f976 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:26.940537 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-11671075-13b6-4ece-bde4-02fdd045f976 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:26.942865 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-11671075-13b6-4ece-bde4-02fdd045f976 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:26.944024 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-11671075-13b6-4ece-bde4-02fdd045f976 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de" status: 200 len: 1726 microversion: 2.20 time: 0.164892 Aug 24 11:37:26.944608 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 239/506] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:37:26 2022] GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de => generated 1726 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:37:27.967422 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-f8bb4564-0ed9-4442-bd14-ea5a5baee8ef tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:27.967975 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-f8bb4564-0ed9-4442-bd14-ea5a5baee8ef tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: 2e661217-fb1a-48ad-9f1b-47985a4074de] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:27.975979 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f8bb4564-0ed9-4442-bd14-ea5a5baee8ef tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:27.976814 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f8bb4564-0ed9-4442-bd14-ea5a5baee8ef tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:27.977346 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f8bb4564-0ed9-4442-bd14-ea5a5baee8ef tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:27.978055 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f8bb4564-0ed9-4442-bd14-ea5a5baee8ef tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:27.978508 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f8bb4564-0ed9-4442-bd14-ea5a5baee8ef tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:27.978930 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f8bb4564-0ed9-4442-bd14-ea5a5baee8ef tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:28.138111 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-f8bb4564-0ed9-4442-bd14-ea5a5baee8ef tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:28.147539 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-f8bb4564-0ed9-4442-bd14-ea5a5baee8ef tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:28.149072 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-f8bb4564-0ed9-4442-bd14-ea5a5baee8ef tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:28.150242 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-f8bb4564-0ed9-4442-bd14-ea5a5baee8ef tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de" status: 200 len: 1726 microversion: 2.20 time: 0.186862 Aug 24 11:37:28.150801 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 268/507] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:37:27 2022] GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de => generated 1726 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:37:29.176264 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-42942821-affd-4626-96cf-1ef99f7d2f04 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:29.176264 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-42942821-affd-4626-96cf-1ef99f7d2f04 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: 2e661217-fb1a-48ad-9f1b-47985a4074de] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:29.181755 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-42942821-affd-4626-96cf-1ef99f7d2f04 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:29.182243 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-42942821-affd-4626-96cf-1ef99f7d2f04 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:29.182685 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-42942821-affd-4626-96cf-1ef99f7d2f04 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:29.183367 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-42942821-affd-4626-96cf-1ef99f7d2f04 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:29.183816 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-42942821-affd-4626-96cf-1ef99f7d2f04 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:29.184236 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-42942821-affd-4626-96cf-1ef99f7d2f04 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:29.322898 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-42942821-affd-4626-96cf-1ef99f7d2f04 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:29.333257 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-42942821-affd-4626-96cf-1ef99f7d2f04 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:29.334795 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-42942821-affd-4626-96cf-1ef99f7d2f04 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:29.335955 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-42942821-affd-4626-96cf-1ef99f7d2f04 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de" status: 200 len: 1726 microversion: 2.20 time: 0.166046 Aug 24 11:37:29.336528 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 240/508] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:37:29 2022] GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de => generated 1726 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:37:29.635512 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-591ed99a-c183-4218-ab88-752cda45ff0a tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Action: 'create', calling method: .version_select at 0x7f0e2a673040>, body: {"keypair": {"name": "tempest-keypair-2021479066", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHB0rvg7qAr+PFpG+pg554YzlNhw9RU2deir/K8MklxmeuQj0RuIjpIui+lSBgJN6FX6r5jGpaBE4O6tGMT0LfQSz6QOVu77Ow2AOH20w3yIkCC30BayNsmecbZQSUJn/Q=="}} {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:37:29.654316 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.quota [None req-591ed99a-c183-4218-ab88-752cda45ff0a tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Getting quotas for project 4a4159dc366f41bc9e4057a079f6fb5a. Resources: {'key_pairs'} {{(pid=124769) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:37:29.658654 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.quota [None req-591ed99a-c183-4218-ab88-752cda45ff0a tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Getting quotas for user 2715cf2a5129439c83a5347bb963f1a9 and project 4a4159dc366f41bc9e4057a079f6fb5a. Resources: {'key_pairs'} {{(pid=124769) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:37:29.914941 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-591ed99a-c183-4218-ab88-752cda45ff0a tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.283173 Aug 24 11:37:29.915542 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 269/509] 10.222.0.84 () {60 vars in 1159 bytes} [Wed Aug 24 11:37:29 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:37:30.364539 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-851331c4-0903-4fd7-b4ec-b75ad4df95d7 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:30.365820 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-851331c4-0903-4fd7-b4ec-b75ad4df95d7 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: 2e661217-fb1a-48ad-9f1b-47985a4074de] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:30.373854 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-851331c4-0903-4fd7-b4ec-b75ad4df95d7 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:30.374607 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-851331c4-0903-4fd7-b4ec-b75ad4df95d7 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:30.375013 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-851331c4-0903-4fd7-b4ec-b75ad4df95d7 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:30.375892 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-851331c4-0903-4fd7-b4ec-b75ad4df95d7 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:30.376355 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-851331c4-0903-4fd7-b4ec-b75ad4df95d7 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:30.376778 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-851331c4-0903-4fd7-b4ec-b75ad4df95d7 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:30.541858 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-851331c4-0903-4fd7-b4ec-b75ad4df95d7 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:30.556752 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-851331c4-0903-4fd7-b4ec-b75ad4df95d7 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:30.556752 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-851331c4-0903-4fd7-b4ec-b75ad4df95d7 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:30.556752 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-851331c4-0903-4fd7-b4ec-b75ad4df95d7 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de" status: 200 len: 1726 microversion: 2.20 time: 0.197760 Aug 24 11:37:30.557104 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 241/510] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:37:30 2022] GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de => generated 1726 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:37:31.579036 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-681a9a02-9b74-4c75-9e1e-29ce577c236c tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:31.579617 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-681a9a02-9b74-4c75-9e1e-29ce577c236c tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: 2e661217-fb1a-48ad-9f1b-47985a4074de] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:31.587195 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-681a9a02-9b74-4c75-9e1e-29ce577c236c tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:31.589886 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-681a9a02-9b74-4c75-9e1e-29ce577c236c tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:31.590345 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-681a9a02-9b74-4c75-9e1e-29ce577c236c tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:31.591069 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-681a9a02-9b74-4c75-9e1e-29ce577c236c tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:31.591530 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-681a9a02-9b74-4c75-9e1e-29ce577c236c tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:31.591963 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-681a9a02-9b74-4c75-9e1e-29ce577c236c tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:31.774844 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-344f3fef-170c-4ade-996a-645a54dfaf82 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1098195162", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1852951757", "security_groups": [{"name": "tempest-secgroup-smoke-1129237839"}], "block_device_mapping_v2": [{"uuid": "a69aaab5-7f01-4074-a271-f7d3e439795b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "2124b453-c0e5-4e4a-8217-6cdc2b930758"}]}} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:37:31.775697 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-681a9a02-9b74-4c75-9e1e-29ce577c236c tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:31.785803 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-681a9a02-9b74-4c75-9e1e-29ce577c236c tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:31.787208 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-681a9a02-9b74-4c75-9e1e-29ce577c236c tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:31.788430 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-681a9a02-9b74-4c75-9e1e-29ce577c236c tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de" status: 200 len: 1726 microversion: 2.20 time: 0.213430 Aug 24 11:37:31.789013 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 270/511] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:37:31 2022] GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de => generated 1726 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:37:31.909868 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.network.neutron [None req-344f3fef-170c-4ade-996a-645a54dfaf82 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] validate_networks() for [('2124b453-c0e5-4e4a-8217-6cdc2b930758', None, None, None, None, None)] {{(pid=124770) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 11:37:32.458974 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.virt.hardware [None req-344f3fef-170c-4ade-996a-645a54dfaf82 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Flavor limits 0:0:0 {{(pid=124770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 11:37:32.459406 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.virt.hardware [None req-344f3fef-170c-4ade-996a-645a54dfaf82 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Image limits 0:0:0 {{(pid=124770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 11:37:32.461782 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.virt.hardware [None req-344f3fef-170c-4ade-996a-645a54dfaf82 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Flavor pref 0:0:0 {{(pid=124770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 11:37:32.462313 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.virt.hardware [None req-344f3fef-170c-4ade-996a-645a54dfaf82 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Image pref 0:0:0 {{(pid=124770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 11:37:32.462794 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.virt.hardware [None req-344f3fef-170c-4ade-996a-645a54dfaf82 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 11:37:32.477492 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-344f3fef-170c-4ade-996a-645a54dfaf82 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:32.479002 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-344f3fef-170c-4ade-996a-645a54dfaf82 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:32.479002 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-344f3fef-170c-4ade-996a-645a54dfaf82 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:32.479214 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-344f3fef-170c-4ade-996a-645a54dfaf82 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:32.479600 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-344f3fef-170c-4ade-996a-645a54dfaf82 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:32.480024 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-344f3fef-170c-4ade-996a-645a54dfaf82 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:32.498414 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.quota [None req-344f3fef-170c-4ade-996a-645a54dfaf82 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Getting quotas for project c4ef3fc15a0147e39228729d2b5b2631. Resources: {'ram', 'cores', 'instances'} {{(pid=124770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:37:32.502684 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.quota [None req-344f3fef-170c-4ade-996a-645a54dfaf82 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Getting quotas for user 0b82b6f568bd41fa9d6b44facb766e0b and project c4ef3fc15a0147e39228729d2b5b2631. Resources: {'ram', 'cores', 'instances'} {{(pid=124770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:37:32.577100 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-344f3fef-170c-4ade-996a-645a54dfaf82 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Going to run 1 instances... {{(pid=124770) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 11:37:32.579281 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-344f3fef-170c-4ade-996a-645a54dfaf82 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] [instance: be34b51d-aa45-4540-959d-a0f61d775992] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a69aaab5-7f01-4074-a271-f7d3e439795b',volume_size=None,volume_type=None)] {{(pid=124770) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 11:37:32.816050 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-0a9b6c09-9127-46a2-8765-c6c1cd0bead9 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:32.816761 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-0a9b6c09-9127-46a2-8765-c6c1cd0bead9 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: 2e661217-fb1a-48ad-9f1b-47985a4074de] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:32.823364 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-0a9b6c09-9127-46a2-8765-c6c1cd0bead9 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:32.823836 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-0a9b6c09-9127-46a2-8765-c6c1cd0bead9 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:32.824268 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-0a9b6c09-9127-46a2-8765-c6c1cd0bead9 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:32.825008 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-0a9b6c09-9127-46a2-8765-c6c1cd0bead9 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:32.825456 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-0a9b6c09-9127-46a2-8765-c6c1cd0bead9 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:32.825872 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-0a9b6c09-9127-46a2-8765-c6c1cd0bead9 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:33.046562 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-0a9b6c09-9127-46a2-8765-c6c1cd0bead9 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:33.056371 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-0a9b6c09-9127-46a2-8765-c6c1cd0bead9 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:33.057972 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-0a9b6c09-9127-46a2-8765-c6c1cd0bead9 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:33.059162 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-0a9b6c09-9127-46a2-8765-c6c1cd0bead9 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de" status: 200 len: 1726 microversion: 2.20 time: 0.247194 Aug 24 11:37:33.059731 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 271/512] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:37:32 2022] GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de => generated 1726 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 11:37:33.357437 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-344f3fef-170c-4ade-996a-645a54dfaf82 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] 10.222.0.84 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.587160 Aug 24 11:37:33.359009 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 242/513] 10.222.0.84 () {60 vars in 1147 bytes} [Wed Aug 24 11:37:31 2022] POST /compute/v2.1/servers => generated 406 bytes in 1590 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 11:37:33.376654 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-538fcf8d-3b35-40d5-bc4f-3de2904663dd tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:33.377305 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-538fcf8d-3b35-40d5-bc4f-3de2904663dd tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] [instance: be34b51d-aa45-4540-959d-a0f61d775992] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:33.467455 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-538fcf8d-3b35-40d5-bc4f-3de2904663dd tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b82b6f568bd41fa9d6b44facb766e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ef3fc15a0147e39228729d2b5b2631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:33.481019 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-538fcf8d-3b35-40d5-bc4f-3de2904663dd tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] 10.222.0.84 "GET /compute/v2.1/servers/be34b51d-aa45-4540-959d-a0f61d775992" status: 200 len: 1095 microversion: 2.1 time: 0.107493 Aug 24 11:37:33.482830 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 272/514] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:37:33 2022] GET /compute/v2.1/servers/be34b51d-aa45-4540-959d-a0f61d775992 => generated 1095 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:37:33.722831 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-50aad667-9f1f-44fb-9609-8083cbf32ddb tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-945893141", "imageRef": "028cad80-8f50-4139-b345-dfdca694dc6b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1a520e2a-cec7-4c07-8304-e0a7f6eeb34e"}], "security_groups": [{"name": "tempest-securitygroup--218354020"}], "key_name": "tempest-keypair-2021479066", "user_data": "}} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:37:33.833888 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.network.neutron [None req-50aad667-9f1f-44fb-9609-8083cbf32ddb tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] validate_networks() for [('1a520e2a-cec7-4c07-8304-e0a7f6eeb34e', None, None, None, None, None)] {{(pid=124770) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 11:37:34.087179 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-5717126d-ffe0-4c63-be26-fa6dbaf01a67 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:34.088146 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-5717126d-ffe0-4c63-be26-fa6dbaf01a67 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: 2e661217-fb1a-48ad-9f1b-47985a4074de] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:34.096499 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-5717126d-ffe0-4c63-be26-fa6dbaf01a67 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:34.097314 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-5717126d-ffe0-4c63-be26-fa6dbaf01a67 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:34.097870 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-5717126d-ffe0-4c63-be26-fa6dbaf01a67 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:34.098768 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-5717126d-ffe0-4c63-be26-fa6dbaf01a67 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:34.099295 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-5717126d-ffe0-4c63-be26-fa6dbaf01a67 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:34.099790 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-5717126d-ffe0-4c63-be26-fa6dbaf01a67 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:34.260907 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-5717126d-ffe0-4c63-be26-fa6dbaf01a67 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:34.270849 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-5717126d-ffe0-4c63-be26-fa6dbaf01a67 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:34.272589 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-5717126d-ffe0-4c63-be26-fa6dbaf01a67 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:34.273854 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-5717126d-ffe0-4c63-be26-fa6dbaf01a67 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de" status: 200 len: 1747 microversion: 2.20 time: 0.190913 Aug 24 11:37:34.282505 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 273/515] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:37:34 2022] GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de => generated 1747 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 11:37:34.507502 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-3c812d23-54aa-498e-866b-da6d7178c729 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:34.509490 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-3c812d23-54aa-498e-866b-da6d7178c729 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] [instance: be34b51d-aa45-4540-959d-a0f61d775992] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:34.575714 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.virt.hardware [None req-50aad667-9f1f-44fb-9609-8083cbf32ddb tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Flavor limits 0:0:0 {{(pid=124770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 11:37:34.576326 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.virt.hardware [None req-50aad667-9f1f-44fb-9609-8083cbf32ddb tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Image limits 0:0:0 {{(pid=124770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 11:37:34.576587 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.virt.hardware [None req-50aad667-9f1f-44fb-9609-8083cbf32ddb tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Flavor pref 0:0:0 {{(pid=124770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 11:37:34.577853 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.virt.hardware [None req-50aad667-9f1f-44fb-9609-8083cbf32ddb tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Image pref 0:0:0 {{(pid=124770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 11:37:34.578019 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.virt.hardware [None req-50aad667-9f1f-44fb-9609-8083cbf32ddb tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 11:37:34.582273 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-3c812d23-54aa-498e-866b-da6d7178c729 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b82b6f568bd41fa9d6b44facb766e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ef3fc15a0147e39228729d2b5b2631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:34.591518 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-3c812d23-54aa-498e-866b-da6d7178c729 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] 10.222.0.84 "GET /compute/v2.1/servers/be34b51d-aa45-4540-959d-a0f61d775992" status: 200 len: 1095 microversion: 2.1 time: 0.086484 Aug 24 11:37:34.591518 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 274/516] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:37:34 2022] GET /compute/v2.1/servers/be34b51d-aa45-4540-959d-a0f61d775992 => generated 1095 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:37:34.592169 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-50aad667-9f1f-44fb-9609-8083cbf32ddb tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:34.592658 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-50aad667-9f1f-44fb-9609-8083cbf32ddb tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:34.593195 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-50aad667-9f1f-44fb-9609-8083cbf32ddb tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:34.594056 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-50aad667-9f1f-44fb-9609-8083cbf32ddb tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:34.594502 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-50aad667-9f1f-44fb-9609-8083cbf32ddb tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:34.594922 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-50aad667-9f1f-44fb-9609-8083cbf32ddb tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:34.614170 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.quota [None req-50aad667-9f1f-44fb-9609-8083cbf32ddb tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Getting quotas for project 4a4159dc366f41bc9e4057a079f6fb5a. Resources: {'ram', 'cores', 'instances'} {{(pid=124770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:37:34.622184 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.quota [None req-50aad667-9f1f-44fb-9609-8083cbf32ddb tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Getting quotas for user 2715cf2a5129439c83a5347bb963f1a9 and project 4a4159dc366f41bc9e4057a079f6fb5a. Resources: {'ram', 'cores', 'instances'} {{(pid=124770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:37:34.637437 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-50aad667-9f1f-44fb-9609-8083cbf32ddb tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Going to run 1 instances... {{(pid=124770) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 11:37:34.639847 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-50aad667-9f1f-44fb-9609-8083cbf32ddb tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: ea26410d-7ad5-47e7-8d4a-ade5827e511c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='028cad80-8f50-4139-b345-dfdca694dc6b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124770) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 11:37:35.063786 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-50aad667-9f1f-44fb-9609-8083cbf32ddb tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.345442 Aug 24 11:37:35.064685 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 243/517] 10.222.0.84 () {60 vars in 1147 bytes} [Wed Aug 24 11:37:33 2022] POST /compute/v2.1/servers => generated 401 bytes in 1347 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 11:37:35.080294 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-9328d4fa-280b-4596-a52e-91ccaf9dc966 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:35.080960 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-9328d4fa-280b-4596-a52e-91ccaf9dc966 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: ea26410d-7ad5-47e7-8d4a-ade5827e511c] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:35.191436 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-9328d4fa-280b-4596-a52e-91ccaf9dc966 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2715cf2a5129439c83a5347bb963f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4159dc366f41bc9e4057a079f6fb5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:35.208597 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-9328d4fa-280b-4596-a52e-91ccaf9dc966 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "GET /compute/v2.1/servers/ea26410d-7ad5-47e7-8d4a-ade5827e511c" status: 200 len: 1241 microversion: 2.1 time: 0.131985 Aug 24 11:37:35.232139 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 275/518] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:37:35 2022] GET /compute/v2.1/servers/ea26410d-7ad5-47e7-8d4a-ade5827e511c => generated 1241 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:37:35.298948 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-97c947f9-3924-4a9c-96f9-634613a2fe2e tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:35.299693 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-97c947f9-3924-4a9c-96f9-634613a2fe2e tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: 2e661217-fb1a-48ad-9f1b-47985a4074de] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:35.306976 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-97c947f9-3924-4a9c-96f9-634613a2fe2e tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:35.307410 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-97c947f9-3924-4a9c-96f9-634613a2fe2e tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:35.308388 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-97c947f9-3924-4a9c-96f9-634613a2fe2e tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:35.309701 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-97c947f9-3924-4a9c-96f9-634613a2fe2e tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:35.311442 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-97c947f9-3924-4a9c-96f9-634613a2fe2e tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:35.312462 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-97c947f9-3924-4a9c-96f9-634613a2fe2e tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:35.520966 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-97c947f9-3924-4a9c-96f9-634613a2fe2e tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:35.540551 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-97c947f9-3924-4a9c-96f9-634613a2fe2e tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:35.544039 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-97c947f9-3924-4a9c-96f9-634613a2fe2e tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:35.546433 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-97c947f9-3924-4a9c-96f9-634613a2fe2e tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de" status: 200 len: 1747 microversion: 2.20 time: 0.251489 Aug 24 11:37:35.547311 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 244/519] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:37:35 2022] GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de => generated 1747 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:37:35.608930 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-2e6f6d4f-b7bb-4c4c-9a66-13a4b09f3561 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:35.609577 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-2e6f6d4f-b7bb-4c4c-9a66-13a4b09f3561 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] [instance: be34b51d-aa45-4540-959d-a0f61d775992] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:35.678408 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-2e6f6d4f-b7bb-4c4c-9a66-13a4b09f3561 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b82b6f568bd41fa9d6b44facb766e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ef3fc15a0147e39228729d2b5b2631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:35.688406 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-2e6f6d4f-b7bb-4c4c-9a66-13a4b09f3561 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] 10.222.0.84 "GET /compute/v2.1/servers/be34b51d-aa45-4540-959d-a0f61d775992" status: 200 len: 1095 microversion: 2.1 time: 0.083390 Aug 24 11:37:35.689351 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 276/520] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:37:35 2022] GET /compute/v2.1/servers/be34b51d-aa45-4540-959d-a0f61d775992 => generated 1095 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:37:36.234887 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-a082ed12-a6c3-4784-883e-c3c7da773f33 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:36.235575 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-a082ed12-a6c3-4784-883e-c3c7da773f33 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: ea26410d-7ad5-47e7-8d4a-ade5827e511c] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:36.327933 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-a082ed12-a6c3-4784-883e-c3c7da773f33 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2715cf2a5129439c83a5347bb963f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4159dc366f41bc9e4057a079f6fb5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:36.342116 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-a082ed12-a6c3-4784-883e-c3c7da773f33 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "GET /compute/v2.1/servers/ea26410d-7ad5-47e7-8d4a-ade5827e511c" status: 200 len: 1241 microversion: 2.1 time: 0.111776 Aug 24 11:37:36.342691 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 245/521] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:37:36 2022] GET /compute/v2.1/servers/ea26410d-7ad5-47e7-8d4a-ade5827e511c => generated 1241 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:37:36.573824 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-bb2f6421-e7e6-4961-8967-149f7ceea252 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:36.574424 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-bb2f6421-e7e6-4961-8967-149f7ceea252 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: 2e661217-fb1a-48ad-9f1b-47985a4074de] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:36.584562 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-bb2f6421-e7e6-4961-8967-149f7ceea252 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:36.585095 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-bb2f6421-e7e6-4961-8967-149f7ceea252 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:36.585546 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-bb2f6421-e7e6-4961-8967-149f7ceea252 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:36.586288 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-bb2f6421-e7e6-4961-8967-149f7ceea252 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:36.586744 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-bb2f6421-e7e6-4961-8967-149f7ceea252 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:36.591097 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-bb2f6421-e7e6-4961-8967-149f7ceea252 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:36.710484 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-c5ac80f8-beb3-4a07-b7fa-d0f8f5f2001a tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:36.711109 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-c5ac80f8-beb3-4a07-b7fa-d0f8f5f2001a tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] [instance: be34b51d-aa45-4540-959d-a0f61d775992] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:36.725176 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c5ac80f8-beb3-4a07-b7fa-d0f8f5f2001a tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:36.725858 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c5ac80f8-beb3-4a07-b7fa-d0f8f5f2001a tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:36.726617 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c5ac80f8-beb3-4a07-b7fa-d0f8f5f2001a tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:36.727919 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c5ac80f8-beb3-4a07-b7fa-d0f8f5f2001a tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:36.728680 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c5ac80f8-beb3-4a07-b7fa-d0f8f5f2001a tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:36.729460 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c5ac80f8-beb3-4a07-b7fa-d0f8f5f2001a tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:36.789818 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-bb2f6421-e7e6-4961-8967-149f7ceea252 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:36.799431 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-bb2f6421-e7e6-4961-8967-149f7ceea252 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:36.802585 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-bb2f6421-e7e6-4961-8967-149f7ceea252 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:36.804071 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-bb2f6421-e7e6-4961-8967-149f7ceea252 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de" status: 200 len: 1747 microversion: 2.20 time: 0.234244 Aug 24 11:37:36.804755 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 277/522] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:37:36 2022] GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de => generated 1747 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:37:36.806080 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-c5ac80f8-beb3-4a07-b7fa-d0f8f5f2001a tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b82b6f568bd41fa9d6b44facb766e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ef3fc15a0147e39228729d2b5b2631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:36.816112 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-c5ac80f8-beb3-4a07-b7fa-d0f8f5f2001a tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] 10.222.0.84 "GET /compute/v2.1/servers/be34b51d-aa45-4540-959d-a0f61d775992" status: 200 len: 1145 microversion: 2.1 time: 0.109107 Aug 24 11:37:36.826605 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 246/523] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:37:36 2022] GET /compute/v2.1/servers/be34b51d-aa45-4540-959d-a0f61d775992 => generated 1145 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:37:36.933205 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [req-6d0f2a63-3721-49c9-bee1-7b608875a5e8 req-70f76f8b-479a-4c01-ae4b-b5dc12576c2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e661217-fb1a-48ad-9f1b-47985a4074de", "name": "network-vif-plugged", "status": "completed", "tag": "e82d60e7-8369-4554-9da0-a0a3a25fe586"}]} {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:37:36.944528 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [req-6d0f2a63-3721-49c9-bee1-7b608875a5e8 req-70f76f8b-479a-4c01-ae4b-b5dc12576c2d service nova] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:36.945069 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [req-6d0f2a63-3721-49c9-bee1-7b608875a5e8 req-70f76f8b-479a-4c01-ae4b-b5dc12576c2d service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:36.945568 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [req-6d0f2a63-3721-49c9-bee1-7b608875a5e8 req-70f76f8b-479a-4c01-ae4b-b5dc12576c2d service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:36.959357 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.compute.server_external_events [req-6d0f2a63-3721-49c9-bee1-7b608875a5e8 req-70f76f8b-479a-4c01-ae4b-b5dc12576c2d service nova] Creating event network-vif-plugged:e82d60e7-8369-4554-9da0-a0a3a25fe586 for instance 2e661217-fb1a-48ad-9f1b-47985a4074de on hv-cinder-85427 Aug 24 11:37:36.966148 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [req-6d0f2a63-3721-49c9-bee1-7b608875a5e8 req-70f76f8b-479a-4c01-ae4b-b5dc12576c2d service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104014 Aug 24 11:37:36.966871 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 278/524] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Aug 24 11:37:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:37:37.363864 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-dfe2491c-030f-4bba-ae76-6ef826dfde64 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:37.364663 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-dfe2491c-030f-4bba-ae76-6ef826dfde64 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: ea26410d-7ad5-47e7-8d4a-ade5827e511c] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:37.374691 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-dfe2491c-030f-4bba-ae76-6ef826dfde64 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:37.375198 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-dfe2491c-030f-4bba-ae76-6ef826dfde64 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:37.375827 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-dfe2491c-030f-4bba-ae76-6ef826dfde64 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:37.376759 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-dfe2491c-030f-4bba-ae76-6ef826dfde64 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:37.377258 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-dfe2491c-030f-4bba-ae76-6ef826dfde64 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:37.377693 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-dfe2491c-030f-4bba-ae76-6ef826dfde64 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:37.384058 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:37:37.475647 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-dfe2491c-030f-4bba-ae76-6ef826dfde64 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2715cf2a5129439c83a5347bb963f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4159dc366f41bc9e4057a079f6fb5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:37.489371 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-dfe2491c-030f-4bba-ae76-6ef826dfde64 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "GET /compute/v2.1/servers/ea26410d-7ad5-47e7-8d4a-ade5827e511c" status: 200 len: 1245 microversion: 2.1 time: 0.129866 Aug 24 11:37:37.490359 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 247/525] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:37:37 2022] GET /compute/v2.1/servers/ea26410d-7ad5-47e7-8d4a-ade5827e511c => generated 1245 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:37:37.832832 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-846513ce-2ad1-41be-9d67-572e94c6a63a tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:37.833485 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-846513ce-2ad1-41be-9d67-572e94c6a63a tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: 2e661217-fb1a-48ad-9f1b-47985a4074de] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:37.846347 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-846513ce-2ad1-41be-9d67-572e94c6a63a tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:37.852886 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-846513ce-2ad1-41be-9d67-572e94c6a63a tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:37.852886 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-846513ce-2ad1-41be-9d67-572e94c6a63a tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:37.852886 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-846513ce-2ad1-41be-9d67-572e94c6a63a tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:37.853433 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-70d5636d-faa7-4883-983a-c918bc259805 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:37.853662 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-846513ce-2ad1-41be-9d67-572e94c6a63a tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:37.853662 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-846513ce-2ad1-41be-9d67-572e94c6a63a tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:37.853971 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-70d5636d-faa7-4883-983a-c918bc259805 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] [instance: be34b51d-aa45-4540-959d-a0f61d775992] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:37.862237 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-70d5636d-faa7-4883-983a-c918bc259805 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:37.863163 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-70d5636d-faa7-4883-983a-c918bc259805 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:37.863862 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-70d5636d-faa7-4883-983a-c918bc259805 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:37.865040 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-70d5636d-faa7-4883-983a-c918bc259805 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:37.865812 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-70d5636d-faa7-4883-983a-c918bc259805 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:37.866500 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-70d5636d-faa7-4883-983a-c918bc259805 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:37.950162 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-70d5636d-faa7-4883-983a-c918bc259805 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b82b6f568bd41fa9d6b44facb766e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ef3fc15a0147e39228729d2b5b2631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:37.963255 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-70d5636d-faa7-4883-983a-c918bc259805 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] 10.222.0.84 "GET /compute/v2.1/servers/be34b51d-aa45-4540-959d-a0f61d775992" status: 200 len: 1145 microversion: 2.1 time: 0.120802 Aug 24 11:37:37.963874 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 248/526] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:37:37 2022] GET /compute/v2.1/servers/be34b51d-aa45-4540-959d-a0f61d775992 => generated 1145 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:37:38.016678 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-846513ce-2ad1-41be-9d67-572e94c6a63a tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:38.026434 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-846513ce-2ad1-41be-9d67-572e94c6a63a tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:38.027931 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-846513ce-2ad1-41be-9d67-572e94c6a63a tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:38.029230 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-846513ce-2ad1-41be-9d67-572e94c6a63a tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de" status: 200 len: 1747 microversion: 2.20 time: 0.202685 Aug 24 11:37:38.029786 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 279/527] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:37:37 2022] GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de => generated 1747 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:37:38.515305 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-525d2177-b769-4680-ac3b-d7faf7eea125 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:38.516164 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-525d2177-b769-4680-ac3b-d7faf7eea125 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: ea26410d-7ad5-47e7-8d4a-ade5827e511c] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:38.519695 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=6 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:37:38.528005 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-525d2177-b769-4680-ac3b-d7faf7eea125 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:38.528826 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-525d2177-b769-4680-ac3b-d7faf7eea125 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:38.529544 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-525d2177-b769-4680-ac3b-d7faf7eea125 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:38.530615 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-525d2177-b769-4680-ac3b-d7faf7eea125 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:38.531321 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-525d2177-b769-4680-ac3b-d7faf7eea125 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:38.532005 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-525d2177-b769-4680-ac3b-d7faf7eea125 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:38.606601 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-525d2177-b769-4680-ac3b-d7faf7eea125 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2715cf2a5129439c83a5347bb963f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4159dc366f41bc9e4057a079f6fb5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:38.615955 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-525d2177-b769-4680-ac3b-d7faf7eea125 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "GET /compute/v2.1/servers/ea26410d-7ad5-47e7-8d4a-ade5827e511c" status: 200 len: 1237 microversion: 2.1 time: 0.107777 Aug 24 11:37:38.616538 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 249/528] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:37:38 2022] GET /compute/v2.1/servers/ea26410d-7ad5-47e7-8d4a-ade5827e511c => generated 1237 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:37:38.985083 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-538d1c29-d40b-4ceb-a904-17c8fdfb3578 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:38.985691 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-538d1c29-d40b-4ceb-a904-17c8fdfb3578 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] [instance: be34b51d-aa45-4540-959d-a0f61d775992] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:38.992540 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-538d1c29-d40b-4ceb-a904-17c8fdfb3578 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:38.996027 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-538d1c29-d40b-4ceb-a904-17c8fdfb3578 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:38.996027 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-538d1c29-d40b-4ceb-a904-17c8fdfb3578 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:38.996027 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-538d1c29-d40b-4ceb-a904-17c8fdfb3578 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:38.996027 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-538d1c29-d40b-4ceb-a904-17c8fdfb3578 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:38.996407 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-538d1c29-d40b-4ceb-a904-17c8fdfb3578 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:39.053232 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-f19d5aa8-3284-491a-a470-4c9b0b785eac tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:39.053862 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-f19d5aa8-3284-491a-a470-4c9b0b785eac tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: 2e661217-fb1a-48ad-9f1b-47985a4074de] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:39.060702 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-f19d5aa8-3284-491a-a470-4c9b0b785eac tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:39.061309 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-f19d5aa8-3284-491a-a470-4c9b0b785eac tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:39.061634 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-538d1c29-d40b-4ceb-a904-17c8fdfb3578 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b82b6f568bd41fa9d6b44facb766e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ef3fc15a0147e39228729d2b5b2631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:39.061787 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-f19d5aa8-3284-491a-a470-4c9b0b785eac tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:39.062462 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-f19d5aa8-3284-491a-a470-4c9b0b785eac tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:39.062911 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-f19d5aa8-3284-491a-a470-4c9b0b785eac tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:39.063331 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-f19d5aa8-3284-491a-a470-4c9b0b785eac tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:39.070438 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-538d1c29-d40b-4ceb-a904-17c8fdfb3578 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] 10.222.0.84 "GET /compute/v2.1/servers/be34b51d-aa45-4540-959d-a0f61d775992" status: 200 len: 1193 microversion: 2.1 time: 0.089193 Aug 24 11:37:39.071055 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 280/529] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:37:38 2022] GET /compute/v2.1/servers/be34b51d-aa45-4540-959d-a0f61d775992 => generated 1193 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:37:39.215700 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-f19d5aa8-3284-491a-a470-4c9b0b785eac tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:39.225260 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-f19d5aa8-3284-491a-a470-4c9b0b785eac tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:39.226814 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-f19d5aa8-3284-491a-a470-4c9b0b785eac tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:39.228117 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-f19d5aa8-3284-491a-a470-4c9b0b785eac tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de" status: 200 len: 1747 microversion: 2.20 time: 0.179042 Aug 24 11:37:39.228744 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 250/530] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:37:39 2022] GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de => generated 1747 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 11:37:39.639149 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-ae66a9fd-2ac5-4f95-9d47-7899723a550c tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:39.639725 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-ae66a9fd-2ac5-4f95-9d47-7899723a550c tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: ea26410d-7ad5-47e7-8d4a-ade5827e511c] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:39.646476 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-ae66a9fd-2ac5-4f95-9d47-7899723a550c tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:39.646965 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-ae66a9fd-2ac5-4f95-9d47-7899723a550c tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:39.647474 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-ae66a9fd-2ac5-4f95-9d47-7899723a550c tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:39.648290 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-ae66a9fd-2ac5-4f95-9d47-7899723a550c tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:39.648832 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-ae66a9fd-2ac5-4f95-9d47-7899723a550c tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:39.649298 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-ae66a9fd-2ac5-4f95-9d47-7899723a550c tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:39.742315 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-ae66a9fd-2ac5-4f95-9d47-7899723a550c tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2715cf2a5129439c83a5347bb963f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4159dc366f41bc9e4057a079f6fb5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:39.755904 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-ae66a9fd-2ac5-4f95-9d47-7899723a550c tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "GET /compute/v2.1/servers/ea26410d-7ad5-47e7-8d4a-ade5827e511c" status: 200 len: 1293 microversion: 2.1 time: 0.121230 Aug 24 11:37:39.765953 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 281/531] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:37:39 2022] GET /compute/v2.1/servers/ea26410d-7ad5-47e7-8d4a-ade5827e511c => generated 1293 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:37:39.967243 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-7c932180-f490-4e66-a194-a715ea58905e tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:37:39.976613 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-7c932180-f490-4e66-a194-a715ea58905e tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:39.977162 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-7c932180-f490-4e66-a194-a715ea58905e tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:39.977592 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-7c932180-f490-4e66-a194-a715ea58905e tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:40.041405 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-7c932180-f490-4e66-a194-a715ea58905e tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] [instance: 15d4a46e-9504-4897-918d-39aafc20d22a] Going to try to stop instance {{(pid=124770) force_stop /opt/stack/nova/nova/compute/api.py:2749}} Aug 24 11:37:40.095123 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-1a607311-5b6d-483e-868d-372b9270fc18 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:40.095825 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-1a607311-5b6d-483e-868d-372b9270fc18 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] [instance: be34b51d-aa45-4540-959d-a0f61d775992] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:40.103265 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-1a607311-5b6d-483e-868d-372b9270fc18 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:40.106266 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-1a607311-5b6d-483e-868d-372b9270fc18 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:40.106266 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-1a607311-5b6d-483e-868d-372b9270fc18 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:40.106266 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-1a607311-5b6d-483e-868d-372b9270fc18 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:40.106266 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-1a607311-5b6d-483e-868d-372b9270fc18 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:40.106704 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-1a607311-5b6d-483e-868d-372b9270fc18 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:40.175263 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-1a607311-5b6d-483e-868d-372b9270fc18 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b82b6f568bd41fa9d6b44facb766e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ef3fc15a0147e39228729d2b5b2631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:40.183477 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-1a607311-5b6d-483e-868d-372b9270fc18 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] 10.222.0.84 "GET /compute/v2.1/servers/be34b51d-aa45-4540-959d-a0f61d775992" status: 200 len: 1193 microversion: 2.1 time: 0.092174 Aug 24 11:37:40.184124 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 282/532] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:37:40 2022] GET /compute/v2.1/servers/be34b51d-aa45-4540-959d-a0f61d775992 => generated 1193 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:37:40.252041 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-8e4ffb3f-f912-4e8e-a3f3-d4f9c80ded5c tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:40.252655 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-8e4ffb3f-f912-4e8e-a3f3-d4f9c80ded5c tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: 2e661217-fb1a-48ad-9f1b-47985a4074de] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:40.259164 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-8e4ffb3f-f912-4e8e-a3f3-d4f9c80ded5c tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:40.259651 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-8e4ffb3f-f912-4e8e-a3f3-d4f9c80ded5c tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:40.260089 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-8e4ffb3f-f912-4e8e-a3f3-d4f9c80ded5c tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:40.260787 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-8e4ffb3f-f912-4e8e-a3f3-d4f9c80ded5c tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:40.261268 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-8e4ffb3f-f912-4e8e-a3f3-d4f9c80ded5c tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:40.261693 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-8e4ffb3f-f912-4e8e-a3f3-d4f9c80ded5c tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:40.425421 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-8e4ffb3f-f912-4e8e-a3f3-d4f9c80ded5c tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:40.437236 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-8e4ffb3f-f912-4e8e-a3f3-d4f9c80ded5c tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:40.442547 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-8e4ffb3f-f912-4e8e-a3f3-d4f9c80ded5c tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:40.443760 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-8e4ffb3f-f912-4e8e-a3f3-d4f9c80ded5c tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de" status: 200 len: 1747 microversion: 2.20 time: 0.195697 Aug 24 11:37:40.456843 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 283/533] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:37:40 2022] GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de => generated 1747 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 11:37:40.719766 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-7c932180-f490-4e66-a194-a715ea58905e tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] 10.222.0.84 "POST /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a/action" status: 202 len: 0 microversion: 2.1 time: 0.756402 Aug 24 11:37:40.721248 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 251/534] 10.222.0.84 () {60 vars in 1278 bytes} [Wed Aug 24 11:37:39 2022] POST /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a/action => generated 0 bytes in 759 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 11:37:40.732437 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-0dedac37-edda-4fe4-b30a-c11842de02f1 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:40.737951 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-0dedac37-edda-4fe4-b30a-c11842de02f1 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] [instance: 15d4a46e-9504-4897-918d-39aafc20d22a] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:40.741113 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-0dedac37-edda-4fe4-b30a-c11842de02f1 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:40.741891 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-0dedac37-edda-4fe4-b30a-c11842de02f1 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:40.742539 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-0dedac37-edda-4fe4-b30a-c11842de02f1 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:40.743701 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-0dedac37-edda-4fe4-b30a-c11842de02f1 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:40.744266 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-0dedac37-edda-4fe4-b30a-c11842de02f1 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:40.744931 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-0dedac37-edda-4fe4-b30a-c11842de02f1 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:40.782879 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-33beb398-9e59-4db6-8923-8f1034f86389 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:40.785236 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-33beb398-9e59-4db6-8923-8f1034f86389 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: ea26410d-7ad5-47e7-8d4a-ade5827e511c] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:40.804596 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-33beb398-9e59-4db6-8923-8f1034f86389 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:40.806033 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-33beb398-9e59-4db6-8923-8f1034f86389 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:40.807429 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-33beb398-9e59-4db6-8923-8f1034f86389 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:40.818687 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-33beb398-9e59-4db6-8923-8f1034f86389 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:40.819545 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-33beb398-9e59-4db6-8923-8f1034f86389 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:40.820269 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-33beb398-9e59-4db6-8923-8f1034f86389 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:40.975514 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-33beb398-9e59-4db6-8923-8f1034f86389 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2715cf2a5129439c83a5347bb963f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4159dc366f41bc9e4057a079f6fb5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:40.988439 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-0dedac37-edda-4fe4-b30a-c11842de02f1 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031939e16194f63b99e6f27f700fa8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecec6d0c155f4d658197c4779ab9ffce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:40.988952 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-33beb398-9e59-4db6-8923-8f1034f86389 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "GET /compute/v2.1/servers/ea26410d-7ad5-47e7-8d4a-ade5827e511c" status: 200 len: 1301 microversion: 2.1 time: 0.211983 Aug 24 11:37:40.988952 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 252/535] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:37:40 2022] GET /compute/v2.1/servers/ea26410d-7ad5-47e7-8d4a-ade5827e511c => generated 1301 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:37:40.995852 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-0dedac37-edda-4fe4-b30a-c11842de02f1 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] 10.222.0.84 "GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a" status: 200 len: 1723 microversion: 2.1 time: 0.268174 Aug 24 11:37:40.997631 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 284/536] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:37:40 2022] GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a => generated 1723 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:37:41.204816 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-42d5b52c-26b4-46a9-8a14-06b8ab82d2c9 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:41.205693 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-42d5b52c-26b4-46a9-8a14-06b8ab82d2c9 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] [instance: be34b51d-aa45-4540-959d-a0f61d775992] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:41.214602 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-42d5b52c-26b4-46a9-8a14-06b8ab82d2c9 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:41.215575 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-42d5b52c-26b4-46a9-8a14-06b8ab82d2c9 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:41.216150 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-42d5b52c-26b4-46a9-8a14-06b8ab82d2c9 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:41.217173 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-42d5b52c-26b4-46a9-8a14-06b8ab82d2c9 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:41.217912 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-42d5b52c-26b4-46a9-8a14-06b8ab82d2c9 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:41.218615 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-42d5b52c-26b4-46a9-8a14-06b8ab82d2c9 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:41.387368 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-42d5b52c-26b4-46a9-8a14-06b8ab82d2c9 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b82b6f568bd41fa9d6b44facb766e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ef3fc15a0147e39228729d2b5b2631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:41.419097 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-42d5b52c-26b4-46a9-8a14-06b8ab82d2c9 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] 10.222.0.84 "GET /compute/v2.1/servers/be34b51d-aa45-4540-959d-a0f61d775992" status: 200 len: 1211 microversion: 2.1 time: 0.218230 Aug 24 11:37:41.424063 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 253/537] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:37:41 2022] GET /compute/v2.1/servers/be34b51d-aa45-4540-959d-a0f61d775992 => generated 1211 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:37:41.488851 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-a1beb574-acdf-4ebf-b530-ac46fd3d4c9e tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:41.491421 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-a1beb574-acdf-4ebf-b530-ac46fd3d4c9e tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: 2e661217-fb1a-48ad-9f1b-47985a4074de] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:41.504756 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-a1beb574-acdf-4ebf-b530-ac46fd3d4c9e tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:41.506088 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-a1beb574-acdf-4ebf-b530-ac46fd3d4c9e tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:41.506861 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-a1beb574-acdf-4ebf-b530-ac46fd3d4c9e tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:41.509005 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-a1beb574-acdf-4ebf-b530-ac46fd3d4c9e tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:41.510039 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-a1beb574-acdf-4ebf-b530-ac46fd3d4c9e tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:41.511850 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-a1beb574-acdf-4ebf-b530-ac46fd3d4c9e tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:41.722246 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-a1beb574-acdf-4ebf-b530-ac46fd3d4c9e tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:41.733198 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-a1beb574-acdf-4ebf-b530-ac46fd3d4c9e tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:41.734975 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-a1beb574-acdf-4ebf-b530-ac46fd3d4c9e tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:41.736540 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-a1beb574-acdf-4ebf-b530-ac46fd3d4c9e tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de" status: 200 len: 1747 microversion: 2.20 time: 0.256502 Aug 24 11:37:41.738673 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 285/538] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:37:41 2022] GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de => generated 1747 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:37:42.013542 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-6ea3b7fa-a589-431f-8154-5d9e6c4af015 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:42.015467 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-6ea3b7fa-a589-431f-8154-5d9e6c4af015 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: ea26410d-7ad5-47e7-8d4a-ade5827e511c] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:42.022504 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-1e6c0bdc-fe73-42fe-bbfa-06d6d2405a30 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:42.023701 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-1e6c0bdc-fe73-42fe-bbfa-06d6d2405a30 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] [instance: 15d4a46e-9504-4897-918d-39aafc20d22a] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:42.031653 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-1e6c0bdc-fe73-42fe-bbfa-06d6d2405a30 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:42.032457 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-1e6c0bdc-fe73-42fe-bbfa-06d6d2405a30 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:42.033086 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-1e6c0bdc-fe73-42fe-bbfa-06d6d2405a30 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:42.035043 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-1e6c0bdc-fe73-42fe-bbfa-06d6d2405a30 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:42.035738 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6ea3b7fa-a589-431f-8154-5d9e6c4af015 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:42.036711 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-1e6c0bdc-fe73-42fe-bbfa-06d6d2405a30 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:42.036924 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6ea3b7fa-a589-431f-8154-5d9e6c4af015 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:42.037502 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-1e6c0bdc-fe73-42fe-bbfa-06d6d2405a30 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:42.037625 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6ea3b7fa-a589-431f-8154-5d9e6c4af015 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:42.038762 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6ea3b7fa-a589-431f-8154-5d9e6c4af015 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:42.039549 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6ea3b7fa-a589-431f-8154-5d9e6c4af015 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:42.040269 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6ea3b7fa-a589-431f-8154-5d9e6c4af015 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:42.068175 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG dbcounter [-] [124769] Writing DB stats nova_cell1:SELECT=100 {{(pid=124769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:37:42.324242 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-6ea3b7fa-a589-431f-8154-5d9e6c4af015 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2715cf2a5129439c83a5347bb963f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4159dc366f41bc9e4057a079f6fb5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:42.338843 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-6ea3b7fa-a589-431f-8154-5d9e6c4af015 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "GET /compute/v2.1/servers/ea26410d-7ad5-47e7-8d4a-ade5827e511c" status: 200 len: 1366 microversion: 2.1 time: 0.331150 Aug 24 11:37:42.351037 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 254/539] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:37:42 2022] GET /compute/v2.1/servers/ea26410d-7ad5-47e7-8d4a-ade5827e511c => generated 1366 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:37:42.368998 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-1e6c0bdc-fe73-42fe-bbfa-06d6d2405a30 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031939e16194f63b99e6f27f700fa8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecec6d0c155f4d658197c4779ab9ffce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:42.381087 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-1e6c0bdc-fe73-42fe-bbfa-06d6d2405a30 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] 10.222.0.84 "GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a" status: 200 len: 1723 microversion: 2.1 time: 0.364419 Aug 24 11:37:42.382071 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 286/540] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:37:42 2022] GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a => generated 1723 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:37:42.458900 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-0a6a594d-62d0-4854-a697-a18c3257e3c4 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:42.459726 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-0a6a594d-62d0-4854-a697-a18c3257e3c4 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] [instance: be34b51d-aa45-4540-959d-a0f61d775992] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:42.467573 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-0a6a594d-62d0-4854-a697-a18c3257e3c4 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:42.468069 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-0a6a594d-62d0-4854-a697-a18c3257e3c4 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:42.468502 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-0a6a594d-62d0-4854-a697-a18c3257e3c4 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:42.469556 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-0a6a594d-62d0-4854-a697-a18c3257e3c4 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:42.470044 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-0a6a594d-62d0-4854-a697-a18c3257e3c4 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:42.470481 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-0a6a594d-62d0-4854-a697-a18c3257e3c4 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:42.767673 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-14743675-4a68-4430-ad91-60f1b9da67e0 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:42.768438 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-14743675-4a68-4430-ad91-60f1b9da67e0 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: 2e661217-fb1a-48ad-9f1b-47985a4074de] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:42.776576 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-14743675-4a68-4430-ad91-60f1b9da67e0 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:42.777101 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-14743675-4a68-4430-ad91-60f1b9da67e0 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:42.777542 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-14743675-4a68-4430-ad91-60f1b9da67e0 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:42.778470 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-14743675-4a68-4430-ad91-60f1b9da67e0 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:42.778934 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-14743675-4a68-4430-ad91-60f1b9da67e0 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:42.779368 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-14743675-4a68-4430-ad91-60f1b9da67e0 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:42.835698 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-0a6a594d-62d0-4854-a697-a18c3257e3c4 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b82b6f568bd41fa9d6b44facb766e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ef3fc15a0147e39228729d2b5b2631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:42.843461 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-0a6a594d-62d0-4854-a697-a18c3257e3c4 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] 10.222.0.84 "GET /compute/v2.1/servers/be34b51d-aa45-4540-959d-a0f61d775992" status: 200 len: 1279 microversion: 2.1 time: 0.389089 Aug 24 11:37:42.844395 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 255/541] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:37:42 2022] GET /compute/v2.1/servers/be34b51d-aa45-4540-959d-a0f61d775992 => generated 1279 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:37:42.988907 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-14743675-4a68-4430-ad91-60f1b9da67e0 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:42.997712 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-14743675-4a68-4430-ad91-60f1b9da67e0 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:42.999364 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-14743675-4a68-4430-ad91-60f1b9da67e0 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:43.000542 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-14743675-4a68-4430-ad91-60f1b9da67e0 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de" status: 200 len: 1747 microversion: 2.20 time: 0.238326 Aug 24 11:37:43.001137 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 287/542] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:37:42 2022] GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de => generated 1747 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 11:37:43.362356 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-ec104054-5b79-4f6c-8eb2-51a028176470 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:43.363223 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-ec104054-5b79-4f6c-8eb2-51a028176470 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: ea26410d-7ad5-47e7-8d4a-ade5827e511c] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:43.370012 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ec104054-5b79-4f6c-8eb2-51a028176470 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:43.370512 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ec104054-5b79-4f6c-8eb2-51a028176470 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:43.371206 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ec104054-5b79-4f6c-8eb2-51a028176470 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:43.371902 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ec104054-5b79-4f6c-8eb2-51a028176470 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:43.372358 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ec104054-5b79-4f6c-8eb2-51a028176470 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:43.372820 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ec104054-5b79-4f6c-8eb2-51a028176470 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:43.404178 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-08f53802-df82-4156-83b9-e5df01638e0a tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:43.404788 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-08f53802-df82-4156-83b9-e5df01638e0a tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] [instance: 15d4a46e-9504-4897-918d-39aafc20d22a] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:43.411919 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-08f53802-df82-4156-83b9-e5df01638e0a tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:43.412471 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-08f53802-df82-4156-83b9-e5df01638e0a tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:43.412934 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-08f53802-df82-4156-83b9-e5df01638e0a tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:43.413652 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-08f53802-df82-4156-83b9-e5df01638e0a tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:43.414102 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-08f53802-df82-4156-83b9-e5df01638e0a tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:43.414521 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-08f53802-df82-4156-83b9-e5df01638e0a tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:43.605203 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-08f53802-df82-4156-83b9-e5df01638e0a tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031939e16194f63b99e6f27f700fa8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecec6d0c155f4d658197c4779ab9ffce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:43.619690 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-08f53802-df82-4156-83b9-e5df01638e0a tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] 10.222.0.84 "GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a" status: 200 len: 1723 microversion: 2.1 time: 0.219182 Aug 24 11:37:43.622983 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 288/543] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:37:43 2022] GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a => generated 1723 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:37:43.754107 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-ec104054-5b79-4f6c-8eb2-51a028176470 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2715cf2a5129439c83a5347bb963f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4159dc366f41bc9e4057a079f6fb5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:43.792535 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-ec104054-5b79-4f6c-8eb2-51a028176470 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "GET /compute/v2.1/servers/ea26410d-7ad5-47e7-8d4a-ade5827e511c" status: 200 len: 1366 microversion: 2.1 time: 0.433996 Aug 24 11:37:43.793300 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 256/544] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:37:43 2022] GET /compute/v2.1/servers/ea26410d-7ad5-47e7-8d4a-ade5827e511c => generated 1366 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:37:43.874683 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-6750cee5-1215-4096-881f-a2fcd9ec677b tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:43.876837 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-6750cee5-1215-4096-881f-a2fcd9ec677b tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] [instance: be34b51d-aa45-4540-959d-a0f61d775992] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:43.906052 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-6750cee5-1215-4096-881f-a2fcd9ec677b tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:43.907137 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-6750cee5-1215-4096-881f-a2fcd9ec677b tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:43.912621 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-6750cee5-1215-4096-881f-a2fcd9ec677b tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:43.914209 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-6750cee5-1215-4096-881f-a2fcd9ec677b tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:43.915109 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-6750cee5-1215-4096-881f-a2fcd9ec677b tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:43.915844 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-6750cee5-1215-4096-881f-a2fcd9ec677b tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:43.989863 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [req-e8ade089-5431-49be-a429-626c41077e30 req-810776c5-d8c8-487b-b9e0-50b429dffec5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea26410d-7ad5-47e7-8d4a-ade5827e511c", "tag": "b747c4d8-3ba6-4e33-ada3-b81ba17dac29"}]} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:37:44.000135 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-e8ade089-5431-49be-a429-626c41077e30 req-810776c5-d8c8-487b-b9e0-50b429dffec5 service nova] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:44.000917 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-e8ade089-5431-49be-a429-626c41077e30 req-810776c5-d8c8-487b-b9e0-50b429dffec5 service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:44.001533 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-e8ade089-5431-49be-a429-626c41077e30 req-810776c5-d8c8-487b-b9e0-50b429dffec5 service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:44.014541 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.compute.server_external_events [req-e8ade089-5431-49be-a429-626c41077e30 req-810776c5-d8c8-487b-b9e0-50b429dffec5 service nova] Creating event network-changed:b747c4d8-3ba6-4e33-ada3-b81ba17dac29 for instance ea26410d-7ad5-47e7-8d4a-ade5827e511c on hv-cinder-85427 Aug 24 11:37:44.022667 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [req-e8ade089-5431-49be-a429-626c41077e30 req-810776c5-d8c8-487b-b9e0-50b429dffec5 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127608 Aug 24 11:37:44.023722 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 257/545] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Aug 24 11:37:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:37:44.031527 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-4cef84ae-8e5e-45c1-bd4e-0faafe1779b5 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:44.032243 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-4cef84ae-8e5e-45c1-bd4e-0faafe1779b5 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: 2e661217-fb1a-48ad-9f1b-47985a4074de] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:44.040469 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4cef84ae-8e5e-45c1-bd4e-0faafe1779b5 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:44.040923 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4cef84ae-8e5e-45c1-bd4e-0faafe1779b5 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:44.041640 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4cef84ae-8e5e-45c1-bd4e-0faafe1779b5 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:44.042525 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4cef84ae-8e5e-45c1-bd4e-0faafe1779b5 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:44.044212 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4cef84ae-8e5e-45c1-bd4e-0faafe1779b5 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:44.044212 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4cef84ae-8e5e-45c1-bd4e-0faafe1779b5 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:44.276987 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-6750cee5-1215-4096-881f-a2fcd9ec677b tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b82b6f568bd41fa9d6b44facb766e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ef3fc15a0147e39228729d2b5b2631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:44.293436 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-6750cee5-1215-4096-881f-a2fcd9ec677b tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] 10.222.0.84 "GET /compute/v2.1/servers/be34b51d-aa45-4540-959d-a0f61d775992" status: 200 len: 1279 microversion: 2.1 time: 0.430990 Aug 24 11:37:44.301723 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 289/546] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:37:43 2022] GET /compute/v2.1/servers/be34b51d-aa45-4540-959d-a0f61d775992 => generated 1279 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:37:44.400965 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-4cef84ae-8e5e-45c1-bd4e-0faafe1779b5 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:44.413009 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-4cef84ae-8e5e-45c1-bd4e-0faafe1779b5 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:44.414527 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-4cef84ae-8e5e-45c1-bd4e-0faafe1779b5 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:44.415755 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-4cef84ae-8e5e-45c1-bd4e-0faafe1779b5 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de" status: 200 len: 1742 microversion: 2.20 time: 0.390140 Aug 24 11:37:44.416457 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 258/547] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:37:44 2022] GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de => generated 1742 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:37:44.645859 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-aff446df-b23d-455e-869f-6c47dd5cfef7 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:44.647200 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-aff446df-b23d-455e-869f-6c47dd5cfef7 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] [instance: 15d4a46e-9504-4897-918d-39aafc20d22a] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:44.655414 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-aff446df-b23d-455e-869f-6c47dd5cfef7 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:44.656472 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-aff446df-b23d-455e-869f-6c47dd5cfef7 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:44.657150 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-aff446df-b23d-455e-869f-6c47dd5cfef7 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:44.658177 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-aff446df-b23d-455e-869f-6c47dd5cfef7 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:44.658931 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-aff446df-b23d-455e-869f-6c47dd5cfef7 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:44.661332 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-aff446df-b23d-455e-869f-6c47dd5cfef7 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:44.818267 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-33afea1f-0fb1-45ca-8516-b0f4a03c01d7 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:44.830319 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-33afea1f-0fb1-45ca-8516-b0f4a03c01d7 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: ea26410d-7ad5-47e7-8d4a-ade5827e511c] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:44.832633 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_cell0:SELECT=4 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:37:44.856375 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-33afea1f-0fb1-45ca-8516-b0f4a03c01d7 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:44.857277 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-33afea1f-0fb1-45ca-8516-b0f4a03c01d7 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:44.857953 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-33afea1f-0fb1-45ca-8516-b0f4a03c01d7 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:44.858938 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-33afea1f-0fb1-45ca-8516-b0f4a03c01d7 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:44.859811 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-33afea1f-0fb1-45ca-8516-b0f4a03c01d7 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:44.860594 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-33afea1f-0fb1-45ca-8516-b0f4a03c01d7 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:45.089555 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-aff446df-b23d-455e-869f-6c47dd5cfef7 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031939e16194f63b99e6f27f700fa8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecec6d0c155f4d658197c4779ab9ffce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:45.113803 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-aff446df-b23d-455e-869f-6c47dd5cfef7 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] 10.222.0.84 "GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a" status: 200 len: 1723 microversion: 2.1 time: 0.473845 Aug 24 11:37:45.129344 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 290/548] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:37:44 2022] GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a => generated 1723 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:37:45.320416 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-20e10221-f8a9-4e1f-a578-4f82dc2084f5 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:45.321462 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-20e10221-f8a9-4e1f-a578-4f82dc2084f5 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] [instance: be34b51d-aa45-4540-959d-a0f61d775992] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:45.335503 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-20e10221-f8a9-4e1f-a578-4f82dc2084f5 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:45.339268 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-20e10221-f8a9-4e1f-a578-4f82dc2084f5 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:45.340034 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-20e10221-f8a9-4e1f-a578-4f82dc2084f5 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:45.342347 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-20e10221-f8a9-4e1f-a578-4f82dc2084f5 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:45.343063 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-20e10221-f8a9-4e1f-a578-4f82dc2084f5 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:45.344787 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-20e10221-f8a9-4e1f-a578-4f82dc2084f5 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:45.501198 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-33afea1f-0fb1-45ca-8516-b0f4a03c01d7 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2715cf2a5129439c83a5347bb963f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4159dc366f41bc9e4057a079f6fb5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:45.515882 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-33afea1f-0fb1-45ca-8516-b0f4a03c01d7 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "GET /compute/v2.1/servers/ea26410d-7ad5-47e7-8d4a-ade5827e511c" status: 200 len: 1366 microversion: 2.1 time: 0.702848 Aug 24 11:37:45.534602 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 259/549] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:37:44 2022] GET /compute/v2.1/servers/ea26410d-7ad5-47e7-8d4a-ade5827e511c => generated 1366 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:37:45.540532 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-22efc04f-629f-4a01-ae03-3d79ff913bee tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:45.541548 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-22efc04f-629f-4a01-ae03-3d79ff913bee tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: 2e661217-fb1a-48ad-9f1b-47985a4074de] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:45.549493 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-22efc04f-629f-4a01-ae03-3d79ff913bee tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:45.550952 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-22efc04f-629f-4a01-ae03-3d79ff913bee tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:45.551621 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-22efc04f-629f-4a01-ae03-3d79ff913bee tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:45.553127 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-22efc04f-629f-4a01-ae03-3d79ff913bee tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:45.554390 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-22efc04f-629f-4a01-ae03-3d79ff913bee tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:45.555067 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-22efc04f-629f-4a01-ae03-3d79ff913bee tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:45.684330 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG dbcounter [-] [124769] Writing DB stats nova_cell0:SELECT=12 {{(pid=124769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:37:45.726952 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-20e10221-f8a9-4e1f-a578-4f82dc2084f5 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b82b6f568bd41fa9d6b44facb766e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ef3fc15a0147e39228729d2b5b2631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:45.726952 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-20e10221-f8a9-4e1f-a578-4f82dc2084f5 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] 10.222.0.84 "GET /compute/v2.1/servers/be34b51d-aa45-4540-959d-a0f61d775992" status: 200 len: 1267 microversion: 2.1 time: 0.399509 Aug 24 11:37:45.726952 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 291/550] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:37:45 2022] GET /compute/v2.1/servers/be34b51d-aa45-4540-959d-a0f61d775992 => generated 1267 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:37:46.047994 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [req-ddcb0d92-3828-4c38-a0e5-70867fc32e28 req-eff3e127-028f-44d8-b404-fa678b39449d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be34b51d-aa45-4540-959d-a0f61d775992", "tag": "bc48e073-4e3e-414c-bc63-e35b79ac195d"}]} {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:37:46.063376 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [req-ddcb0d92-3828-4c38-a0e5-70867fc32e28 req-eff3e127-028f-44d8-b404-fa678b39449d service nova] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:46.064836 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [req-ddcb0d92-3828-4c38-a0e5-70867fc32e28 req-eff3e127-028f-44d8-b404-fa678b39449d service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:46.065734 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [req-ddcb0d92-3828-4c38-a0e5-70867fc32e28 req-eff3e127-028f-44d8-b404-fa678b39449d service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:46.080225 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.compute.server_external_events [req-ddcb0d92-3828-4c38-a0e5-70867fc32e28 req-eff3e127-028f-44d8-b404-fa678b39449d service nova] Creating event network-changed:bc48e073-4e3e-414c-bc63-e35b79ac195d for instance be34b51d-aa45-4540-959d-a0f61d775992 on hv-cinder-85427 Aug 24 11:37:46.090164 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [req-ddcb0d92-3828-4c38-a0e5-70867fc32e28 req-eff3e127-028f-44d8-b404-fa678b39449d service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046955 Aug 24 11:37:46.092122 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 292/551] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Aug 24 11:37:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:37:46.092482 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-22efc04f-629f-4a01-ae03-3d79ff913bee tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:46.133495 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-22efc04f-629f-4a01-ae03-3d79ff913bee tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:46.133495 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-22efc04f-629f-4a01-ae03-3d79ff913bee tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:46.133495 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-22efc04f-629f-4a01-ae03-3d79ff913bee tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de" status: 200 len: 1742 microversion: 2.20 time: 0.584731 Aug 24 11:37:46.133811 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 260/552] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:37:45 2022] GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de => generated 1742 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:37:46.146508 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-51d0b260-b219-4284-bae6-607ad9be47e7 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:46.147511 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-51d0b260-b219-4284-bae6-607ad9be47e7 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] [instance: 15d4a46e-9504-4897-918d-39aafc20d22a] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:46.173835 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-51d0b260-b219-4284-bae6-607ad9be47e7 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:46.174349 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-51d0b260-b219-4284-bae6-607ad9be47e7 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:46.180742 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-51d0b260-b219-4284-bae6-607ad9be47e7 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:46.181888 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-51d0b260-b219-4284-bae6-607ad9be47e7 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:46.182867 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-51d0b260-b219-4284-bae6-607ad9be47e7 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:46.186245 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-51d0b260-b219-4284-bae6-607ad9be47e7 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:46.478059 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-51d0b260-b219-4284-bae6-607ad9be47e7 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031939e16194f63b99e6f27f700fa8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecec6d0c155f4d658197c4779ab9ffce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:46.493209 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-51d0b260-b219-4284-bae6-607ad9be47e7 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] 10.222.0.84 "GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a" status: 200 len: 1723 microversion: 2.1 time: 0.352639 Aug 24 11:37:46.494635 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 293/553] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:37:46 2022] GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a => generated 1723 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:37:46.543967 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-60a3d11c-b844-49b2-8d97-abab7b062e51 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:46.545726 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-60a3d11c-b844-49b2-8d97-abab7b062e51 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: ea26410d-7ad5-47e7-8d4a-ade5827e511c] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:46.548462 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_cell0:SELECT=14 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:37:46.558755 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-60a3d11c-b844-49b2-8d97-abab7b062e51 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:46.559626 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-60a3d11c-b844-49b2-8d97-abab7b062e51 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:46.560489 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-60a3d11c-b844-49b2-8d97-abab7b062e51 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:46.562272 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-60a3d11c-b844-49b2-8d97-abab7b062e51 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:46.562943 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-60a3d11c-b844-49b2-8d97-abab7b062e51 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:46.563656 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-60a3d11c-b844-49b2-8d97-abab7b062e51 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:46.749503 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-10ffa46d-440a-45ff-af6e-1a2b5599e4ff tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:46.750231 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-10ffa46d-440a-45ff-af6e-1a2b5599e4ff tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] [instance: be34b51d-aa45-4540-959d-a0f61d775992] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:46.759985 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-10ffa46d-440a-45ff-af6e-1a2b5599e4ff tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:46.760668 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-10ffa46d-440a-45ff-af6e-1a2b5599e4ff tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:46.761597 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-10ffa46d-440a-45ff-af6e-1a2b5599e4ff tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:46.766228 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-10ffa46d-440a-45ff-af6e-1a2b5599e4ff tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:46.766228 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-10ffa46d-440a-45ff-af6e-1a2b5599e4ff tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:46.766228 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-10ffa46d-440a-45ff-af6e-1a2b5599e4ff tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:46.812316 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-60a3d11c-b844-49b2-8d97-abab7b062e51 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2715cf2a5129439c83a5347bb963f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4159dc366f41bc9e4057a079f6fb5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:46.833704 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-60a3d11c-b844-49b2-8d97-abab7b062e51 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "GET /compute/v2.1/servers/ea26410d-7ad5-47e7-8d4a-ade5827e511c" status: 200 len: 1366 microversion: 2.1 time: 0.295949 Aug 24 11:37:46.834767 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 261/554] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:37:46 2022] GET /compute/v2.1/servers/ea26410d-7ad5-47e7-8d4a-ade5827e511c => generated 1366 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:37:46.984434 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-10ffa46d-440a-45ff-af6e-1a2b5599e4ff tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b82b6f568bd41fa9d6b44facb766e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ef3fc15a0147e39228729d2b5b2631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:46.984913 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-10ffa46d-440a-45ff-af6e-1a2b5599e4ff tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] 10.222.0.84 "GET /compute/v2.1/servers/be34b51d-aa45-4540-959d-a0f61d775992" status: 200 len: 1267 microversion: 2.1 time: 0.248482 Aug 24 11:37:46.988846 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 294/555] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:37:46 2022] GET /compute/v2.1/servers/be34b51d-aa45-4540-959d-a0f61d775992 => generated 1267 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:37:47.155076 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-56a29907-c28a-448e-b1d7-3268a1e92fc6 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:47.156447 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-56a29907-c28a-448e-b1d7-3268a1e92fc6 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: 2e661217-fb1a-48ad-9f1b-47985a4074de] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:47.165276 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-56a29907-c28a-448e-b1d7-3268a1e92fc6 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:47.170939 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-56a29907-c28a-448e-b1d7-3268a1e92fc6 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:47.172238 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-56a29907-c28a-448e-b1d7-3268a1e92fc6 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:47.173842 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-56a29907-c28a-448e-b1d7-3268a1e92fc6 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:47.174688 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-56a29907-c28a-448e-b1d7-3268a1e92fc6 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:47.176266 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-56a29907-c28a-448e-b1d7-3268a1e92fc6 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:47.390360 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-56a29907-c28a-448e-b1d7-3268a1e92fc6 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:47.400213 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-56a29907-c28a-448e-b1d7-3268a1e92fc6 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:47.404728 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-56a29907-c28a-448e-b1d7-3268a1e92fc6 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:47.404728 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-56a29907-c28a-448e-b1d7-3268a1e92fc6 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de" status: 200 len: 1742 microversion: 2.20 time: 0.252586 Aug 24 11:37:47.404728 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 262/556] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:37:47 2022] GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de => generated 1742 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 11:37:47.519041 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-289b4394-b542-4ef4-8f5e-97af4de80105 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:47.520712 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-289b4394-b542-4ef4-8f5e-97af4de80105 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] [instance: 15d4a46e-9504-4897-918d-39aafc20d22a] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:47.530924 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-289b4394-b542-4ef4-8f5e-97af4de80105 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:47.558620 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-289b4394-b542-4ef4-8f5e-97af4de80105 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:47.558620 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-289b4394-b542-4ef4-8f5e-97af4de80105 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:47.558620 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-289b4394-b542-4ef4-8f5e-97af4de80105 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:47.558620 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-289b4394-b542-4ef4-8f5e-97af4de80105 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:47.560565 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-289b4394-b542-4ef4-8f5e-97af4de80105 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:47.786795 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-289b4394-b542-4ef4-8f5e-97af4de80105 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031939e16194f63b99e6f27f700fa8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecec6d0c155f4d658197c4779ab9ffce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:47.796915 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-289b4394-b542-4ef4-8f5e-97af4de80105 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] 10.222.0.84 "GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a" status: 200 len: 1723 microversion: 2.1 time: 0.282608 Aug 24 11:37:47.797802 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 295/557] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:37:47 2022] GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a => generated 1723 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:37:47.858426 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-17742e62-f04d-4c6b-a131-cac6fe471cfe tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:47.859081 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-17742e62-f04d-4c6b-a131-cac6fe471cfe tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: ea26410d-7ad5-47e7-8d4a-ade5827e511c] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:47.866631 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-17742e62-f04d-4c6b-a131-cac6fe471cfe tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:47.867135 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-17742e62-f04d-4c6b-a131-cac6fe471cfe tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:47.867585 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-17742e62-f04d-4c6b-a131-cac6fe471cfe tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:47.868295 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-17742e62-f04d-4c6b-a131-cac6fe471cfe tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:47.868756 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-17742e62-f04d-4c6b-a131-cac6fe471cfe tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:47.869230 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-17742e62-f04d-4c6b-a131-cac6fe471cfe tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:47.893155 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:37:48.022789 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-a13a7f5d-45d8-4e33-b0e5-6cefed4dc1b2 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:48.023879 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-a13a7f5d-45d8-4e33-b0e5-6cefed4dc1b2 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] [instance: be34b51d-aa45-4540-959d-a0f61d775992] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:48.036834 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-a13a7f5d-45d8-4e33-b0e5-6cefed4dc1b2 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:48.038251 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-a13a7f5d-45d8-4e33-b0e5-6cefed4dc1b2 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:48.039412 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-a13a7f5d-45d8-4e33-b0e5-6cefed4dc1b2 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:48.041188 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-a13a7f5d-45d8-4e33-b0e5-6cefed4dc1b2 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:48.041999 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-a13a7f5d-45d8-4e33-b0e5-6cefed4dc1b2 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:48.042504 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-a13a7f5d-45d8-4e33-b0e5-6cefed4dc1b2 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:48.099993 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-17742e62-f04d-4c6b-a131-cac6fe471cfe tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2715cf2a5129439c83a5347bb963f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4159dc366f41bc9e4057a079f6fb5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:48.113175 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-17742e62-f04d-4c6b-a131-cac6fe471cfe tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "GET /compute/v2.1/servers/ea26410d-7ad5-47e7-8d4a-ade5827e511c" status: 200 len: 1366 microversion: 2.1 time: 0.258401 Aug 24 11:37:48.115909 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 263/558] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:37:47 2022] GET /compute/v2.1/servers/ea26410d-7ad5-47e7-8d4a-ade5827e511c => generated 1366 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:37:48.285012 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-a13a7f5d-45d8-4e33-b0e5-6cefed4dc1b2 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b82b6f568bd41fa9d6b44facb766e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ef3fc15a0147e39228729d2b5b2631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:48.294340 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-a13a7f5d-45d8-4e33-b0e5-6cefed4dc1b2 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] 10.222.0.84 "GET /compute/v2.1/servers/be34b51d-aa45-4540-959d-a0f61d775992" status: 200 len: 1267 microversion: 2.1 time: 0.282697 Aug 24 11:37:48.295040 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 296/559] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:37:48 2022] GET /compute/v2.1/servers/be34b51d-aa45-4540-959d-a0f61d775992 => generated 1267 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:37:48.430691 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-d1bd476f-8a19-4c43-9294-1bd1ea84708c tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:48.431511 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-d1bd476f-8a19-4c43-9294-1bd1ea84708c tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: 2e661217-fb1a-48ad-9f1b-47985a4074de] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:48.452563 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d1bd476f-8a19-4c43-9294-1bd1ea84708c tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:48.452563 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d1bd476f-8a19-4c43-9294-1bd1ea84708c tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:48.452563 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d1bd476f-8a19-4c43-9294-1bd1ea84708c tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:48.452563 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d1bd476f-8a19-4c43-9294-1bd1ea84708c tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:48.453033 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d1bd476f-8a19-4c43-9294-1bd1ea84708c tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:48.453033 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d1bd476f-8a19-4c43-9294-1bd1ea84708c tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:48.642079 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-d1bd476f-8a19-4c43-9294-1bd1ea84708c tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:48.663689 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-d1bd476f-8a19-4c43-9294-1bd1ea84708c tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:48.665997 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-d1bd476f-8a19-4c43-9294-1bd1ea84708c tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:48.667463 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-d1bd476f-8a19-4c43-9294-1bd1ea84708c tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de" status: 200 len: 1742 microversion: 2.20 time: 0.242863 Aug 24 11:37:48.668606 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 264/560] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:37:48 2022] GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de => generated 1742 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:37:48.841322 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-3ad9d95a-19b4-4da2-8ef7-62eca38a5bf4 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:48.841322 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-3ad9d95a-19b4-4da2-8ef7-62eca38a5bf4 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] [instance: 15d4a46e-9504-4897-918d-39aafc20d22a] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:48.841322 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-3ad9d95a-19b4-4da2-8ef7-62eca38a5bf4 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:48.841322 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-3ad9d95a-19b4-4da2-8ef7-62eca38a5bf4 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:48.842814 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-3ad9d95a-19b4-4da2-8ef7-62eca38a5bf4 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:48.842814 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-3ad9d95a-19b4-4da2-8ef7-62eca38a5bf4 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:48.842814 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-3ad9d95a-19b4-4da2-8ef7-62eca38a5bf4 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:48.842814 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-3ad9d95a-19b4-4da2-8ef7-62eca38a5bf4 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:48.992137 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-3ad9d95a-19b4-4da2-8ef7-62eca38a5bf4 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031939e16194f63b99e6f27f700fa8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecec6d0c155f4d658197c4779ab9ffce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:49.001470 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-3ad9d95a-19b4-4da2-8ef7-62eca38a5bf4 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] 10.222.0.84 "GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a" status: 200 len: 1723 microversion: 2.1 time: 0.180706 Aug 24 11:37:49.002038 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 297/561] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:37:48 2022] GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a => generated 1723 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:37:49.154246 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-c86ac02c-a5e7-4515-8017-441cb108b9db tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:49.154839 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-c86ac02c-a5e7-4515-8017-441cb108b9db tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: ea26410d-7ad5-47e7-8d4a-ade5827e511c] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:49.161799 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c86ac02c-a5e7-4515-8017-441cb108b9db tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:49.162279 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c86ac02c-a5e7-4515-8017-441cb108b9db tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:49.162711 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c86ac02c-a5e7-4515-8017-441cb108b9db tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:49.163397 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c86ac02c-a5e7-4515-8017-441cb108b9db tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:49.163853 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c86ac02c-a5e7-4515-8017-441cb108b9db tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:49.164271 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c86ac02c-a5e7-4515-8017-441cb108b9db tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:49.304779 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-c86ac02c-a5e7-4515-8017-441cb108b9db tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2715cf2a5129439c83a5347bb963f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4159dc366f41bc9e4057a079f6fb5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:49.312399 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-c86ac02c-a5e7-4515-8017-441cb108b9db tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "GET /compute/v2.1/servers/ea26410d-7ad5-47e7-8d4a-ade5827e511c" status: 200 len: 1366 microversion: 2.1 time: 0.168660 Aug 24 11:37:49.313239 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 265/562] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:37:49 2022] GET /compute/v2.1/servers/ea26410d-7ad5-47e7-8d4a-ade5827e511c => generated 1366 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:37:49.319952 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-ef88d27c-9d7c-43ee-9824-e2758cee7b30 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:49.320746 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-ef88d27c-9d7c-43ee-9824-e2758cee7b30 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] [instance: be34b51d-aa45-4540-959d-a0f61d775992] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:49.326754 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-ef88d27c-9d7c-43ee-9824-e2758cee7b30 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:49.327227 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-ef88d27c-9d7c-43ee-9824-e2758cee7b30 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:49.327656 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-ef88d27c-9d7c-43ee-9824-e2758cee7b30 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:49.328418 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-ef88d27c-9d7c-43ee-9824-e2758cee7b30 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:49.328893 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-ef88d27c-9d7c-43ee-9824-e2758cee7b30 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:49.329309 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-ef88d27c-9d7c-43ee-9824-e2758cee7b30 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:49.472374 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-ef88d27c-9d7c-43ee-9824-e2758cee7b30 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b82b6f568bd41fa9d6b44facb766e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ef3fc15a0147e39228729d2b5b2631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:49.480146 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-ef88d27c-9d7c-43ee-9824-e2758cee7b30 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] 10.222.0.84 "GET /compute/v2.1/servers/be34b51d-aa45-4540-959d-a0f61d775992" status: 200 len: 1267 microversion: 2.1 time: 0.165615 Aug 24 11:37:49.480719 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 298/563] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:37:49 2022] GET /compute/v2.1/servers/be34b51d-aa45-4540-959d-a0f61d775992 => generated 1267 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:37:49.693608 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-218a314a-447b-419c-8317-a5e636d2b826 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:49.694211 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-218a314a-447b-419c-8317-a5e636d2b826 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: 2e661217-fb1a-48ad-9f1b-47985a4074de] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:49.700521 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-218a314a-447b-419c-8317-a5e636d2b826 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:49.701360 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-218a314a-447b-419c-8317-a5e636d2b826 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:49.701888 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-218a314a-447b-419c-8317-a5e636d2b826 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:49.702994 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-218a314a-447b-419c-8317-a5e636d2b826 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:49.703807 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-218a314a-447b-419c-8317-a5e636d2b826 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:49.704733 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-218a314a-447b-419c-8317-a5e636d2b826 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:49.876051 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-218a314a-447b-419c-8317-a5e636d2b826 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:49.892550 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-218a314a-447b-419c-8317-a5e636d2b826 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:49.895255 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-218a314a-447b-419c-8317-a5e636d2b826 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:49.896499 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-218a314a-447b-419c-8317-a5e636d2b826 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de" status: 200 len: 1742 microversion: 2.20 time: 0.207004 Aug 24 11:37:49.897248 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 266/564] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:37:49 2022] GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de => generated 1742 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 11:37:50.029180 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-cef3aa37-c51d-43e7-8f39-9df3a573df92 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:50.037489 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-cef3aa37-c51d-43e7-8f39-9df3a573df92 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] [instance: 15d4a46e-9504-4897-918d-39aafc20d22a] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:50.087664 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-cef3aa37-c51d-43e7-8f39-9df3a573df92 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:50.087664 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-cef3aa37-c51d-43e7-8f39-9df3a573df92 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:50.087664 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-cef3aa37-c51d-43e7-8f39-9df3a573df92 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:50.087664 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-cef3aa37-c51d-43e7-8f39-9df3a573df92 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:50.088157 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-cef3aa37-c51d-43e7-8f39-9df3a573df92 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:50.089359 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-cef3aa37-c51d-43e7-8f39-9df3a573df92 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:50.338165 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-bc3bfe51-035c-48e7-94c9-56987d073efe tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:50.339131 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-bc3bfe51-035c-48e7-94c9-56987d073efe tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: ea26410d-7ad5-47e7-8d4a-ade5827e511c] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:50.350025 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-bc3bfe51-035c-48e7-94c9-56987d073efe tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:50.350877 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-bc3bfe51-035c-48e7-94c9-56987d073efe tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:50.352318 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-bc3bfe51-035c-48e7-94c9-56987d073efe tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:50.353047 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-bc3bfe51-035c-48e7-94c9-56987d073efe tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:50.353154 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-bc3bfe51-035c-48e7-94c9-56987d073efe tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:50.353850 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-bc3bfe51-035c-48e7-94c9-56987d073efe tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:50.378824 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-cef3aa37-c51d-43e7-8f39-9df3a573df92 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031939e16194f63b99e6f27f700fa8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecec6d0c155f4d658197c4779ab9ffce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:50.390449 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-cef3aa37-c51d-43e7-8f39-9df3a573df92 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] 10.222.0.84 "GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a" status: 200 len: 1723 microversion: 2.1 time: 0.368750 Aug 24 11:37:50.391272 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 299/565] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:37:50 2022] GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a => generated 1723 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:37:50.506382 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-8257b860-347a-4dfa-8d5b-f6552a22e717 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:50.507521 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-8257b860-347a-4dfa-8d5b-f6552a22e717 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] [instance: be34b51d-aa45-4540-959d-a0f61d775992] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:50.516465 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-8257b860-347a-4dfa-8d5b-f6552a22e717 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:50.517598 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-8257b860-347a-4dfa-8d5b-f6552a22e717 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:50.519028 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-8257b860-347a-4dfa-8d5b-f6552a22e717 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:50.520025 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-8257b860-347a-4dfa-8d5b-f6552a22e717 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:50.520696 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-8257b860-347a-4dfa-8d5b-f6552a22e717 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:50.521614 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-8257b860-347a-4dfa-8d5b-f6552a22e717 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:50.652509 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-bc3bfe51-035c-48e7-94c9-56987d073efe tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2715cf2a5129439c83a5347bb963f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4159dc366f41bc9e4057a079f6fb5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:50.668781 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-bc3bfe51-035c-48e7-94c9-56987d073efe tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "GET /compute/v2.1/servers/ea26410d-7ad5-47e7-8d4a-ade5827e511c" status: 200 len: 1366 microversion: 2.1 time: 0.337456 Aug 24 11:37:50.674007 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 267/566] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:37:50 2022] GET /compute/v2.1/servers/ea26410d-7ad5-47e7-8d4a-ade5827e511c => generated 1366 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:37:50.755035 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-8257b860-347a-4dfa-8d5b-f6552a22e717 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b82b6f568bd41fa9d6b44facb766e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ef3fc15a0147e39228729d2b5b2631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:50.766680 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-8257b860-347a-4dfa-8d5b-f6552a22e717 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] 10.222.0.84 "GET /compute/v2.1/servers/be34b51d-aa45-4540-959d-a0f61d775992" status: 200 len: 1267 microversion: 2.1 time: 0.267146 Aug 24 11:37:50.767823 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 300/567] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:37:50 2022] GET /compute/v2.1/servers/be34b51d-aa45-4540-959d-a0f61d775992 => generated 1267 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:37:50.958767 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-5738621c-fc3d-40ad-af80-c869ff369d64 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:50.959536 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-5738621c-fc3d-40ad-af80-c869ff369d64 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: 2e661217-fb1a-48ad-9f1b-47985a4074de] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:50.970937 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5738621c-fc3d-40ad-af80-c869ff369d64 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:50.978411 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5738621c-fc3d-40ad-af80-c869ff369d64 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:50.981533 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5738621c-fc3d-40ad-af80-c869ff369d64 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:50.982505 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5738621c-fc3d-40ad-af80-c869ff369d64 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:50.983166 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5738621c-fc3d-40ad-af80-c869ff369d64 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:50.983728 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5738621c-fc3d-40ad-af80-c869ff369d64 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:51.157953 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-5738621c-fc3d-40ad-af80-c869ff369d64 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:51.166829 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-5738621c-fc3d-40ad-af80-c869ff369d64 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:51.168430 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-5738621c-fc3d-40ad-af80-c869ff369d64 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:51.169618 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-5738621c-fc3d-40ad-af80-c869ff369d64 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de" status: 200 len: 1742 microversion: 2.20 time: 0.240907 Aug 24 11:37:51.170367 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 268/568] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:37:50 2022] GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de => generated 1742 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:37:51.418333 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-023b5558-56ea-4df6-9ebb-eda6681e0b24 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:51.419478 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-023b5558-56ea-4df6-9ebb-eda6681e0b24 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] [instance: 15d4a46e-9504-4897-918d-39aafc20d22a] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:51.430888 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-023b5558-56ea-4df6-9ebb-eda6681e0b24 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:51.449237 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-023b5558-56ea-4df6-9ebb-eda6681e0b24 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:51.449237 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-023b5558-56ea-4df6-9ebb-eda6681e0b24 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:51.449237 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-023b5558-56ea-4df6-9ebb-eda6681e0b24 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:51.449237 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-023b5558-56ea-4df6-9ebb-eda6681e0b24 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:51.449651 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-023b5558-56ea-4df6-9ebb-eda6681e0b24 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:51.591744 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-023b5558-56ea-4df6-9ebb-eda6681e0b24 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031939e16194f63b99e6f27f700fa8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecec6d0c155f4d658197c4779ab9ffce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:51.601087 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-023b5558-56ea-4df6-9ebb-eda6681e0b24 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] 10.222.0.84 "GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a" status: 200 len: 1723 microversion: 2.1 time: 0.190023 Aug 24 11:37:51.602620 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 301/569] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:37:51 2022] GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a => generated 1723 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:37:51.698664 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-aa307fc3-27d2-44a2-9c88-32ccb2aa15da tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:51.699279 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-aa307fc3-27d2-44a2-9c88-32ccb2aa15da tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: ea26410d-7ad5-47e7-8d4a-ade5827e511c] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:51.705761 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-aa307fc3-27d2-44a2-9c88-32ccb2aa15da tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:51.706785 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-aa307fc3-27d2-44a2-9c88-32ccb2aa15da tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:51.707884 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-aa307fc3-27d2-44a2-9c88-32ccb2aa15da tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:51.708573 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-aa307fc3-27d2-44a2-9c88-32ccb2aa15da tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:51.709055 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-aa307fc3-27d2-44a2-9c88-32ccb2aa15da tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:51.709475 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-aa307fc3-27d2-44a2-9c88-32ccb2aa15da tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:51.791218 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-306a0f0e-58fd-498b-b3f7-25eae5a973aa tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:51.791592 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-306a0f0e-58fd-498b-b3f7-25eae5a973aa tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] [instance: be34b51d-aa45-4540-959d-a0f61d775992] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:51.798137 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-306a0f0e-58fd-498b-b3f7-25eae5a973aa tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:51.798826 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-306a0f0e-58fd-498b-b3f7-25eae5a973aa tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:51.799278 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-306a0f0e-58fd-498b-b3f7-25eae5a973aa tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:51.800405 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-306a0f0e-58fd-498b-b3f7-25eae5a973aa tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:51.800560 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-306a0f0e-58fd-498b-b3f7-25eae5a973aa tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:51.801323 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-306a0f0e-58fd-498b-b3f7-25eae5a973aa tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:51.901465 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-aa307fc3-27d2-44a2-9c88-32ccb2aa15da tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2715cf2a5129439c83a5347bb963f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4159dc366f41bc9e4057a079f6fb5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:51.914506 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-aa307fc3-27d2-44a2-9c88-32ccb2aa15da tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "GET /compute/v2.1/servers/ea26410d-7ad5-47e7-8d4a-ade5827e511c" status: 200 len: 1366 microversion: 2.1 time: 0.219837 Aug 24 11:37:51.915164 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 269/570] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:37:51 2022] GET /compute/v2.1/servers/ea26410d-7ad5-47e7-8d4a-ade5827e511c => generated 1366 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:37:51.969789 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-306a0f0e-58fd-498b-b3f7-25eae5a973aa tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b82b6f568bd41fa9d6b44facb766e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ef3fc15a0147e39228729d2b5b2631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:51.989796 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-306a0f0e-58fd-498b-b3f7-25eae5a973aa tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] 10.222.0.84 "GET /compute/v2.1/servers/be34b51d-aa45-4540-959d-a0f61d775992" status: 200 len: 1267 microversion: 2.1 time: 0.203822 Aug 24 11:37:51.990400 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 302/571] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:37:51 2022] GET /compute/v2.1/servers/be34b51d-aa45-4540-959d-a0f61d775992 => generated 1267 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:37:52.195832 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-adf4ae76-f543-4db9-8ec0-f62c76b471c8 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:52.196349 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-adf4ae76-f543-4db9-8ec0-f62c76b471c8 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: 2e661217-fb1a-48ad-9f1b-47985a4074de] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:52.203115 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-adf4ae76-f543-4db9-8ec0-f62c76b471c8 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:52.203671 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-adf4ae76-f543-4db9-8ec0-f62c76b471c8 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:52.204030 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-adf4ae76-f543-4db9-8ec0-f62c76b471c8 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:52.204716 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-adf4ae76-f543-4db9-8ec0-f62c76b471c8 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:52.205189 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-adf4ae76-f543-4db9-8ec0-f62c76b471c8 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:52.205689 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-adf4ae76-f543-4db9-8ec0-f62c76b471c8 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:52.365673 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-adf4ae76-f543-4db9-8ec0-f62c76b471c8 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:52.384186 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-adf4ae76-f543-4db9-8ec0-f62c76b471c8 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:52.385864 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-adf4ae76-f543-4db9-8ec0-f62c76b471c8 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:52.387418 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-adf4ae76-f543-4db9-8ec0-f62c76b471c8 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de" status: 200 len: 1742 microversion: 2.20 time: 0.195337 Aug 24 11:37:52.405766 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 270/572] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:37:52 2022] GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de => generated 1742 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:37:52.623464 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-c4b2ff67-2b30-4e34-b8fc-272177701511 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:52.624076 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-c4b2ff67-2b30-4e34-b8fc-272177701511 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] [instance: 15d4a46e-9504-4897-918d-39aafc20d22a] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:52.631992 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-c4b2ff67-2b30-4e34-b8fc-272177701511 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:52.632507 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-c4b2ff67-2b30-4e34-b8fc-272177701511 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:52.632974 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-c4b2ff67-2b30-4e34-b8fc-272177701511 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:52.633664 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-c4b2ff67-2b30-4e34-b8fc-272177701511 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:52.634112 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-c4b2ff67-2b30-4e34-b8fc-272177701511 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:52.634532 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-c4b2ff67-2b30-4e34-b8fc-272177701511 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:52.796175 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-c4b2ff67-2b30-4e34-b8fc-272177701511 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031939e16194f63b99e6f27f700fa8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecec6d0c155f4d658197c4779ab9ffce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:52.798545 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG dbcounter [-] [124769] Writing DB stats nova_cell1:SELECT=100 {{(pid=124769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:37:52.816911 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-c4b2ff67-2b30-4e34-b8fc-272177701511 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] 10.222.0.84 "GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a" status: 200 len: 1723 microversion: 2.1 time: 0.186647 Aug 24 11:37:52.816911 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 303/573] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:37:52 2022] GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a => generated 1723 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:37:52.948554 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-c708b5d5-5564-48be-8f4b-1b10274fdbd1 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:52.950148 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-c708b5d5-5564-48be-8f4b-1b10274fdbd1 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: ea26410d-7ad5-47e7-8d4a-ade5827e511c] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:52.962974 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c708b5d5-5564-48be-8f4b-1b10274fdbd1 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:52.963796 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c708b5d5-5564-48be-8f4b-1b10274fdbd1 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:52.964485 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c708b5d5-5564-48be-8f4b-1b10274fdbd1 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:52.966215 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c708b5d5-5564-48be-8f4b-1b10274fdbd1 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:52.966626 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c708b5d5-5564-48be-8f4b-1b10274fdbd1 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:52.967412 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c708b5d5-5564-48be-8f4b-1b10274fdbd1 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:53.035642 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-4831205a-7340-4430-9a78-6c48a0dbaa1c tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:53.035642 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-4831205a-7340-4430-9a78-6c48a0dbaa1c tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] [instance: be34b51d-aa45-4540-959d-a0f61d775992] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:53.047314 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-4831205a-7340-4430-9a78-6c48a0dbaa1c tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:53.049432 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-4831205a-7340-4430-9a78-6c48a0dbaa1c tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:53.049432 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-4831205a-7340-4430-9a78-6c48a0dbaa1c tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:53.050365 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-4831205a-7340-4430-9a78-6c48a0dbaa1c tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:53.051056 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-4831205a-7340-4430-9a78-6c48a0dbaa1c tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:53.051705 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-4831205a-7340-4430-9a78-6c48a0dbaa1c tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:53.303778 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-c708b5d5-5564-48be-8f4b-1b10274fdbd1 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2715cf2a5129439c83a5347bb963f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4159dc366f41bc9e4057a079f6fb5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:53.320449 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-c708b5d5-5564-48be-8f4b-1b10274fdbd1 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "GET /compute/v2.1/servers/ea26410d-7ad5-47e7-8d4a-ade5827e511c" status: 200 len: 1366 microversion: 2.1 time: 0.385136 Aug 24 11:37:53.321822 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 271/574] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:37:52 2022] GET /compute/v2.1/servers/ea26410d-7ad5-47e7-8d4a-ade5827e511c => generated 1366 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:37:53.413914 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-fca7cc72-ae94-4023-a548-d1c860518ce7 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:53.414515 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-fca7cc72-ae94-4023-a548-d1c860518ce7 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: 2e661217-fb1a-48ad-9f1b-47985a4074de] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:53.420738 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-fca7cc72-ae94-4023-a548-d1c860518ce7 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:53.421258 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-fca7cc72-ae94-4023-a548-d1c860518ce7 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:53.421825 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-fca7cc72-ae94-4023-a548-d1c860518ce7 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:53.422366 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-fca7cc72-ae94-4023-a548-d1c860518ce7 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:53.422813 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-fca7cc72-ae94-4023-a548-d1c860518ce7 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:53.423230 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-fca7cc72-ae94-4023-a548-d1c860518ce7 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:53.430477 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-4831205a-7340-4430-9a78-6c48a0dbaa1c tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b82b6f568bd41fa9d6b44facb766e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ef3fc15a0147e39228729d2b5b2631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:53.444984 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-4831205a-7340-4430-9a78-6c48a0dbaa1c tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] 10.222.0.84 "GET /compute/v2.1/servers/be34b51d-aa45-4540-959d-a0f61d775992" status: 200 len: 1267 microversion: 2.1 time: 0.431700 Aug 24 11:37:53.445625 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 304/575] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:37:53 2022] GET /compute/v2.1/servers/be34b51d-aa45-4540-959d-a0f61d775992 => generated 1267 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:37:53.583432 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-fca7cc72-ae94-4023-a548-d1c860518ce7 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:53.595249 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-fca7cc72-ae94-4023-a548-d1c860518ce7 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:53.597815 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-fca7cc72-ae94-4023-a548-d1c860518ce7 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:53.599037 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-fca7cc72-ae94-4023-a548-d1c860518ce7 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de" status: 200 len: 1742 microversion: 2.20 time: 0.189064 Aug 24 11:37:53.599891 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 272/576] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:37:53 2022] GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de => generated 1742 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:37:53.830049 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-0fc64f00-e184-4d4a-b010-7d0c6f348ccd tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:53.830634 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-0fc64f00-e184-4d4a-b010-7d0c6f348ccd tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] [instance: 15d4a46e-9504-4897-918d-39aafc20d22a] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:53.833105 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG dbcounter [-] [124769] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=124769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:37:53.837952 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-0fc64f00-e184-4d4a-b010-7d0c6f348ccd tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:53.838443 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-0fc64f00-e184-4d4a-b010-7d0c6f348ccd tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:53.838888 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-0fc64f00-e184-4d4a-b010-7d0c6f348ccd tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:53.839569 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-0fc64f00-e184-4d4a-b010-7d0c6f348ccd tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:53.840021 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-0fc64f00-e184-4d4a-b010-7d0c6f348ccd tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:53.840447 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-0fc64f00-e184-4d4a-b010-7d0c6f348ccd tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:54.176057 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-0fc64f00-e184-4d4a-b010-7d0c6f348ccd tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031939e16194f63b99e6f27f700fa8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecec6d0c155f4d658197c4779ab9ffce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:54.188000 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-0fc64f00-e184-4d4a-b010-7d0c6f348ccd tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] 10.222.0.84 "GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a" status: 200 len: 1723 microversion: 2.1 time: 0.362171 Aug 24 11:37:54.208720 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 305/577] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:37:53 2022] GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a => generated 1723 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:37:54.365940 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-982fb043-21e8-4e18-94bb-c04c6cb40a25 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:54.371649 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-982fb043-21e8-4e18-94bb-c04c6cb40a25 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: ea26410d-7ad5-47e7-8d4a-ade5827e511c] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:54.424034 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-982fb043-21e8-4e18-94bb-c04c6cb40a25 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:54.424034 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-982fb043-21e8-4e18-94bb-c04c6cb40a25 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:54.424986 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-982fb043-21e8-4e18-94bb-c04c6cb40a25 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:54.427116 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-982fb043-21e8-4e18-94bb-c04c6cb40a25 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:54.428176 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-982fb043-21e8-4e18-94bb-c04c6cb40a25 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:54.429545 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-982fb043-21e8-4e18-94bb-c04c6cb40a25 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:54.467152 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-c0378229-49e9-4c66-9c9d-2a3f5072c15f tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:54.469870 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-c0378229-49e9-4c66-9c9d-2a3f5072c15f tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] [instance: be34b51d-aa45-4540-959d-a0f61d775992] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:54.509511 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-c0378229-49e9-4c66-9c9d-2a3f5072c15f tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:54.510023 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-c0378229-49e9-4c66-9c9d-2a3f5072c15f tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:54.510636 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-c0378229-49e9-4c66-9c9d-2a3f5072c15f tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:54.511394 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-c0378229-49e9-4c66-9c9d-2a3f5072c15f tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:54.511828 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-c0378229-49e9-4c66-9c9d-2a3f5072c15f tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:54.512437 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-c0378229-49e9-4c66-9c9d-2a3f5072c15f tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:54.939642 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-982fb043-21e8-4e18-94bb-c04c6cb40a25 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2715cf2a5129439c83a5347bb963f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4159dc366f41bc9e4057a079f6fb5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:54.939642 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-982fb043-21e8-4e18-94bb-c04c6cb40a25 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "GET /compute/v2.1/servers/ea26410d-7ad5-47e7-8d4a-ade5827e511c" status: 200 len: 1366 microversion: 2.1 time: 0.560143 Aug 24 11:37:54.939642 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 273/578] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:37:54 2022] GET /compute/v2.1/servers/ea26410d-7ad5-47e7-8d4a-ade5827e511c => generated 1366 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:37:54.939642 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-36bd8079-01ec-47a9-a439-5a4cad2d0870 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:54.940838 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-36bd8079-01ec-47a9-a439-5a4cad2d0870 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: 2e661217-fb1a-48ad-9f1b-47985a4074de] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:54.940838 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-36bd8079-01ec-47a9-a439-5a4cad2d0870 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:54.941545 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-36bd8079-01ec-47a9-a439-5a4cad2d0870 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:54.941781 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-36bd8079-01ec-47a9-a439-5a4cad2d0870 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:54.942472 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-36bd8079-01ec-47a9-a439-5a4cad2d0870 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:54.943054 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-36bd8079-01ec-47a9-a439-5a4cad2d0870 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:54.943547 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-36bd8079-01ec-47a9-a439-5a4cad2d0870 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:55.053652 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-c0378229-49e9-4c66-9c9d-2a3f5072c15f tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b82b6f568bd41fa9d6b44facb766e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ef3fc15a0147e39228729d2b5b2631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:55.063748 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-c0378229-49e9-4c66-9c9d-2a3f5072c15f tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] 10.222.0.84 "GET /compute/v2.1/servers/be34b51d-aa45-4540-959d-a0f61d775992" status: 200 len: 1267 microversion: 2.1 time: 0.600978 Aug 24 11:37:55.064415 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 306/579] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:37:54 2022] GET /compute/v2.1/servers/be34b51d-aa45-4540-959d-a0f61d775992 => generated 1267 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:37:55.204421 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-36bd8079-01ec-47a9-a439-5a4cad2d0870 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:55.214930 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-09b69d75-e3d7-4acf-9440-469baf2ff587 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:55.215822 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-09b69d75-e3d7-4acf-9440-469baf2ff587 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] [instance: 15d4a46e-9504-4897-918d-39aafc20d22a] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:55.219263 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-36bd8079-01ec-47a9-a439-5a4cad2d0870 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:55.220775 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-36bd8079-01ec-47a9-a439-5a4cad2d0870 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:55.222296 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-36bd8079-01ec-47a9-a439-5a4cad2d0870 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de" status: 200 len: 1742 microversion: 2.20 time: 0.301825 Aug 24 11:37:55.223059 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 274/580] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:37:54 2022] GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de => generated 1742 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:37:55.229806 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-09b69d75-e3d7-4acf-9440-469baf2ff587 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:55.231426 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-09b69d75-e3d7-4acf-9440-469baf2ff587 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:55.232152 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-09b69d75-e3d7-4acf-9440-469baf2ff587 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:55.235528 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-09b69d75-e3d7-4acf-9440-469baf2ff587 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:55.236025 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-09b69d75-e3d7-4acf-9440-469baf2ff587 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:55.236487 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-09b69d75-e3d7-4acf-9440-469baf2ff587 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:55.418419 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-09b69d75-e3d7-4acf-9440-469baf2ff587 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031939e16194f63b99e6f27f700fa8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecec6d0c155f4d658197c4779ab9ffce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:55.430348 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-09b69d75-e3d7-4acf-9440-469baf2ff587 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] 10.222.0.84 "GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a" status: 200 len: 1700 microversion: 2.1 time: 0.219142 Aug 24 11:37:55.431564 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 307/581] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:37:55 2022] GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a => generated 1700 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:37:55.454350 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-dd82b4b0-cc1f-4903-9572-b6bd4e4a172f tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:37:55.461418 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-dd82b4b0-cc1f-4903-9572-b6bd4e4a172f tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:55.461912 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-dd82b4b0-cc1f-4903-9572-b6bd4e4a172f tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:55.462345 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-dd82b4b0-cc1f-4903-9572-b6bd4e4a172f tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:55.492611 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-dd82b4b0-cc1f-4903-9572-b6bd4e4a172f tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] [instance: 15d4a46e-9504-4897-918d-39aafc20d22a] Going to try to start instance {{(pid=124770) start /opt/stack/nova/nova/compute/api.py:2772}} Aug 24 11:37:55.871104 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-dd82b4b0-cc1f-4903-9572-b6bd4e4a172f tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] 10.222.0.84 "POST /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a/action" status: 202 len: 0 microversion: 2.1 time: 0.421662 Aug 24 11:37:55.880788 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-1b248c26-a891-441d-aa42-8c0b00251849 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:55.881439 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-1b248c26-a891-441d-aa42-8c0b00251849 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] [instance: 15d4a46e-9504-4897-918d-39aafc20d22a] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:55.884587 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 275/582] 10.222.0.84 () {60 vars in 1278 bytes} [Wed Aug 24 11:37:55 2022] POST /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a/action => generated 0 bytes in 427 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 11:37:55.889755 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-1b248c26-a891-441d-aa42-8c0b00251849 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:55.892355 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-1b248c26-a891-441d-aa42-8c0b00251849 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:55.893789 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-1b248c26-a891-441d-aa42-8c0b00251849 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:55.895100 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-1b248c26-a891-441d-aa42-8c0b00251849 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:55.895908 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-1b248c26-a891-441d-aa42-8c0b00251849 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:55.896662 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-1b248c26-a891-441d-aa42-8c0b00251849 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:55.941415 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-b161ff6d-3c96-429c-8a79-0153b05e1bcd tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:55.942124 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-b161ff6d-3c96-429c-8a79-0153b05e1bcd tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: ea26410d-7ad5-47e7-8d4a-ade5827e511c] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:55.956722 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b161ff6d-3c96-429c-8a79-0153b05e1bcd tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:55.957267 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b161ff6d-3c96-429c-8a79-0153b05e1bcd tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:55.957706 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b161ff6d-3c96-429c-8a79-0153b05e1bcd tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:55.959836 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b161ff6d-3c96-429c-8a79-0153b05e1bcd tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:55.960315 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b161ff6d-3c96-429c-8a79-0153b05e1bcd tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:55.960746 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b161ff6d-3c96-429c-8a79-0153b05e1bcd tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:56.197827 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-b161ff6d-3c96-429c-8a79-0153b05e1bcd tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2715cf2a5129439c83a5347bb963f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4159dc366f41bc9e4057a079f6fb5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:56.207102 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-b161ff6d-3c96-429c-8a79-0153b05e1bcd tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "GET /compute/v2.1/servers/ea26410d-7ad5-47e7-8d4a-ade5827e511c" status: 200 len: 1366 microversion: 2.1 time: 0.270985 Aug 24 11:37:56.223176 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 276/583] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:37:55 2022] GET /compute/v2.1/servers/ea26410d-7ad5-47e7-8d4a-ade5827e511c => generated 1366 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:37:56.223176 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-962a573f-3276-497d-ae06-e75dc6deb24d tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:56.223176 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-962a573f-3276-497d-ae06-e75dc6deb24d tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] [instance: be34b51d-aa45-4540-959d-a0f61d775992] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:56.228669 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-962a573f-3276-497d-ae06-e75dc6deb24d tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:56.229744 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-962a573f-3276-497d-ae06-e75dc6deb24d tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:56.230467 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-962a573f-3276-497d-ae06-e75dc6deb24d tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:56.231505 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-962a573f-3276-497d-ae06-e75dc6deb24d tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:56.232267 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-962a573f-3276-497d-ae06-e75dc6deb24d tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:56.233142 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-962a573f-3276-497d-ae06-e75dc6deb24d tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:56.314497 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-1b248c26-a891-441d-aa42-8c0b00251849 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031939e16194f63b99e6f27f700fa8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecec6d0c155f4d658197c4779ab9ffce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:56.325111 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-1b248c26-a891-441d-aa42-8c0b00251849 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] 10.222.0.84 "GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a" status: 200 len: 1709 microversion: 2.1 time: 0.448843 Aug 24 11:37:56.327508 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 308/584] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:37:55 2022] GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a => generated 1709 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:37:56.334802 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-53ea79f8-8589-4189-82ee-ed110306588f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:56.335739 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-53ea79f8-8589-4189-82ee-ed110306588f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: 2e661217-fb1a-48ad-9f1b-47985a4074de] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:56.373572 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-53ea79f8-8589-4189-82ee-ed110306588f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:56.374340 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-53ea79f8-8589-4189-82ee-ed110306588f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:56.377019 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-53ea79f8-8589-4189-82ee-ed110306588f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:56.378956 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-53ea79f8-8589-4189-82ee-ed110306588f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:56.382901 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-53ea79f8-8589-4189-82ee-ed110306588f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:56.383653 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-53ea79f8-8589-4189-82ee-ed110306588f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:56.571531 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-962a573f-3276-497d-ae06-e75dc6deb24d tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b82b6f568bd41fa9d6b44facb766e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ef3fc15a0147e39228729d2b5b2631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:56.591263 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-962a573f-3276-497d-ae06-e75dc6deb24d tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] 10.222.0.84 "GET /compute/v2.1/servers/be34b51d-aa45-4540-959d-a0f61d775992" status: 200 len: 1267 microversion: 2.1 time: 0.379753 Aug 24 11:37:56.593003 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 277/585] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:37:56 2022] GET /compute/v2.1/servers/be34b51d-aa45-4540-959d-a0f61d775992 => generated 1267 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:37:57.184027 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-53ea79f8-8589-4189-82ee-ed110306588f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:57.196666 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-53ea79f8-8589-4189-82ee-ed110306588f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:57.201299 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-53ea79f8-8589-4189-82ee-ed110306588f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:57.201299 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-53ea79f8-8589-4189-82ee-ed110306588f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de" status: 200 len: 1742 microversion: 2.20 time: 0.870326 Aug 24 11:37:57.202100 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 309/586] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:37:56 2022] GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de => generated 1742 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:37:57.236137 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-6ded0042-b085-4f0c-9303-7954cf33da04 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:57.236524 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-6ded0042-b085-4f0c-9303-7954cf33da04 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: ea26410d-7ad5-47e7-8d4a-ade5827e511c] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:57.265187 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6ded0042-b085-4f0c-9303-7954cf33da04 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:57.265187 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6ded0042-b085-4f0c-9303-7954cf33da04 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:57.265187 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6ded0042-b085-4f0c-9303-7954cf33da04 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:57.265187 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6ded0042-b085-4f0c-9303-7954cf33da04 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:57.266256 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6ded0042-b085-4f0c-9303-7954cf33da04 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:57.266256 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6ded0042-b085-4f0c-9303-7954cf33da04 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:57.357093 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-139989f4-ad06-45e4-8354-ee7b7e37fc8e tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:57.358063 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-139989f4-ad06-45e4-8354-ee7b7e37fc8e tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] [instance: 15d4a46e-9504-4897-918d-39aafc20d22a] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:57.369963 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-139989f4-ad06-45e4-8354-ee7b7e37fc8e tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:57.371165 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-139989f4-ad06-45e4-8354-ee7b7e37fc8e tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:57.371929 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-139989f4-ad06-45e4-8354-ee7b7e37fc8e tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:57.373199 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-139989f4-ad06-45e4-8354-ee7b7e37fc8e tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:57.374346 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-139989f4-ad06-45e4-8354-ee7b7e37fc8e tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:57.375110 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-139989f4-ad06-45e4-8354-ee7b7e37fc8e tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:57.588300 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-6ded0042-b085-4f0c-9303-7954cf33da04 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2715cf2a5129439c83a5347bb963f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4159dc366f41bc9e4057a079f6fb5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:57.604662 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-6ded0042-b085-4f0c-9303-7954cf33da04 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "GET /compute/v2.1/servers/ea26410d-7ad5-47e7-8d4a-ade5827e511c" status: 200 len: 1366 microversion: 2.1 time: 0.374698 Aug 24 11:37:57.611056 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 278/587] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:37:57 2022] GET /compute/v2.1/servers/ea26410d-7ad5-47e7-8d4a-ade5827e511c => generated 1366 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:37:57.634983 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-0f6c4a06-f870-479d-a72c-9e274ca6793c tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:57.636234 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-0f6c4a06-f870-479d-a72c-9e274ca6793c tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] [instance: be34b51d-aa45-4540-959d-a0f61d775992] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:57.648835 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-0f6c4a06-f870-479d-a72c-9e274ca6793c tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:57.653612 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-0f6c4a06-f870-479d-a72c-9e274ca6793c tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:57.653612 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-0f6c4a06-f870-479d-a72c-9e274ca6793c tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:57.653612 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-0f6c4a06-f870-479d-a72c-9e274ca6793c tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:57.653612 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-0f6c4a06-f870-479d-a72c-9e274ca6793c tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:57.654219 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-0f6c4a06-f870-479d-a72c-9e274ca6793c tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:57.704896 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:37:57.808405 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-139989f4-ad06-45e4-8354-ee7b7e37fc8e tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031939e16194f63b99e6f27f700fa8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecec6d0c155f4d658197c4779ab9ffce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:57.862071 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-139989f4-ad06-45e4-8354-ee7b7e37fc8e tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] 10.222.0.84 "GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a" status: 200 len: 1709 microversion: 2.1 time: 0.508875 Aug 24 11:37:57.888348 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 310/588] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:37:57 2022] GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a => generated 1709 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:37:57.908833 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-0f6c4a06-f870-479d-a72c-9e274ca6793c tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b82b6f568bd41fa9d6b44facb766e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ef3fc15a0147e39228729d2b5b2631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:57.917309 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-0f6c4a06-f870-479d-a72c-9e274ca6793c tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] 10.222.0.84 "GET /compute/v2.1/servers/be34b51d-aa45-4540-959d-a0f61d775992" status: 200 len: 1267 microversion: 2.1 time: 0.291732 Aug 24 11:37:57.918451 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 279/589] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:37:57 2022] GET /compute/v2.1/servers/be34b51d-aa45-4540-959d-a0f61d775992 => generated 1267 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:37:58.239271 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-90f26292-a7fa-4c41-aa64-05062265d9d6 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:58.240732 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-90f26292-a7fa-4c41-aa64-05062265d9d6 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: 2e661217-fb1a-48ad-9f1b-47985a4074de] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:58.275872 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-90f26292-a7fa-4c41-aa64-05062265d9d6 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:58.277177 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-90f26292-a7fa-4c41-aa64-05062265d9d6 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:58.278002 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-90f26292-a7fa-4c41-aa64-05062265d9d6 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:58.279717 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-90f26292-a7fa-4c41-aa64-05062265d9d6 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:58.280788 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-90f26292-a7fa-4c41-aa64-05062265d9d6 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:58.281798 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-90f26292-a7fa-4c41-aa64-05062265d9d6 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:58.610016 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-90f26292-a7fa-4c41-aa64-05062265d9d6 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:58.640001 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-74724320-3f7a-4461-a361-e162bcbd6bc3 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:58.641894 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-74724320-3f7a-4461-a361-e162bcbd6bc3 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: ea26410d-7ad5-47e7-8d4a-ade5827e511c] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:58.649367 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-90f26292-a7fa-4c41-aa64-05062265d9d6 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:58.654882 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-90f26292-a7fa-4c41-aa64-05062265d9d6 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:58.658321 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-90f26292-a7fa-4c41-aa64-05062265d9d6 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de" status: 200 len: 1742 microversion: 2.20 time: 0.424441 Aug 24 11:37:58.683035 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 311/590] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:37:58 2022] GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de => generated 1742 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 11:37:58.685176 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-74724320-3f7a-4461-a361-e162bcbd6bc3 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:58.686245 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-74724320-3f7a-4461-a361-e162bcbd6bc3 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:58.687151 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-74724320-3f7a-4461-a361-e162bcbd6bc3 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:58.689302 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-74724320-3f7a-4461-a361-e162bcbd6bc3 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:58.690287 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-74724320-3f7a-4461-a361-e162bcbd6bc3 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:58.691729 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-74724320-3f7a-4461-a361-e162bcbd6bc3 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:58.903708 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-10f9e3e3-bf9d-49d4-b55d-2f6629233b78 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:58.904958 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-10f9e3e3-bf9d-49d4-b55d-2f6629233b78 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] [instance: 15d4a46e-9504-4897-918d-39aafc20d22a] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:58.914907 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-10f9e3e3-bf9d-49d4-b55d-2f6629233b78 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:58.916319 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-10f9e3e3-bf9d-49d4-b55d-2f6629233b78 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:58.917487 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-10f9e3e3-bf9d-49d4-b55d-2f6629233b78 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:58.918750 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-10f9e3e3-bf9d-49d4-b55d-2f6629233b78 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:58.919645 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-10f9e3e3-bf9d-49d4-b55d-2f6629233b78 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:58.920426 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-10f9e3e3-bf9d-49d4-b55d-2f6629233b78 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:58.983678 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-74724320-3f7a-4461-a361-e162bcbd6bc3 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2715cf2a5129439c83a5347bb963f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4159dc366f41bc9e4057a079f6fb5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:59.002038 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-74724320-3f7a-4461-a361-e162bcbd6bc3 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "GET /compute/v2.1/servers/ea26410d-7ad5-47e7-8d4a-ade5827e511c" status: 200 len: 1366 microversion: 2.1 time: 0.369936 Aug 24 11:37:59.003507 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 280/591] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:37:58 2022] GET /compute/v2.1/servers/ea26410d-7ad5-47e7-8d4a-ade5827e511c => generated 1366 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:37:59.045107 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-8b75dd50-69d7-4beb-b538-255738fcc2bd tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:59.053425 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-8b75dd50-69d7-4beb-b538-255738fcc2bd tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] [instance: be34b51d-aa45-4540-959d-a0f61d775992] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:59.085554 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8b75dd50-69d7-4beb-b538-255738fcc2bd tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:59.086363 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8b75dd50-69d7-4beb-b538-255738fcc2bd tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:59.087022 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8b75dd50-69d7-4beb-b538-255738fcc2bd tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:59.088312 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8b75dd50-69d7-4beb-b538-255738fcc2bd tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:59.089170 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8b75dd50-69d7-4beb-b538-255738fcc2bd tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:59.090769 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8b75dd50-69d7-4beb-b538-255738fcc2bd tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:59.212010 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-10f9e3e3-bf9d-49d4-b55d-2f6629233b78 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031939e16194f63b99e6f27f700fa8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecec6d0c155f4d658197c4779ab9ffce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:59.243633 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-10f9e3e3-bf9d-49d4-b55d-2f6629233b78 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] 10.222.0.84 "GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a" status: 200 len: 1709 microversion: 2.1 time: 0.345187 Aug 24 11:37:59.244530 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 312/592] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:37:58 2022] GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a => generated 1709 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:37:59.364017 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [req-4e85b6e2-fcd9-400e-9bbd-2cfdd3d3f42d req-33be4825-e671-409b-b454-0913f6899802 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea26410d-7ad5-47e7-8d4a-ade5827e511c", "name": "network-vif-plugged", "status": "completed", "tag": "b747c4d8-3ba6-4e33-ada3-b81ba17dac29"}]} {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:37:59.417185 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [req-4e85b6e2-fcd9-400e-9bbd-2cfdd3d3f42d req-33be4825-e671-409b-b454-0913f6899802 service nova] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:59.418613 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [req-4e85b6e2-fcd9-400e-9bbd-2cfdd3d3f42d req-33be4825-e671-409b-b454-0913f6899802 service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:59.419685 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [req-4e85b6e2-fcd9-400e-9bbd-2cfdd3d3f42d req-33be4825-e671-409b-b454-0913f6899802 service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:59.441725 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.compute.server_external_events [req-4e85b6e2-fcd9-400e-9bbd-2cfdd3d3f42d req-33be4825-e671-409b-b454-0913f6899802 service nova] Creating event network-vif-plugged:b747c4d8-3ba6-4e33-ada3-b81ba17dac29 for instance ea26410d-7ad5-47e7-8d4a-ade5827e511c on hv-cinder-85427 Aug 24 11:37:59.449999 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [req-4e85b6e2-fcd9-400e-9bbd-2cfdd3d3f42d req-33be4825-e671-409b-b454-0913f6899802 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100693 Aug 24 11:37:59.453248 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 313/593] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Aug 24 11:37:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:37:59.693574 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-37def7ed-dfa8-496e-97b3-62543d6f1c88 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:59.695155 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-37def7ed-dfa8-496e-97b3-62543d6f1c88 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: 2e661217-fb1a-48ad-9f1b-47985a4074de] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:59.707616 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-37def7ed-dfa8-496e-97b3-62543d6f1c88 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:59.708612 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-37def7ed-dfa8-496e-97b3-62543d6f1c88 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:59.709520 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-37def7ed-dfa8-496e-97b3-62543d6f1c88 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:59.711843 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-37def7ed-dfa8-496e-97b3-62543d6f1c88 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:59.713877 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-37def7ed-dfa8-496e-97b3-62543d6f1c88 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:59.714808 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-37def7ed-dfa8-496e-97b3-62543d6f1c88 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:59.863259 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-8b75dd50-69d7-4beb-b538-255738fcc2bd tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b82b6f568bd41fa9d6b44facb766e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ef3fc15a0147e39228729d2b5b2631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:59.883946 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-8b75dd50-69d7-4beb-b538-255738fcc2bd tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] 10.222.0.84 "GET /compute/v2.1/servers/be34b51d-aa45-4540-959d-a0f61d775992" status: 200 len: 1267 microversion: 2.1 time: 0.850615 Aug 24 11:37:59.886307 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 281/594] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:37:59 2022] GET /compute/v2.1/servers/be34b51d-aa45-4540-959d-a0f61d775992 => generated 1267 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:38:00.027599 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-88a2aa28-0103-4c2d-a5bd-8bd3201969c1 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:38:00.028220 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-88a2aa28-0103-4c2d-a5bd-8bd3201969c1 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: ea26410d-7ad5-47e7-8d4a-ade5827e511c] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:38:00.044427 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-88a2aa28-0103-4c2d-a5bd-8bd3201969c1 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:00.045227 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-88a2aa28-0103-4c2d-a5bd-8bd3201969c1 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:00.045866 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-88a2aa28-0103-4c2d-a5bd-8bd3201969c1 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:00.052769 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-88a2aa28-0103-4c2d-a5bd-8bd3201969c1 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:00.053980 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-88a2aa28-0103-4c2d-a5bd-8bd3201969c1 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:00.078404 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-88a2aa28-0103-4c2d-a5bd-8bd3201969c1 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:00.250854 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-37def7ed-dfa8-496e-97b3-62543d6f1c88 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:00.285202 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-37def7ed-dfa8-496e-97b3-62543d6f1c88 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:00.290970 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-37def7ed-dfa8-496e-97b3-62543d6f1c88 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:00.307304 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-37def7ed-dfa8-496e-97b3-62543d6f1c88 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de" status: 200 len: 1742 microversion: 2.20 time: 0.607352 Aug 24 11:38:00.346800 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 314/595] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:37:59 2022] GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de => generated 1742 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:38:00.363569 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-fae4b0dd-ba83-49aa-add5-760cc11a4bff tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:38:00.365197 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-fae4b0dd-ba83-49aa-add5-760cc11a4bff tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] [instance: 15d4a46e-9504-4897-918d-39aafc20d22a] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:38:00.387117 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-fae4b0dd-ba83-49aa-add5-760cc11a4bff tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:00.387616 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-fae4b0dd-ba83-49aa-add5-760cc11a4bff tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:00.388067 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-fae4b0dd-ba83-49aa-add5-760cc11a4bff tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:00.388827 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-fae4b0dd-ba83-49aa-add5-760cc11a4bff tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:00.390016 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-fae4b0dd-ba83-49aa-add5-760cc11a4bff tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:00.401026 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-fae4b0dd-ba83-49aa-add5-760cc11a4bff tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:00.431446 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-88a2aa28-0103-4c2d-a5bd-8bd3201969c1 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2715cf2a5129439c83a5347bb963f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4159dc366f41bc9e4057a079f6fb5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:00.435290 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-88a2aa28-0103-4c2d-a5bd-8bd3201969c1 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "GET /compute/v2.1/servers/ea26410d-7ad5-47e7-8d4a-ade5827e511c" status: 200 len: 1366 microversion: 2.1 time: 0.411530 Aug 24 11:38:00.464875 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 282/596] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:38:00 2022] GET /compute/v2.1/servers/ea26410d-7ad5-47e7-8d4a-ade5827e511c => generated 1366 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:38:00.705826 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-fae4b0dd-ba83-49aa-add5-760cc11a4bff tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031939e16194f63b99e6f27f700fa8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecec6d0c155f4d658197c4779ab9ffce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:00.724049 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-fae4b0dd-ba83-49aa-add5-760cc11a4bff tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] 10.222.0.84 "GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a" status: 200 len: 1713 microversion: 2.1 time: 0.374797 Aug 24 11:38:00.725121 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 315/597] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:38:00 2022] GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a => generated 1713 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:38:00.918134 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-81ba985c-d296-4fce-8821-4ad43ed190c6 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:38:00.919513 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-81ba985c-d296-4fce-8821-4ad43ed190c6 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] [instance: be34b51d-aa45-4540-959d-a0f61d775992] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:38:00.936034 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-81ba985c-d296-4fce-8821-4ad43ed190c6 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:00.938000 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-81ba985c-d296-4fce-8821-4ad43ed190c6 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:00.939071 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-81ba985c-d296-4fce-8821-4ad43ed190c6 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:00.940174 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-81ba985c-d296-4fce-8821-4ad43ed190c6 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:00.940918 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-81ba985c-d296-4fce-8821-4ad43ed190c6 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:00.941574 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-81ba985c-d296-4fce-8821-4ad43ed190c6 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:01.206384 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-81ba985c-d296-4fce-8821-4ad43ed190c6 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b82b6f568bd41fa9d6b44facb766e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ef3fc15a0147e39228729d2b5b2631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:01.215731 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-81ba985c-d296-4fce-8821-4ad43ed190c6 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] 10.222.0.84 "GET /compute/v2.1/servers/be34b51d-aa45-4540-959d-a0f61d775992" status: 200 len: 1267 microversion: 2.1 time: 0.302895 Aug 24 11:38:01.216742 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 283/598] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:38:00 2022] GET /compute/v2.1/servers/be34b51d-aa45-4540-959d-a0f61d775992 => generated 1267 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:38:01.383392 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-3a0ae09c-da20-4c87-9ec2-63d6da875554 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:38:01.384664 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-3a0ae09c-da20-4c87-9ec2-63d6da875554 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: 2e661217-fb1a-48ad-9f1b-47985a4074de] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:38:01.405030 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-3a0ae09c-da20-4c87-9ec2-63d6da875554 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:01.405030 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-3a0ae09c-da20-4c87-9ec2-63d6da875554 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:01.405030 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-3a0ae09c-da20-4c87-9ec2-63d6da875554 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:01.418359 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-3a0ae09c-da20-4c87-9ec2-63d6da875554 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:01.419452 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-3a0ae09c-da20-4c87-9ec2-63d6da875554 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:01.420190 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-3a0ae09c-da20-4c87-9ec2-63d6da875554 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:01.481156 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-19338ac6-5b27-4c95-a06c-9850eddd6fbe tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:38:01.482688 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-19338ac6-5b27-4c95-a06c-9850eddd6fbe tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: ea26410d-7ad5-47e7-8d4a-ade5827e511c] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:38:01.567371 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-19338ac6-5b27-4c95-a06c-9850eddd6fbe tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:01.567371 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-19338ac6-5b27-4c95-a06c-9850eddd6fbe tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:01.567371 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-19338ac6-5b27-4c95-a06c-9850eddd6fbe tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:01.567371 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-19338ac6-5b27-4c95-a06c-9850eddd6fbe tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:01.568533 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-19338ac6-5b27-4c95-a06c-9850eddd6fbe tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:01.568533 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-19338ac6-5b27-4c95-a06c-9850eddd6fbe tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:01.679454 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-3a0ae09c-da20-4c87-9ec2-63d6da875554 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:01.698975 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-3a0ae09c-da20-4c87-9ec2-63d6da875554 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:01.700940 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-3a0ae09c-da20-4c87-9ec2-63d6da875554 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:01.702154 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-3a0ae09c-da20-4c87-9ec2-63d6da875554 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de" status: 200 len: 1742 microversion: 2.20 time: 0.327830 Aug 24 11:38:01.702728 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 316/599] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:38:01 2022] GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de => generated 1742 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:38:01.808279 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-19338ac6-5b27-4c95-a06c-9850eddd6fbe tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2715cf2a5129439c83a5347bb963f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4159dc366f41bc9e4057a079f6fb5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:01.821393 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-19338ac6-5b27-4c95-a06c-9850eddd6fbe tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "GET /compute/v2.1/servers/ea26410d-7ad5-47e7-8d4a-ade5827e511c" status: 200 len: 1366 microversion: 2.1 time: 0.354896 Aug 24 11:38:01.822281 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 284/600] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:38:01 2022] GET /compute/v2.1/servers/ea26410d-7ad5-47e7-8d4a-ade5827e511c => generated 1366 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:38:02.238331 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-5608f80e-e779-4475-861e-31c1f272fefa tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:38:02.238983 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-5608f80e-e779-4475-861e-31c1f272fefa tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] [instance: be34b51d-aa45-4540-959d-a0f61d775992] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:38:02.245318 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-5608f80e-e779-4475-861e-31c1f272fefa tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:02.246068 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-5608f80e-e779-4475-861e-31c1f272fefa tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:02.246546 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-5608f80e-e779-4475-861e-31c1f272fefa tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:02.247355 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-5608f80e-e779-4475-861e-31c1f272fefa tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:02.247935 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-5608f80e-e779-4475-861e-31c1f272fefa tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:02.248357 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-5608f80e-e779-4475-861e-31c1f272fefa tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:02.399796 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-5608f80e-e779-4475-861e-31c1f272fefa tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b82b6f568bd41fa9d6b44facb766e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ef3fc15a0147e39228729d2b5b2631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:02.408970 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-5608f80e-e779-4475-861e-31c1f272fefa tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] 10.222.0.84 "GET /compute/v2.1/servers/be34b51d-aa45-4540-959d-a0f61d775992" status: 200 len: 1267 microversion: 2.1 time: 0.174515 Aug 24 11:38:02.409572 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 317/601] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:38:02 2022] GET /compute/v2.1/servers/be34b51d-aa45-4540-959d-a0f61d775992 => generated 1267 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:38:02.731613 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-30a0c87c-41e9-4b91-9e99-4657ede74533 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:38:02.732778 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-30a0c87c-41e9-4b91-9e99-4657ede74533 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: 2e661217-fb1a-48ad-9f1b-47985a4074de] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:38:02.743592 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-30a0c87c-41e9-4b91-9e99-4657ede74533 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:02.746238 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-30a0c87c-41e9-4b91-9e99-4657ede74533 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:02.746904 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-30a0c87c-41e9-4b91-9e99-4657ede74533 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:02.747887 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-30a0c87c-41e9-4b91-9e99-4657ede74533 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:02.749387 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-30a0c87c-41e9-4b91-9e99-4657ede74533 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:02.750217 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-30a0c87c-41e9-4b91-9e99-4657ede74533 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:02.863756 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-b0504703-7087-46fc-a395-aadc2e187a7b tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:38:02.864659 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-b0504703-7087-46fc-a395-aadc2e187a7b tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: ea26410d-7ad5-47e7-8d4a-ade5827e511c] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:38:02.880576 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-b0504703-7087-46fc-a395-aadc2e187a7b tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:02.882973 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-b0504703-7087-46fc-a395-aadc2e187a7b tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:02.888433 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-b0504703-7087-46fc-a395-aadc2e187a7b tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:02.888433 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-b0504703-7087-46fc-a395-aadc2e187a7b tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:02.888433 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-b0504703-7087-46fc-a395-aadc2e187a7b tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:02.888433 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-b0504703-7087-46fc-a395-aadc2e187a7b tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:03.226507 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-b0504703-7087-46fc-a395-aadc2e187a7b tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2715cf2a5129439c83a5347bb963f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4159dc366f41bc9e4057a079f6fb5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:03.230969 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-30a0c87c-41e9-4b91-9e99-4657ede74533 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:03.253651 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-b0504703-7087-46fc-a395-aadc2e187a7b tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "GET /compute/v2.1/servers/ea26410d-7ad5-47e7-8d4a-ade5827e511c" status: 200 len: 1366 microversion: 2.1 time: 0.396883 Aug 24 11:38:03.254697 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 318/602] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:38:02 2022] GET /compute/v2.1/servers/ea26410d-7ad5-47e7-8d4a-ade5827e511c => generated 1366 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:38:03.274880 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-30a0c87c-41e9-4b91-9e99-4657ede74533 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:03.280729 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-30a0c87c-41e9-4b91-9e99-4657ede74533 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:03.282266 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-30a0c87c-41e9-4b91-9e99-4657ede74533 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de" status: 200 len: 1742 microversion: 2.20 time: 0.557112 Aug 24 11:38:03.283506 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 285/603] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:38:02 2022] GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de => generated 1742 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:38:03.433136 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-122541a9-932c-4883-9c2d-d7d2a04f54a4 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:38:03.435056 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-122541a9-932c-4883-9c2d-d7d2a04f54a4 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] [instance: be34b51d-aa45-4540-959d-a0f61d775992] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:38:03.458935 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-122541a9-932c-4883-9c2d-d7d2a04f54a4 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:03.459728 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-122541a9-932c-4883-9c2d-d7d2a04f54a4 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:03.460707 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-122541a9-932c-4883-9c2d-d7d2a04f54a4 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:03.462009 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-122541a9-932c-4883-9c2d-d7d2a04f54a4 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:03.465207 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-122541a9-932c-4883-9c2d-d7d2a04f54a4 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:03.466001 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-122541a9-932c-4883-9c2d-d7d2a04f54a4 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:03.738581 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-122541a9-932c-4883-9c2d-d7d2a04f54a4 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b82b6f568bd41fa9d6b44facb766e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ef3fc15a0147e39228729d2b5b2631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:03.746895 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-122541a9-932c-4883-9c2d-d7d2a04f54a4 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] 10.222.0.84 "GET /compute/v2.1/servers/be34b51d-aa45-4540-959d-a0f61d775992" status: 200 len: 1267 microversion: 2.1 time: 0.319950 Aug 24 11:38:03.749039 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 319/604] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:38:03 2022] GET /compute/v2.1/servers/be34b51d-aa45-4540-959d-a0f61d775992 => generated 1267 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:38:04.281963 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-351ea9de-9674-42a9-90da-ed0e0164ed5e tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:38:04.282711 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-351ea9de-9674-42a9-90da-ed0e0164ed5e tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: ea26410d-7ad5-47e7-8d4a-ade5827e511c] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:38:04.290408 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-351ea9de-9674-42a9-90da-ed0e0164ed5e tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:04.290894 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-351ea9de-9674-42a9-90da-ed0e0164ed5e tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:04.291325 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-351ea9de-9674-42a9-90da-ed0e0164ed5e tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:04.292331 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-351ea9de-9674-42a9-90da-ed0e0164ed5e tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:04.292697 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-351ea9de-9674-42a9-90da-ed0e0164ed5e tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:04.293216 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-351ea9de-9674-42a9-90da-ed0e0164ed5e tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:04.317774 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-17174f4f-26b9-4ceb-8221-1950857a71fc tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:38:04.318580 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-17174f4f-26b9-4ceb-8221-1950857a71fc tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: 2e661217-fb1a-48ad-9f1b-47985a4074de] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:38:04.325993 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-17174f4f-26b9-4ceb-8221-1950857a71fc tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:04.327388 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-17174f4f-26b9-4ceb-8221-1950857a71fc tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:04.328176 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-17174f4f-26b9-4ceb-8221-1950857a71fc tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:04.328743 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-17174f4f-26b9-4ceb-8221-1950857a71fc tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:04.329549 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-17174f4f-26b9-4ceb-8221-1950857a71fc tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:04.331171 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-17174f4f-26b9-4ceb-8221-1950857a71fc tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:04.508610 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-17174f4f-26b9-4ceb-8221-1950857a71fc tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:04.518835 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-17174f4f-26b9-4ceb-8221-1950857a71fc tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:04.537015 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-17174f4f-26b9-4ceb-8221-1950857a71fc tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:04.537015 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-17174f4f-26b9-4ceb-8221-1950857a71fc tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de" status: 200 len: 1742 microversion: 2.20 time: 0.212888 Aug 24 11:38:04.539096 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-351ea9de-9674-42a9-90da-ed0e0164ed5e tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2715cf2a5129439c83a5347bb963f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4159dc366f41bc9e4057a079f6fb5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:04.540384 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 320/605] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:38:04 2022] GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de => generated 1742 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:38:04.553367 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-351ea9de-9674-42a9-90da-ed0e0164ed5e tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "GET /compute/v2.1/servers/ea26410d-7ad5-47e7-8d4a-ade5827e511c" status: 200 len: 1366 microversion: 2.1 time: 0.275208 Aug 24 11:38:04.554524 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 286/606] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:38:04 2022] GET /compute/v2.1/servers/ea26410d-7ad5-47e7-8d4a-ade5827e511c => generated 1366 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:38:04.776396 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-5f5f6e03-42ec-4297-9cbd-5d725744057b tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:38:04.777037 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-5f5f6e03-42ec-4297-9cbd-5d725744057b tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] [instance: be34b51d-aa45-4540-959d-a0f61d775992] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:38:04.784107 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-5f5f6e03-42ec-4297-9cbd-5d725744057b tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:04.784679 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-5f5f6e03-42ec-4297-9cbd-5d725744057b tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:04.785061 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-5f5f6e03-42ec-4297-9cbd-5d725744057b tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:04.785743 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-5f5f6e03-42ec-4297-9cbd-5d725744057b tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:04.786288 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-5f5f6e03-42ec-4297-9cbd-5d725744057b tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:04.786619 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-5f5f6e03-42ec-4297-9cbd-5d725744057b tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:04.791029 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG dbcounter [-] [124769] Writing DB stats nova_cell1:SELECT=100 {{(pid=124769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:38:04.947600 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-5f5f6e03-42ec-4297-9cbd-5d725744057b tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b82b6f568bd41fa9d6b44facb766e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ef3fc15a0147e39228729d2b5b2631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:04.963953 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-5f5f6e03-42ec-4297-9cbd-5d725744057b tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] 10.222.0.84 "GET /compute/v2.1/servers/be34b51d-aa45-4540-959d-a0f61d775992" status: 200 len: 1267 microversion: 2.1 time: 0.185036 Aug 24 11:38:04.963953 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 321/607] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:38:04 2022] GET /compute/v2.1/servers/be34b51d-aa45-4540-959d-a0f61d775992 => generated 1267 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:38:05.559383 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-1a5a9781-bd14-4434-a304-2888f71f977d tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:38:05.560530 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-1a5a9781-bd14-4434-a304-2888f71f977d tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: 2e661217-fb1a-48ad-9f1b-47985a4074de] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:38:05.571269 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1a5a9781-bd14-4434-a304-2888f71f977d tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:05.572385 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1a5a9781-bd14-4434-a304-2888f71f977d tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:05.577043 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1a5a9781-bd14-4434-a304-2888f71f977d tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:05.577043 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1a5a9781-bd14-4434-a304-2888f71f977d tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:05.577043 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1a5a9781-bd14-4434-a304-2888f71f977d tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:05.577043 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1a5a9781-bd14-4434-a304-2888f71f977d tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:05.583410 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-9fc99ef1-0e4a-435d-beef-3d8d4cabb836 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:38:05.584466 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-9fc99ef1-0e4a-435d-beef-3d8d4cabb836 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: ea26410d-7ad5-47e7-8d4a-ade5827e511c] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:38:05.597029 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-9fc99ef1-0e4a-435d-beef-3d8d4cabb836 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:05.597545 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-9fc99ef1-0e4a-435d-beef-3d8d4cabb836 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:05.598270 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-9fc99ef1-0e4a-435d-beef-3d8d4cabb836 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:05.600160 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-9fc99ef1-0e4a-435d-beef-3d8d4cabb836 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:05.600959 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-9fc99ef1-0e4a-435d-beef-3d8d4cabb836 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:05.601671 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-9fc99ef1-0e4a-435d-beef-3d8d4cabb836 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:05.847716 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-9fc99ef1-0e4a-435d-beef-3d8d4cabb836 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2715cf2a5129439c83a5347bb963f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4159dc366f41bc9e4057a079f6fb5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:05.858319 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-9fc99ef1-0e4a-435d-beef-3d8d4cabb836 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "GET /compute/v2.1/servers/ea26410d-7ad5-47e7-8d4a-ade5827e511c" status: 200 len: 1366 microversion: 2.1 time: 0.279608 Aug 24 11:38:05.858910 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 322/608] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:38:05 2022] GET /compute/v2.1/servers/ea26410d-7ad5-47e7-8d4a-ade5827e511c => generated 1366 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:38:05.901022 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-1a5a9781-bd14-4434-a304-2888f71f977d tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:05.913911 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-1a5a9781-bd14-4434-a304-2888f71f977d tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:05.915465 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-1a5a9781-bd14-4434-a304-2888f71f977d tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:05.916653 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-1a5a9781-bd14-4434-a304-2888f71f977d tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de" status: 200 len: 1742 microversion: 2.20 time: 0.364364 Aug 24 11:38:05.917249 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 287/609] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:38:05 2022] GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de => generated 1742 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:38:05.984523 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-5567dd5d-6dbb-42d7-9e68-b744abd35461 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:38:05.985667 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-5567dd5d-6dbb-42d7-9e68-b744abd35461 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] [instance: be34b51d-aa45-4540-959d-a0f61d775992] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:38:05.994014 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-5567dd5d-6dbb-42d7-9e68-b744abd35461 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:05.994417 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-5567dd5d-6dbb-42d7-9e68-b744abd35461 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:05.994884 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-5567dd5d-6dbb-42d7-9e68-b744abd35461 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:05.995613 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-5567dd5d-6dbb-42d7-9e68-b744abd35461 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:05.996329 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-5567dd5d-6dbb-42d7-9e68-b744abd35461 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:05.996751 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-5567dd5d-6dbb-42d7-9e68-b744abd35461 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:06.179715 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-5567dd5d-6dbb-42d7-9e68-b744abd35461 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b82b6f568bd41fa9d6b44facb766e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ef3fc15a0147e39228729d2b5b2631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:06.188215 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-5567dd5d-6dbb-42d7-9e68-b744abd35461 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] 10.222.0.84 "GET /compute/v2.1/servers/be34b51d-aa45-4540-959d-a0f61d775992" status: 200 len: 1267 microversion: 2.1 time: 0.209401 Aug 24 11:38:06.188816 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 323/610] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:38:05 2022] GET /compute/v2.1/servers/be34b51d-aa45-4540-959d-a0f61d775992 => generated 1267 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:38:06.848543 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [req-13666d44-da3e-46d6-8d02-9c985307a9d1 req-2cc5d7dc-1214-4e82-aaf6-bf765ad96463 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be34b51d-aa45-4540-959d-a0f61d775992", "name": "network-vif-plugged", "status": "completed", "tag": "bc48e073-4e3e-414c-bc63-e35b79ac195d"}]} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:38:06.874443 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-13666d44-da3e-46d6-8d02-9c985307a9d1 req-2cc5d7dc-1214-4e82-aaf6-bf765ad96463 service nova] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:06.883334 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-328f7c3d-b9a3-4cf9-95b5-781d3569aa69 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:38:06.884437 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-328f7c3d-b9a3-4cf9-95b5-781d3569aa69 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: ea26410d-7ad5-47e7-8d4a-ade5827e511c] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:38:06.890817 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-13666d44-da3e-46d6-8d02-9c985307a9d1 req-2cc5d7dc-1214-4e82-aaf6-bf765ad96463 service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:06.891942 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-13666d44-da3e-46d6-8d02-9c985307a9d1 req-2cc5d7dc-1214-4e82-aaf6-bf765ad96463 service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:06.905341 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-328f7c3d-b9a3-4cf9-95b5-781d3569aa69 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:06.906203 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-328f7c3d-b9a3-4cf9-95b5-781d3569aa69 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:06.913844 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-328f7c3d-b9a3-4cf9-95b5-781d3569aa69 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:06.915236 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-328f7c3d-b9a3-4cf9-95b5-781d3569aa69 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:06.916078 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-328f7c3d-b9a3-4cf9-95b5-781d3569aa69 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:06.916860 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-328f7c3d-b9a3-4cf9-95b5-781d3569aa69 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:06.934229 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.compute.server_external_events [req-13666d44-da3e-46d6-8d02-9c985307a9d1 req-2cc5d7dc-1214-4e82-aaf6-bf765ad96463 service nova] Creating event network-vif-plugged:bc48e073-4e3e-414c-bc63-e35b79ac195d for instance be34b51d-aa45-4540-959d-a0f61d775992 on hv-cinder-85427 Aug 24 11:38:06.952120 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [req-13666d44-da3e-46d6-8d02-9c985307a9d1 req-2cc5d7dc-1214-4e82-aaf6-bf765ad96463 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111119 Aug 24 11:38:06.956787 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 288/611] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Aug 24 11:38:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:38:06.963583 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-cfb2e09b-ecae-45d3-b16c-2e0330d8b3e8 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:38:06.968952 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-cfb2e09b-ecae-45d3-b16c-2e0330d8b3e8 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: 2e661217-fb1a-48ad-9f1b-47985a4074de] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:38:06.984949 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-cfb2e09b-ecae-45d3-b16c-2e0330d8b3e8 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:06.985445 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-cfb2e09b-ecae-45d3-b16c-2e0330d8b3e8 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:06.987225 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-cfb2e09b-ecae-45d3-b16c-2e0330d8b3e8 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:06.991236 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-cfb2e09b-ecae-45d3-b16c-2e0330d8b3e8 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:06.991236 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-cfb2e09b-ecae-45d3-b16c-2e0330d8b3e8 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:06.991236 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-cfb2e09b-ecae-45d3-b16c-2e0330d8b3e8 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:07.182973 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-328f7c3d-b9a3-4cf9-95b5-781d3569aa69 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2715cf2a5129439c83a5347bb963f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4159dc366f41bc9e4057a079f6fb5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:07.194585 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-328f7c3d-b9a3-4cf9-95b5-781d3569aa69 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "GET /compute/v2.1/servers/ea26410d-7ad5-47e7-8d4a-ade5827e511c" status: 200 len: 1556 microversion: 2.1 time: 0.318180 Aug 24 11:38:07.196530 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 324/612] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:38:06 2022] GET /compute/v2.1/servers/ea26410d-7ad5-47e7-8d4a-ade5827e511c => generated 1556 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:38:07.215498 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-06d7bec9-c066-45cd-b20c-995ff7483cac tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:38:07.219673 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-06d7bec9-c066-45cd-b20c-995ff7483cac tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] [instance: be34b51d-aa45-4540-959d-a0f61d775992] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:38:07.234850 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-06d7bec9-c066-45cd-b20c-995ff7483cac tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:07.237021 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-06d7bec9-c066-45cd-b20c-995ff7483cac tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:07.240268 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-06d7bec9-c066-45cd-b20c-995ff7483cac tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:07.241200 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-06d7bec9-c066-45cd-b20c-995ff7483cac tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:07.241757 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-06d7bec9-c066-45cd-b20c-995ff7483cac tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:07.244197 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-06d7bec9-c066-45cd-b20c-995ff7483cac tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:07.277634 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-cfb2e09b-ecae-45d3-b16c-2e0330d8b3e8 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:07.315052 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-cfb2e09b-ecae-45d3-b16c-2e0330d8b3e8 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:07.325083 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-cfb2e09b-ecae-45d3-b16c-2e0330d8b3e8 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:07.327959 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-cfb2e09b-ecae-45d3-b16c-2e0330d8b3e8 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de" status: 200 len: 1724 microversion: 2.20 time: 0.369610 Aug 24 11:38:07.332288 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 289/613] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:38:06 2022] GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de => generated 1724 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:38:07.351668 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-09ebd13a-7f28-4c39-b2b3-8e78111c8cb8 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:38:07.354719 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-09ebd13a-7f28-4c39-b2b3-8e78111c8cb8 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: ea26410d-7ad5-47e7-8d4a-ade5827e511c] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:38:07.371958 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-09ebd13a-7f28-4c39-b2b3-8e78111c8cb8 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:07.373594 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-09ebd13a-7f28-4c39-b2b3-8e78111c8cb8 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:07.374799 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-09ebd13a-7f28-4c39-b2b3-8e78111c8cb8 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:07.376404 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-09ebd13a-7f28-4c39-b2b3-8e78111c8cb8 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:07.377725 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-09ebd13a-7f28-4c39-b2b3-8e78111c8cb8 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:07.378877 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-09ebd13a-7f28-4c39-b2b3-8e78111c8cb8 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:07.565620 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-06d7bec9-c066-45cd-b20c-995ff7483cac tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b82b6f568bd41fa9d6b44facb766e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ef3fc15a0147e39228729d2b5b2631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:07.578530 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-06d7bec9-c066-45cd-b20c-995ff7483cac tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] 10.222.0.84 "GET /compute/v2.1/servers/be34b51d-aa45-4540-959d-a0f61d775992" status: 200 len: 1267 microversion: 2.1 time: 0.367111 Aug 24 11:38:07.579664 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 325/614] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:38:07 2022] GET /compute/v2.1/servers/be34b51d-aa45-4540-959d-a0f61d775992 => generated 1267 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:38:07.599147 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-09ebd13a-7f28-4c39-b2b3-8e78111c8cb8 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "GET /compute/v2.1/servers/ea26410d-7ad5-47e7-8d4a-ade5827e511c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.264859 Aug 24 11:38:07.599874 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 290/615] 10.222.0.84 () {58 vars in 1275 bytes} [Wed Aug 24 11:38:07 2022] GET /compute/v2.1/servers/ea26410d-7ad5-47e7-8d4a-ade5827e511c/os-interface => generated 284 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:38:08.361715 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-78a52dec-8935-495f-8ee5-1e9d0bad72de tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:38:08.363376 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-78a52dec-8935-495f-8ee5-1e9d0bad72de tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: 2e661217-fb1a-48ad-9f1b-47985a4074de] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:38:08.387325 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-78a52dec-8935-495f-8ee5-1e9d0bad72de tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:08.394565 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-78a52dec-8935-495f-8ee5-1e9d0bad72de tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:08.395518 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-78a52dec-8935-495f-8ee5-1e9d0bad72de tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:08.396446 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-78a52dec-8935-495f-8ee5-1e9d0bad72de tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:08.397305 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-78a52dec-8935-495f-8ee5-1e9d0bad72de tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:08.397907 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-78a52dec-8935-495f-8ee5-1e9d0bad72de tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:08.624051 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-62bf913e-1358-4f28-abcf-bdc45d496b50 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:38:08.624051 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-62bf913e-1358-4f28-abcf-bdc45d496b50 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] [instance: be34b51d-aa45-4540-959d-a0f61d775992] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:38:08.624051 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-62bf913e-1358-4f28-abcf-bdc45d496b50 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:08.624051 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-62bf913e-1358-4f28-abcf-bdc45d496b50 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:08.625486 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-62bf913e-1358-4f28-abcf-bdc45d496b50 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:08.625486 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-62bf913e-1358-4f28-abcf-bdc45d496b50 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:08.625486 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-62bf913e-1358-4f28-abcf-bdc45d496b50 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:08.625486 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-62bf913e-1358-4f28-abcf-bdc45d496b50 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:08.684222 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-78a52dec-8935-495f-8ee5-1e9d0bad72de tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:08.698365 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-78a52dec-8935-495f-8ee5-1e9d0bad72de tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:08.704402 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-78a52dec-8935-495f-8ee5-1e9d0bad72de tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:08.704402 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-78a52dec-8935-495f-8ee5-1e9d0bad72de tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de" status: 200 len: 1724 microversion: 2.20 time: 0.346259 Aug 24 11:38:08.713227 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 326/616] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:38:08 2022] GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de => generated 1724 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:38:08.834717 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-62bf913e-1358-4f28-abcf-bdc45d496b50 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b82b6f568bd41fa9d6b44facb766e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ef3fc15a0147e39228729d2b5b2631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:08.846760 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-62bf913e-1358-4f28-abcf-bdc45d496b50 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] 10.222.0.84 "GET /compute/v2.1/servers/be34b51d-aa45-4540-959d-a0f61d775992" status: 200 len: 1267 microversion: 2.1 time: 0.248652 Aug 24 11:38:08.848062 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 291/617] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:38:08 2022] GET /compute/v2.1/servers/be34b51d-aa45-4540-959d-a0f61d775992 => generated 1267 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:38:09.432223 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [req-a15e323e-ecfa-41a8-8d50-1b2e790d3cdf req-2749bc8c-7ef1-48b2-8d65-10414b9ac2c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea26410d-7ad5-47e7-8d4a-ade5827e511c", "tag": "b747c4d8-3ba6-4e33-ada3-b81ba17dac29"}]} {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:38:09.444058 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [req-a15e323e-ecfa-41a8-8d50-1b2e790d3cdf req-2749bc8c-7ef1-48b2-8d65-10414b9ac2c9 service nova] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:09.445243 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [req-a15e323e-ecfa-41a8-8d50-1b2e790d3cdf req-2749bc8c-7ef1-48b2-8d65-10414b9ac2c9 service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:09.447713 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [req-a15e323e-ecfa-41a8-8d50-1b2e790d3cdf req-2749bc8c-7ef1-48b2-8d65-10414b9ac2c9 service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:09.474070 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.compute.server_external_events [req-a15e323e-ecfa-41a8-8d50-1b2e790d3cdf req-2749bc8c-7ef1-48b2-8d65-10414b9ac2c9 service nova] Creating event network-changed:b747c4d8-3ba6-4e33-ada3-b81ba17dac29 for instance ea26410d-7ad5-47e7-8d4a-ade5827e511c on hv-cinder-85427 Aug 24 11:38:09.480977 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [req-a15e323e-ecfa-41a8-8d50-1b2e790d3cdf req-2749bc8c-7ef1-48b2-8d65-10414b9ac2c9 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.394104 Aug 24 11:38:09.485397 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 327/618] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Aug 24 11:38:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:38:09.732972 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-f27225ab-ccb7-4f97-ad47-19ebde1b1cfd tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:38:09.733854 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-f27225ab-ccb7-4f97-ad47-19ebde1b1cfd tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: 2e661217-fb1a-48ad-9f1b-47985a4074de] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:38:09.740534 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-f27225ab-ccb7-4f97-ad47-19ebde1b1cfd tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:09.741443 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-f27225ab-ccb7-4f97-ad47-19ebde1b1cfd tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:09.742063 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-f27225ab-ccb7-4f97-ad47-19ebde1b1cfd tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:09.748274 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-f27225ab-ccb7-4f97-ad47-19ebde1b1cfd tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:09.748274 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-f27225ab-ccb7-4f97-ad47-19ebde1b1cfd tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:09.748274 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-f27225ab-ccb7-4f97-ad47-19ebde1b1cfd tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:09.876238 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-243f988d-2bbf-480e-940c-632d8594abe2 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:38:09.877731 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-243f988d-2bbf-480e-940c-632d8594abe2 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] [instance: be34b51d-aa45-4540-959d-a0f61d775992] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:38:09.887684 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-243f988d-2bbf-480e-940c-632d8594abe2 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:09.888171 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-243f988d-2bbf-480e-940c-632d8594abe2 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:09.888730 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-243f988d-2bbf-480e-940c-632d8594abe2 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:09.889584 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-243f988d-2bbf-480e-940c-632d8594abe2 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:09.890187 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-243f988d-2bbf-480e-940c-632d8594abe2 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:09.890648 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-243f988d-2bbf-480e-940c-632d8594abe2 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:10.004947 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-f27225ab-ccb7-4f97-ad47-19ebde1b1cfd tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:10.029585 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-f27225ab-ccb7-4f97-ad47-19ebde1b1cfd tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:10.031513 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-f27225ab-ccb7-4f97-ad47-19ebde1b1cfd tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:10.033026 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-f27225ab-ccb7-4f97-ad47-19ebde1b1cfd tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de" status: 200 len: 1724 microversion: 2.20 time: 0.304461 Aug 24 11:38:10.033810 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 292/619] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:38:09 2022] GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de => generated 1724 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 11:38:10.155127 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-243f988d-2bbf-480e-940c-632d8594abe2 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b82b6f568bd41fa9d6b44facb766e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ef3fc15a0147e39228729d2b5b2631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:10.167657 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-243f988d-2bbf-480e-940c-632d8594abe2 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] 10.222.0.84 "GET /compute/v2.1/servers/be34b51d-aa45-4540-959d-a0f61d775992" status: 200 len: 1267 microversion: 2.1 time: 0.300082 Aug 24 11:38:10.168602 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 328/620] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:38:09 2022] GET /compute/v2.1/servers/be34b51d-aa45-4540-959d-a0f61d775992 => generated 1267 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:38:10.556963 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [req-0fb07449-ef21-49ef-ba5c-81e5c662e67d req-ca2e91a8-9ec5-4919-a4df-f043336b6a99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e661217-fb1a-48ad-9f1b-47985a4074de", "name": "network-vif-unplugged", "status": "completed", "tag": "e82d60e7-8369-4554-9da0-a0a3a25fe586"}]} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:38:10.565311 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_api:SELECT=88 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:38:10.571529 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-0fb07449-ef21-49ef-ba5c-81e5c662e67d req-ca2e91a8-9ec5-4919-a4df-f043336b6a99 service nova] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:10.572467 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-0fb07449-ef21-49ef-ba5c-81e5c662e67d req-ca2e91a8-9ec5-4919-a4df-f043336b6a99 service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:10.573185 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-0fb07449-ef21-49ef-ba5c-81e5c662e67d req-ca2e91a8-9ec5-4919-a4df-f043336b6a99 service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:10.586429 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.compute.server_external_events [req-0fb07449-ef21-49ef-ba5c-81e5c662e67d req-ca2e91a8-9ec5-4919-a4df-f043336b6a99 service nova] Creating event network-vif-unplugged:e82d60e7-8369-4554-9da0-a0a3a25fe586 for instance 2e661217-fb1a-48ad-9f1b-47985a4074de on hv-cinder-85427 Aug 24 11:38:10.597484 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [req-0fb07449-ef21-49ef-ba5c-81e5c662e67d req-ca2e91a8-9ec5-4919-a4df-f043336b6a99 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044655 Aug 24 11:38:10.598767 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 293/621] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Aug 24 11:38:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:38:11.083620 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-fb3295f9-a51a-4d09-bc8f-c8a7cfa66040 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:38:11.092905 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-fb3295f9-a51a-4d09-bc8f-c8a7cfa66040 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: 2e661217-fb1a-48ad-9f1b-47985a4074de] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:38:11.114915 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-fb3295f9-a51a-4d09-bc8f-c8a7cfa66040 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:11.115588 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-fb3295f9-a51a-4d09-bc8f-c8a7cfa66040 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:11.116346 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-fb3295f9-a51a-4d09-bc8f-c8a7cfa66040 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:11.117490 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-fb3295f9-a51a-4d09-bc8f-c8a7cfa66040 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:11.118486 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-fb3295f9-a51a-4d09-bc8f-c8a7cfa66040 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:11.119489 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-fb3295f9-a51a-4d09-bc8f-c8a7cfa66040 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:11.201506 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-cb8bddda-d87a-4393-a2de-f5a0610132f0 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:38:11.202413 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-cb8bddda-d87a-4393-a2de-f5a0610132f0 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] [instance: be34b51d-aa45-4540-959d-a0f61d775992] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:38:11.216688 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-cb8bddda-d87a-4393-a2de-f5a0610132f0 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:11.217234 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-cb8bddda-d87a-4393-a2de-f5a0610132f0 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:11.217674 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-cb8bddda-d87a-4393-a2de-f5a0610132f0 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:11.218404 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-cb8bddda-d87a-4393-a2de-f5a0610132f0 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:11.218863 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-cb8bddda-d87a-4393-a2de-f5a0610132f0 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:11.219292 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-cb8bddda-d87a-4393-a2de-f5a0610132f0 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:11.400515 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-fb3295f9-a51a-4d09-bc8f-c8a7cfa66040 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:11.420918 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-fb3295f9-a51a-4d09-bc8f-c8a7cfa66040 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:11.425471 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-fb3295f9-a51a-4d09-bc8f-c8a7cfa66040 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:11.427768 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-fb3295f9-a51a-4d09-bc8f-c8a7cfa66040 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de" status: 200 len: 1724 microversion: 2.20 time: 0.353659 Aug 24 11:38:11.432418 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 329/622] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:38:11 2022] GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de => generated 1724 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:38:11.646056 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-cb8bddda-d87a-4393-a2de-f5a0610132f0 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b82b6f568bd41fa9d6b44facb766e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ef3fc15a0147e39228729d2b5b2631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:11.669013 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-cb8bddda-d87a-4393-a2de-f5a0610132f0 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] 10.222.0.84 "GET /compute/v2.1/servers/be34b51d-aa45-4540-959d-a0f61d775992" status: 200 len: 1453 microversion: 2.1 time: 0.471158 Aug 24 11:38:11.672453 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 294/623] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:38:11 2022] GET /compute/v2.1/servers/be34b51d-aa45-4540-959d-a0f61d775992 => generated 1453 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:38:11.698442 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-52057282-e469-43eb-a5aa-4d50c11b8ca6 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:38:11.699324 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-52057282-e469-43eb-a5aa-4d50c11b8ca6 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] [instance: be34b51d-aa45-4540-959d-a0f61d775992] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:38:11.709907 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-52057282-e469-43eb-a5aa-4d50c11b8ca6 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:11.710891 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-52057282-e469-43eb-a5aa-4d50c11b8ca6 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:11.711535 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-52057282-e469-43eb-a5aa-4d50c11b8ca6 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:11.712236 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-52057282-e469-43eb-a5aa-4d50c11b8ca6 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:11.712687 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-52057282-e469-43eb-a5aa-4d50c11b8ca6 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:11.713306 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-52057282-e469-43eb-a5aa-4d50c11b8ca6 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:11.971426 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-52057282-e469-43eb-a5aa-4d50c11b8ca6 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b82b6f568bd41fa9d6b44facb766e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ef3fc15a0147e39228729d2b5b2631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:11.988040 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-52057282-e469-43eb-a5aa-4d50c11b8ca6 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] 10.222.0.84 "GET /compute/v2.1/servers/be34b51d-aa45-4540-959d-a0f61d775992" status: 200 len: 1453 microversion: 2.1 time: 0.292868 Aug 24 11:38:11.992075 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 330/624] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:38:11 2022] GET /compute/v2.1/servers/be34b51d-aa45-4540-959d-a0f61d775992 => generated 1453 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:38:12.460392 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-8ecd35e8-cdb4-466e-8610-5ff18623f948 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:38:12.461259 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-8ecd35e8-cdb4-466e-8610-5ff18623f948 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: 2e661217-fb1a-48ad-9f1b-47985a4074de] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:38:12.473724 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8ecd35e8-cdb4-466e-8610-5ff18623f948 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:12.484488 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8ecd35e8-cdb4-466e-8610-5ff18623f948 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:12.484488 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8ecd35e8-cdb4-466e-8610-5ff18623f948 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:12.484488 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8ecd35e8-cdb4-466e-8610-5ff18623f948 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:12.484488 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8ecd35e8-cdb4-466e-8610-5ff18623f948 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:12.486707 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8ecd35e8-cdb4-466e-8610-5ff18623f948 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:12.973564 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-8ecd35e8-cdb4-466e-8610-5ff18623f948 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:12.987576 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-8ecd35e8-cdb4-466e-8610-5ff18623f948 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:12.989091 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-8ecd35e8-cdb4-466e-8610-5ff18623f948 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:12.990273 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-8ecd35e8-cdb4-466e-8610-5ff18623f948 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de" status: 200 len: 1727 microversion: 2.20 time: 0.535849 Aug 24 11:38:12.999471 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 295/625] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:38:12 2022] GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de => generated 1727 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:38:13.069846 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-0e813660-a2cc-4a4b-9828-0954ddbf2033 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3849f947-d442-4b46-890b-db2ae706ef5a"}} {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:38:13.094921 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-0e813660-a2cc-4a4b-9828-0954ddbf2033 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: 2e661217-fb1a-48ad-9f1b-47985a4074de] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:38:13.107713 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-0e813660-a2cc-4a4b-9828-0954ddbf2033 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:13.109189 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-0e813660-a2cc-4a4b-9828-0954ddbf2033 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:13.110145 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-0e813660-a2cc-4a4b-9828-0954ddbf2033 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:13.111207 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-0e813660-a2cc-4a4b-9828-0954ddbf2033 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:13.112476 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-0e813660-a2cc-4a4b-9828-0954ddbf2033 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:13.113230 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-0e813660-a2cc-4a4b-9828-0954ddbf2033 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:14.665927 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-0e813660-a2cc-4a4b-9828-0954ddbf2033 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "POST /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.630009 Aug 24 11:38:14.666697 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 331/626] 10.222.0.84 () {62 vars in 1364 bytes} [Wed Aug 24 11:38:13 2022] POST /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de/os-volume_attachments => generated 188 bytes in 1634 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 11:38:14.843997 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-fc693337-c49a-4b74-aec0-ff3305aa4ba6 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:38:14.845105 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-fc693337-c49a-4b74-aec0-ff3305aa4ba6 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: 2e661217-fb1a-48ad-9f1b-47985a4074de] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:38:14.859933 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-fc693337-c49a-4b74-aec0-ff3305aa4ba6 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:14.861801 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-fc693337-c49a-4b74-aec0-ff3305aa4ba6 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:14.864094 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-fc693337-c49a-4b74-aec0-ff3305aa4ba6 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:14.865777 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-fc693337-c49a-4b74-aec0-ff3305aa4ba6 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:14.866439 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-fc693337-c49a-4b74-aec0-ff3305aa4ba6 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:14.867098 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-fc693337-c49a-4b74-aec0-ff3305aa4ba6 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:15.023200 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-63bfe619-dc01-4996-aa36-666777852f75 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Action: 'create', calling method: .version_select at 0x7f0e2a4888b0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1778781973", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIXh/Oi2TOad4NvwA1btPHufCfnqRW+J1qEPzNTBaisXjRQGoXpIc7d8OMs/96yt/Dfl4Gn4ZD2/FUy+CKzhDwe+nTjWojnb4N9gcWrm9vr4A1b0fBAJQ/w4U1eHkipT0Q=="}} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:38:15.039325 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.quota [None req-63bfe619-dc01-4996-aa36-666777852f75 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Getting quotas for project 31998483af514a1a8f87ab761d5cf3ba. Resources: {'key_pairs'} {{(pid=124770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:38:15.045456 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.quota [None req-63bfe619-dc01-4996-aa36-666777852f75 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Getting quotas for user 7ac5dffd3204413a8834d05db267c3ab and project 31998483af514a1a8f87ab761d5cf3ba. Resources: {'key_pairs'} {{(pid=124770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:38:15.066766 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-fc693337-c49a-4b74-aec0-ff3305aa4ba6 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: 2e661217-fb1a-48ad-9f1b-47985a4074de] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=124769) unshelve /opt/stack/nova/nova/compute/api.py:4578}} Aug 24 11:38:15.148769 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-63bfe619-dc01-4996-aa36-666777852f75 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] 10.222.0.84 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.334990 Aug 24 11:38:15.149683 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 296/627] 10.222.0.84 () {60 vars in 1159 bytes} [Wed Aug 24 11:38:14 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:38:15.448017 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-fc693337-c49a-4b74-aec0-ff3305aa4ba6 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "POST /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de/action" status: 202 len: 0 microversion: 2.20 time: 0.608930 Aug 24 11:38:15.452663 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 332/628] 10.222.0.84 () {62 vars in 1319 bytes} [Wed Aug 24 11:38:14 2022] POST /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de/action => generated 0 bytes in 610 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 11:38:15.462547 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-77cb8320-e52f-44e7-a22c-9dc1b897ff86 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:38:15.463463 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-77cb8320-e52f-44e7-a22c-9dc1b897ff86 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: 2e661217-fb1a-48ad-9f1b-47985a4074de] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:38:15.476075 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-77cb8320-e52f-44e7-a22c-9dc1b897ff86 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:15.477633 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-77cb8320-e52f-44e7-a22c-9dc1b897ff86 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:15.484598 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-77cb8320-e52f-44e7-a22c-9dc1b897ff86 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:15.484598 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-77cb8320-e52f-44e7-a22c-9dc1b897ff86 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:15.484598 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-77cb8320-e52f-44e7-a22c-9dc1b897ff86 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:15.484598 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-77cb8320-e52f-44e7-a22c-9dc1b897ff86 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:15.820139 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-77cb8320-e52f-44e7-a22c-9dc1b897ff86 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:15.831756 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-77cb8320-e52f-44e7-a22c-9dc1b897ff86 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:15.835253 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-77cb8320-e52f-44e7-a22c-9dc1b897ff86 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:15.838305 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-77cb8320-e52f-44e7-a22c-9dc1b897ff86 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de" status: 200 len: 1753 microversion: 2.20 time: 0.383266 Aug 24 11:38:15.839280 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 297/629] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:38:15 2022] GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de => generated 1753 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:38:15.887494 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [req-e79e66d4-b2ba-4d2a-b25f-adf25d715763 req-9a313da7-6981-4ec2-b396-4e8f8ba850c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be34b51d-aa45-4540-959d-a0f61d775992", "tag": "bc48e073-4e3e-414c-bc63-e35b79ac195d"}]} {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:38:15.914049 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [req-e79e66d4-b2ba-4d2a-b25f-adf25d715763 req-9a313da7-6981-4ec2-b396-4e8f8ba850c8 service nova] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:15.915282 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [req-e79e66d4-b2ba-4d2a-b25f-adf25d715763 req-9a313da7-6981-4ec2-b396-4e8f8ba850c8 service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:15.916326 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [req-e79e66d4-b2ba-4d2a-b25f-adf25d715763 req-9a313da7-6981-4ec2-b396-4e8f8ba850c8 service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:15.963881 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.compute.server_external_events [req-e79e66d4-b2ba-4d2a-b25f-adf25d715763 req-9a313da7-6981-4ec2-b396-4e8f8ba850c8 service nova] Creating event network-changed:bc48e073-4e3e-414c-bc63-e35b79ac195d for instance be34b51d-aa45-4540-959d-a0f61d775992 on hv-cinder-85427 Aug 24 11:38:15.982778 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [req-e79e66d4-b2ba-4d2a-b25f-adf25d715763 req-9a313da7-6981-4ec2-b396-4e8f8ba850c8 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117395 Aug 24 11:38:15.984603 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 333/630] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Aug 24 11:38:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:38:16.873685 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-adb0b244-c196-49fc-89d8-2fb815fcf52b tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:38:16.877540 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-adb0b244-c196-49fc-89d8-2fb815fcf52b tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: 2e661217-fb1a-48ad-9f1b-47985a4074de] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:38:16.907911 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-adb0b244-c196-49fc-89d8-2fb815fcf52b tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:16.912229 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-adb0b244-c196-49fc-89d8-2fb815fcf52b tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:16.913109 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-adb0b244-c196-49fc-89d8-2fb815fcf52b tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:16.919835 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-adb0b244-c196-49fc-89d8-2fb815fcf52b tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:16.920630 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-adb0b244-c196-49fc-89d8-2fb815fcf52b tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:16.923232 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-adb0b244-c196-49fc-89d8-2fb815fcf52b tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:16.994645 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_cell1:SELECT=100 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:38:17.188113 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-adb0b244-c196-49fc-89d8-2fb815fcf52b tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:17.208735 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-adb0b244-c196-49fc-89d8-2fb815fcf52b tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:17.213074 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-adb0b244-c196-49fc-89d8-2fb815fcf52b tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:17.215523 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-adb0b244-c196-49fc-89d8-2fb815fcf52b tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de" status: 200 len: 1753 microversion: 2.20 time: 0.349842 Aug 24 11:38:17.216786 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 298/631] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:38:16 2022] GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de => generated 1753 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:38:18.254381 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-26e1d234-6f9d-4d6e-9ea7-59ab90a45ba4 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:38:18.255687 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-26e1d234-6f9d-4d6e-9ea7-59ab90a45ba4 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: 2e661217-fb1a-48ad-9f1b-47985a4074de] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:38:18.264149 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-26e1d234-6f9d-4d6e-9ea7-59ab90a45ba4 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:18.264922 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-26e1d234-6f9d-4d6e-9ea7-59ab90a45ba4 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:18.265373 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-26e1d234-6f9d-4d6e-9ea7-59ab90a45ba4 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:18.266056 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-26e1d234-6f9d-4d6e-9ea7-59ab90a45ba4 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:18.266508 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-26e1d234-6f9d-4d6e-9ea7-59ab90a45ba4 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:18.266927 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-26e1d234-6f9d-4d6e-9ea7-59ab90a45ba4 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:18.506742 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-26e1d234-6f9d-4d6e-9ea7-59ab90a45ba4 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:18.516683 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-26e1d234-6f9d-4d6e-9ea7-59ab90a45ba4 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:18.518333 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-26e1d234-6f9d-4d6e-9ea7-59ab90a45ba4 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:18.519540 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-26e1d234-6f9d-4d6e-9ea7-59ab90a45ba4 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de" status: 200 len: 1755 microversion: 2.20 time: 0.272653 Aug 24 11:38:18.520510 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 334/632] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:38:18 2022] GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de => generated 1755 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:38:19.557044 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-a48ff280-755f-457e-9715-1baf608ce1f6 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:38:19.558312 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-a48ff280-755f-457e-9715-1baf608ce1f6 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: 2e661217-fb1a-48ad-9f1b-47985a4074de] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:38:19.567933 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a48ff280-755f-457e-9715-1baf608ce1f6 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:19.568480 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a48ff280-755f-457e-9715-1baf608ce1f6 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:19.568966 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a48ff280-755f-457e-9715-1baf608ce1f6 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:19.569904 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a48ff280-755f-457e-9715-1baf608ce1f6 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:19.570705 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a48ff280-755f-457e-9715-1baf608ce1f6 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:19.571332 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a48ff280-755f-457e-9715-1baf608ce1f6 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:19.769421 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-a48ff280-755f-457e-9715-1baf608ce1f6 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:19.780777 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-a48ff280-755f-457e-9715-1baf608ce1f6 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:19.782687 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-a48ff280-755f-457e-9715-1baf608ce1f6 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:19.784115 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-a48ff280-755f-457e-9715-1baf608ce1f6 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de" status: 200 len: 1755 microversion: 2.20 time: 0.231665 Aug 24 11:38:19.784742 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 299/633] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:38:19 2022] GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de => generated 1755 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 11:38:20.812991 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-8d8856a5-e854-4675-af60-2d8e03e69398 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:38:20.814131 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-8d8856a5-e854-4675-af60-2d8e03e69398 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: 2e661217-fb1a-48ad-9f1b-47985a4074de] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:38:20.822026 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-8d8856a5-e854-4675-af60-2d8e03e69398 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:20.822525 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-8d8856a5-e854-4675-af60-2d8e03e69398 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:20.822967 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-8d8856a5-e854-4675-af60-2d8e03e69398 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:20.823699 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-8d8856a5-e854-4675-af60-2d8e03e69398 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:20.824136 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-8d8856a5-e854-4675-af60-2d8e03e69398 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:20.824560 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-8d8856a5-e854-4675-af60-2d8e03e69398 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:20.841085 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG dbcounter [-] [124769] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=124769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:38:20.978639 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-8d8856a5-e854-4675-af60-2d8e03e69398 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:20.990886 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-8d8856a5-e854-4675-af60-2d8e03e69398 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:20.994535 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-8d8856a5-e854-4675-af60-2d8e03e69398 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:20.994535 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-8d8856a5-e854-4675-af60-2d8e03e69398 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de" status: 200 len: 1755 microversion: 2.20 time: 0.186995 Aug 24 11:38:20.994535 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 335/634] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:38:20 2022] GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de => generated 1755 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:38:22.024870 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-734d49ad-6d37-467a-8adc-dc800aaa1fa4 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:38:22.025636 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-734d49ad-6d37-467a-8adc-dc800aaa1fa4 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: 2e661217-fb1a-48ad-9f1b-47985a4074de] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:38:22.033651 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-734d49ad-6d37-467a-8adc-dc800aaa1fa4 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:22.034221 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-734d49ad-6d37-467a-8adc-dc800aaa1fa4 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:22.034662 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-734d49ad-6d37-467a-8adc-dc800aaa1fa4 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:22.035358 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-734d49ad-6d37-467a-8adc-dc800aaa1fa4 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:22.035807 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-734d49ad-6d37-467a-8adc-dc800aaa1fa4 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:22.036222 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-734d49ad-6d37-467a-8adc-dc800aaa1fa4 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:22.287940 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-734d49ad-6d37-467a-8adc-dc800aaa1fa4 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:22.302274 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-734d49ad-6d37-467a-8adc-dc800aaa1fa4 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:22.304005 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-734d49ad-6d37-467a-8adc-dc800aaa1fa4 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:22.305394 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-734d49ad-6d37-467a-8adc-dc800aaa1fa4 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de" status: 200 len: 1811 microversion: 2.20 time: 0.285764 Aug 24 11:38:22.305994 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 300/635] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:38:22 2022] GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de => generated 1811 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 11:38:23.332122 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-491b6367-b1a8-4933-ab42-6dc98f2af59c tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:38:23.332949 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-491b6367-b1a8-4933-ab42-6dc98f2af59c tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: 2e661217-fb1a-48ad-9f1b-47985a4074de] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:38:23.342117 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-491b6367-b1a8-4933-ab42-6dc98f2af59c tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:23.342671 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-491b6367-b1a8-4933-ab42-6dc98f2af59c tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:23.343156 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-491b6367-b1a8-4933-ab42-6dc98f2af59c tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:23.343989 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-491b6367-b1a8-4933-ab42-6dc98f2af59c tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:23.344545 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-491b6367-b1a8-4933-ab42-6dc98f2af59c tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:23.345138 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-491b6367-b1a8-4933-ab42-6dc98f2af59c tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:23.590742 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-491b6367-b1a8-4933-ab42-6dc98f2af59c tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:23.607202 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-491b6367-b1a8-4933-ab42-6dc98f2af59c tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:23.610455 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-491b6367-b1a8-4933-ab42-6dc98f2af59c tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:23.613659 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-491b6367-b1a8-4933-ab42-6dc98f2af59c tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de" status: 200 len: 1811 microversion: 2.20 time: 0.287705 Aug 24 11:38:23.616002 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 336/636] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:38:23 2022] GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de => generated 1811 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:38:24.655284 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-7376e67e-c346-401d-ba6a-59e06e8ed0f1 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:38:24.656621 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-7376e67e-c346-401d-ba6a-59e06e8ed0f1 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: 2e661217-fb1a-48ad-9f1b-47985a4074de] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:38:24.666583 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-7376e67e-c346-401d-ba6a-59e06e8ed0f1 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:24.667132 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-7376e67e-c346-401d-ba6a-59e06e8ed0f1 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:24.667675 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-7376e67e-c346-401d-ba6a-59e06e8ed0f1 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:24.669886 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-7376e67e-c346-401d-ba6a-59e06e8ed0f1 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:24.669886 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-7376e67e-c346-401d-ba6a-59e06e8ed0f1 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:24.669886 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-7376e67e-c346-401d-ba6a-59e06e8ed0f1 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:24.872437 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-7376e67e-c346-401d-ba6a-59e06e8ed0f1 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:24.887978 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-7376e67e-c346-401d-ba6a-59e06e8ed0f1 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:24.891737 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-7376e67e-c346-401d-ba6a-59e06e8ed0f1 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:24.896582 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-7376e67e-c346-401d-ba6a-59e06e8ed0f1 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de" status: 200 len: 1811 microversion: 2.20 time: 0.243871 Aug 24 11:38:24.896582 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 301/637] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:38:24 2022] GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de => generated 1811 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 11:38:25.924339 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-eeb91e49-097d-47a9-b4f0-b2c91fb82f01 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:38:25.925375 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-eeb91e49-097d-47a9-b4f0-b2c91fb82f01 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: 2e661217-fb1a-48ad-9f1b-47985a4074de] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:38:25.931954 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-eeb91e49-097d-47a9-b4f0-b2c91fb82f01 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:25.932450 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-eeb91e49-097d-47a9-b4f0-b2c91fb82f01 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:25.932933 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-eeb91e49-097d-47a9-b4f0-b2c91fb82f01 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:25.933688 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-eeb91e49-097d-47a9-b4f0-b2c91fb82f01 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:25.934419 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-eeb91e49-097d-47a9-b4f0-b2c91fb82f01 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:25.935183 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-eeb91e49-097d-47a9-b4f0-b2c91fb82f01 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:26.160107 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-eeb91e49-097d-47a9-b4f0-b2c91fb82f01 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:26.181936 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-eeb91e49-097d-47a9-b4f0-b2c91fb82f01 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:26.184835 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-eeb91e49-097d-47a9-b4f0-b2c91fb82f01 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:26.186343 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-eeb91e49-097d-47a9-b4f0-b2c91fb82f01 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de" status: 200 len: 1811 microversion: 2.20 time: 0.269252 Aug 24 11:38:26.187060 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 337/638] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:38:25 2022] GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de => generated 1811 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:38:27.219629 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-2995698c-27ea-4eb7-99c3-99206c9db3ac tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:38:27.222650 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-2995698c-27ea-4eb7-99c3-99206c9db3ac tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: 2e661217-fb1a-48ad-9f1b-47985a4074de] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:38:27.227637 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_cell0:SELECT=4 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:38:27.246793 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-2995698c-27ea-4eb7-99c3-99206c9db3ac tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:27.246793 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-2995698c-27ea-4eb7-99c3-99206c9db3ac tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:27.247386 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-2995698c-27ea-4eb7-99c3-99206c9db3ac tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:27.248960 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-2995698c-27ea-4eb7-99c3-99206c9db3ac tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:27.250325 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-2995698c-27ea-4eb7-99c3-99206c9db3ac tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:27.251830 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-2995698c-27ea-4eb7-99c3-99206c9db3ac tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:27.492471 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-2995698c-27ea-4eb7-99c3-99206c9db3ac tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:27.511937 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-2995698c-27ea-4eb7-99c3-99206c9db3ac tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:27.515314 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-2995698c-27ea-4eb7-99c3-99206c9db3ac tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:27.518507 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-2995698c-27ea-4eb7-99c3-99206c9db3ac tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de" status: 200 len: 1811 microversion: 2.20 time: 0.308041 Aug 24 11:38:27.519537 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 302/639] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:38:27 2022] GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de => generated 1811 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:38:28.549779 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-b4cf3265-0645-4927-9a8b-0408fa4e7e4a tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:38:28.550666 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-b4cf3265-0645-4927-9a8b-0408fa4e7e4a tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: 2e661217-fb1a-48ad-9f1b-47985a4074de] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:38:28.554345 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG dbcounter [-] [124769] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=1 {{(pid=124769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:38:28.560627 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-b4cf3265-0645-4927-9a8b-0408fa4e7e4a tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:28.561490 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-b4cf3265-0645-4927-9a8b-0408fa4e7e4a tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:28.562145 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-b4cf3265-0645-4927-9a8b-0408fa4e7e4a tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:28.563414 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-b4cf3265-0645-4927-9a8b-0408fa4e7e4a tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:28.564338 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-b4cf3265-0645-4927-9a8b-0408fa4e7e4a tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:28.565085 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-b4cf3265-0645-4927-9a8b-0408fa4e7e4a tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:28.807037 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-b4cf3265-0645-4927-9a8b-0408fa4e7e4a tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:28.821233 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-b4cf3265-0645-4927-9a8b-0408fa4e7e4a tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:28.829640 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-b4cf3265-0645-4927-9a8b-0408fa4e7e4a tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:28.829640 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-b4cf3265-0645-4927-9a8b-0408fa4e7e4a tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de" status: 200 len: 1811 microversion: 2.20 time: 0.282662 Aug 24 11:38:28.829640 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 338/640] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:38:28 2022] GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de => generated 1811 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 11:38:29.848076 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-727c4a8e-b4a6-477e-9c80-a230d8133919 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6427e65b-6458-4f62-9b33-99bdc9a6a645"}} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:38:29.851413 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-727c4a8e-b4a6-477e-9c80-a230d8133919 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: a8ce5b7f-1b02-4746-9aa5-0d826615df18] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:38:29.855149 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-c0886b09-76ee-4389-8137-37a216def033 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:38:29.855764 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-c0886b09-76ee-4389-8137-37a216def033 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: 2e661217-fb1a-48ad-9f1b-47985a4074de] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:38:29.858151 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-727c4a8e-b4a6-477e-9c80-a230d8133919 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:29.858644 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-727c4a8e-b4a6-477e-9c80-a230d8133919 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:29.859171 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-727c4a8e-b4a6-477e-9c80-a230d8133919 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:29.859842 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-727c4a8e-b4a6-477e-9c80-a230d8133919 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:29.860643 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-727c4a8e-b4a6-477e-9c80-a230d8133919 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:29.860881 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-727c4a8e-b4a6-477e-9c80-a230d8133919 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:29.862679 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-c0886b09-76ee-4389-8137-37a216def033 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:29.872027 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-c0886b09-76ee-4389-8137-37a216def033 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:29.872027 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-c0886b09-76ee-4389-8137-37a216def033 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:29.872027 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-c0886b09-76ee-4389-8137-37a216def033 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:29.872027 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-c0886b09-76ee-4389-8137-37a216def033 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:29.872438 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-c0886b09-76ee-4389-8137-37a216def033 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:30.090793 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-c0886b09-76ee-4389-8137-37a216def033 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:30.106389 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-c0886b09-76ee-4389-8137-37a216def033 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:30.109232 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-c0886b09-76ee-4389-8137-37a216def033 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:30.111996 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-c0886b09-76ee-4389-8137-37a216def033 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de" status: 200 len: 1811 microversion: 2.20 time: 0.262864 Aug 24 11:38:30.113290 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 339/641] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:38:29 2022] GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de => generated 1811 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:38:31.154457 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-50f9ecf3-a5c6-45a1-9889-86b370d399e9 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:38:31.155220 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-50f9ecf3-a5c6-45a1-9889-86b370d399e9 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: 2e661217-fb1a-48ad-9f1b-47985a4074de] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:38:31.163033 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-50f9ecf3-a5c6-45a1-9889-86b370d399e9 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:31.163535 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-50f9ecf3-a5c6-45a1-9889-86b370d399e9 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:31.163982 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-50f9ecf3-a5c6-45a1-9889-86b370d399e9 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:31.164702 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-50f9ecf3-a5c6-45a1-9889-86b370d399e9 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:31.165198 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-50f9ecf3-a5c6-45a1-9889-86b370d399e9 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:31.165631 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-50f9ecf3-a5c6-45a1-9889-86b370d399e9 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:31.384861 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-50f9ecf3-a5c6-45a1-9889-86b370d399e9 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:31.399586 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-50f9ecf3-a5c6-45a1-9889-86b370d399e9 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:31.415900 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-50f9ecf3-a5c6-45a1-9889-86b370d399e9 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:31.415900 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-50f9ecf3-a5c6-45a1-9889-86b370d399e9 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de" status: 200 len: 1811 microversion: 2.20 time: 0.254144 Aug 24 11:38:31.415900 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 340/642] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:38:31 2022] GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de => generated 1811 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:38:32.430988 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-08a119c5-b025-475f-bc4b-753f250a4c79 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:38:32.432343 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-08a119c5-b025-475f-bc4b-753f250a4c79 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: 2e661217-fb1a-48ad-9f1b-47985a4074de] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:38:32.442108 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-08a119c5-b025-475f-bc4b-753f250a4c79 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:32.442902 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-08a119c5-b025-475f-bc4b-753f250a4c79 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:32.443582 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-08a119c5-b025-475f-bc4b-753f250a4c79 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:32.444761 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-08a119c5-b025-475f-bc4b-753f250a4c79 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:32.445619 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-08a119c5-b025-475f-bc4b-753f250a4c79 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:32.446375 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-08a119c5-b025-475f-bc4b-753f250a4c79 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:32.657634 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-08a119c5-b025-475f-bc4b-753f250a4c79 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:32.674860 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-08a119c5-b025-475f-bc4b-753f250a4c79 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:32.679738 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-08a119c5-b025-475f-bc4b-753f250a4c79 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:32.679738 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-08a119c5-b025-475f-bc4b-753f250a4c79 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de" status: 200 len: 1811 microversion: 2.20 time: 0.254104 Aug 24 11:38:32.679738 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 341/643] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:38:32 2022] GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de => generated 1811 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:38:33.711856 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-f490bec0-2213-4b3c-ba8d-685d71ae9823 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:38:33.714032 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-f490bec0-2213-4b3c-ba8d-685d71ae9823 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: 2e661217-fb1a-48ad-9f1b-47985a4074de] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:38:33.733844 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f490bec0-2213-4b3c-ba8d-685d71ae9823 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:33.734606 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f490bec0-2213-4b3c-ba8d-685d71ae9823 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:33.735161 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f490bec0-2213-4b3c-ba8d-685d71ae9823 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:33.735848 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f490bec0-2213-4b3c-ba8d-685d71ae9823 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:33.736435 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f490bec0-2213-4b3c-ba8d-685d71ae9823 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:33.736890 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f490bec0-2213-4b3c-ba8d-685d71ae9823 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:33.918390 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-f490bec0-2213-4b3c-ba8d-685d71ae9823 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:33.929486 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-f490bec0-2213-4b3c-ba8d-685d71ae9823 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:33.930982 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-f490bec0-2213-4b3c-ba8d-685d71ae9823 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:33.933029 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-f490bec0-2213-4b3c-ba8d-685d71ae9823 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de" status: 200 len: 1811 microversion: 2.20 time: 0.228470 Aug 24 11:38:33.933880 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 342/644] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:38:33 2022] GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de => generated 1811 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 11:38:34.967579 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-cb8f34b4-313c-4a14-a396-f7006773c6bb tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:38:34.968282 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-cb8f34b4-313c-4a14-a396-f7006773c6bb tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: 2e661217-fb1a-48ad-9f1b-47985a4074de] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:38:34.977681 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-cb8f34b4-313c-4a14-a396-f7006773c6bb tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:34.978545 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-cb8f34b4-313c-4a14-a396-f7006773c6bb tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:34.979343 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-cb8f34b4-313c-4a14-a396-f7006773c6bb tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:34.980607 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-cb8f34b4-313c-4a14-a396-f7006773c6bb tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:34.981596 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-cb8f34b4-313c-4a14-a396-f7006773c6bb tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:34.982339 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-cb8f34b4-313c-4a14-a396-f7006773c6bb tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:35.165398 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-cb8f34b4-313c-4a14-a396-f7006773c6bb tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:35.180820 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-cb8f34b4-313c-4a14-a396-f7006773c6bb tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:35.182335 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-cb8f34b4-313c-4a14-a396-f7006773c6bb tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:35.184321 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-cb8f34b4-313c-4a14-a396-f7006773c6bb tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de" status: 200 len: 1811 microversion: 2.20 time: 0.220511 Aug 24 11:38:35.185296 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 343/645] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:38:34 2022] GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de => generated 1811 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 11:38:36.228259 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-283e2156-c6ef-44a5-831c-f0b8f9e1738f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:38:36.229057 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-283e2156-c6ef-44a5-831c-f0b8f9e1738f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: 2e661217-fb1a-48ad-9f1b-47985a4074de] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:38:36.238008 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-283e2156-c6ef-44a5-831c-f0b8f9e1738f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:36.238621 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-283e2156-c6ef-44a5-831c-f0b8f9e1738f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:36.240909 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-283e2156-c6ef-44a5-831c-f0b8f9e1738f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:36.242535 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-283e2156-c6ef-44a5-831c-f0b8f9e1738f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:36.243901 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-283e2156-c6ef-44a5-831c-f0b8f9e1738f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:36.244392 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-283e2156-c6ef-44a5-831c-f0b8f9e1738f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:36.428352 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-283e2156-c6ef-44a5-831c-f0b8f9e1738f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:36.440433 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-283e2156-c6ef-44a5-831c-f0b8f9e1738f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:36.442037 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-283e2156-c6ef-44a5-831c-f0b8f9e1738f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:36.443277 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-283e2156-c6ef-44a5-831c-f0b8f9e1738f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de" status: 200 len: 1811 microversion: 2.20 time: 0.221837 Aug 24 11:38:36.443830 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 344/646] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:38:36 2022] GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de => generated 1811 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 11:38:37.467769 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-5fa7b2de-59fb-4b98-8b2d-4d3941e520a7 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:38:37.468461 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-5fa7b2de-59fb-4b98-8b2d-4d3941e520a7 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: 2e661217-fb1a-48ad-9f1b-47985a4074de] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:38:37.476346 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-5fa7b2de-59fb-4b98-8b2d-4d3941e520a7 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:37.476872 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-5fa7b2de-59fb-4b98-8b2d-4d3941e520a7 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:37.477316 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-5fa7b2de-59fb-4b98-8b2d-4d3941e520a7 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:37.478024 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-5fa7b2de-59fb-4b98-8b2d-4d3941e520a7 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:37.478479 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-5fa7b2de-59fb-4b98-8b2d-4d3941e520a7 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:37.478910 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-5fa7b2de-59fb-4b98-8b2d-4d3941e520a7 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:37.644051 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-5fa7b2de-59fb-4b98-8b2d-4d3941e520a7 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:37.658456 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-5fa7b2de-59fb-4b98-8b2d-4d3941e520a7 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:37.660163 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-5fa7b2de-59fb-4b98-8b2d-4d3941e520a7 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:37.661415 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-5fa7b2de-59fb-4b98-8b2d-4d3941e520a7 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de" status: 200 len: 1811 microversion: 2.20 time: 0.197974 Aug 24 11:38:37.662098 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 345/647] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:38:37 2022] GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de => generated 1811 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:38:38.694740 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-b2ef0940-5c43-4587-816b-e33bc5d000c2 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:38:38.695440 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-b2ef0940-5c43-4587-816b-e33bc5d000c2 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: 2e661217-fb1a-48ad-9f1b-47985a4074de] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:38:38.701543 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-b2ef0940-5c43-4587-816b-e33bc5d000c2 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:38.702021 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-b2ef0940-5c43-4587-816b-e33bc5d000c2 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:38.702455 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-b2ef0940-5c43-4587-816b-e33bc5d000c2 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:38.703147 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-b2ef0940-5c43-4587-816b-e33bc5d000c2 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:38.704326 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-b2ef0940-5c43-4587-816b-e33bc5d000c2 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:38.704811 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-b2ef0940-5c43-4587-816b-e33bc5d000c2 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:38.850978 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-b2ef0940-5c43-4587-816b-e33bc5d000c2 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:38.860302 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-b2ef0940-5c43-4587-816b-e33bc5d000c2 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:38.861825 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-b2ef0940-5c43-4587-816b-e33bc5d000c2 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:38.862997 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-b2ef0940-5c43-4587-816b-e33bc5d000c2 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de" status: 200 len: 1811 microversion: 2.20 time: 0.172573 Aug 24 11:38:38.863538 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 346/648] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:38:38 2022] GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de => generated 1811 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 11:38:39.855761 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=1 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:38:39.887127 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-6bcbadd4-8429-4f76-b48d-00c8bcb0c5c2 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:38:39.887967 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-6bcbadd4-8429-4f76-b48d-00c8bcb0c5c2 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: 2e661217-fb1a-48ad-9f1b-47985a4074de] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:38:39.895391 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-6bcbadd4-8429-4f76-b48d-00c8bcb0c5c2 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:39.896300 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-6bcbadd4-8429-4f76-b48d-00c8bcb0c5c2 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:39.896300 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-6bcbadd4-8429-4f76-b48d-00c8bcb0c5c2 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:39.897313 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-6bcbadd4-8429-4f76-b48d-00c8bcb0c5c2 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:39.897511 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-6bcbadd4-8429-4f76-b48d-00c8bcb0c5c2 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:39.897919 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-6bcbadd4-8429-4f76-b48d-00c8bcb0c5c2 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:39.978050 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_cell1:SELECT=32 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:38:40.061333 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-6bcbadd4-8429-4f76-b48d-00c8bcb0c5c2 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:40.073132 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-6bcbadd4-8429-4f76-b48d-00c8bcb0c5c2 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:40.074683 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-6bcbadd4-8429-4f76-b48d-00c8bcb0c5c2 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:40.075881 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-6bcbadd4-8429-4f76-b48d-00c8bcb0c5c2 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de" status: 200 len: 1811 microversion: 2.20 time: 0.192873 Aug 24 11:38:40.076449 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 347/649] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:38:39 2022] GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de => generated 1811 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 11:38:41.099892 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-757d6628-1d2a-470f-aaf8-552f934ff9b6 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:38:41.100562 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-757d6628-1d2a-470f-aaf8-552f934ff9b6 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: 2e661217-fb1a-48ad-9f1b-47985a4074de] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:38:41.107132 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-757d6628-1d2a-470f-aaf8-552f934ff9b6 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:41.107612 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-757d6628-1d2a-470f-aaf8-552f934ff9b6 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:41.108058 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-757d6628-1d2a-470f-aaf8-552f934ff9b6 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:41.108743 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-757d6628-1d2a-470f-aaf8-552f934ff9b6 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:41.109277 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-757d6628-1d2a-470f-aaf8-552f934ff9b6 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:41.109774 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-757d6628-1d2a-470f-aaf8-552f934ff9b6 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:41.263003 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-757d6628-1d2a-470f-aaf8-552f934ff9b6 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:41.273129 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-757d6628-1d2a-470f-aaf8-552f934ff9b6 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:41.274716 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-757d6628-1d2a-470f-aaf8-552f934ff9b6 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:41.275873 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-757d6628-1d2a-470f-aaf8-552f934ff9b6 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de" status: 200 len: 1811 microversion: 2.20 time: 0.179960 Aug 24 11:38:41.276434 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 348/650] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:38:41 2022] GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de => generated 1811 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 11:38:42.299834 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-db9a2053-a26e-4496-9d68-2ee0ee18879c tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:38:42.300514 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-db9a2053-a26e-4496-9d68-2ee0ee18879c tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: 2e661217-fb1a-48ad-9f1b-47985a4074de] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:38:42.307828 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-db9a2053-a26e-4496-9d68-2ee0ee18879c tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:42.308316 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-db9a2053-a26e-4496-9d68-2ee0ee18879c tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:42.308758 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-db9a2053-a26e-4496-9d68-2ee0ee18879c tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:42.309502 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-db9a2053-a26e-4496-9d68-2ee0ee18879c tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:42.309964 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-db9a2053-a26e-4496-9d68-2ee0ee18879c tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:42.310390 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-db9a2053-a26e-4496-9d68-2ee0ee18879c tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:42.463932 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-db9a2053-a26e-4496-9d68-2ee0ee18879c tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:42.473646 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-db9a2053-a26e-4496-9d68-2ee0ee18879c tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:42.475150 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-db9a2053-a26e-4496-9d68-2ee0ee18879c tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:42.476336 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-db9a2053-a26e-4496-9d68-2ee0ee18879c tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de" status: 200 len: 1811 microversion: 2.20 time: 0.181463 Aug 24 11:38:42.477088 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 349/651] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:38:42 2022] GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de => generated 1811 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 11:38:43.501428 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-585312f5-6eff-488c-9187-f1fc017bb12c tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:38:43.502121 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-585312f5-6eff-488c-9187-f1fc017bb12c tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: 2e661217-fb1a-48ad-9f1b-47985a4074de] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:38:43.509087 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-585312f5-6eff-488c-9187-f1fc017bb12c tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:43.509587 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-585312f5-6eff-488c-9187-f1fc017bb12c tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:43.510040 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-585312f5-6eff-488c-9187-f1fc017bb12c tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:43.510811 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-585312f5-6eff-488c-9187-f1fc017bb12c tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:43.511274 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-585312f5-6eff-488c-9187-f1fc017bb12c tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:43.511754 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-585312f5-6eff-488c-9187-f1fc017bb12c tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:43.664162 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-585312f5-6eff-488c-9187-f1fc017bb12c tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:43.674081 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-585312f5-6eff-488c-9187-f1fc017bb12c tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:43.675622 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-585312f5-6eff-488c-9187-f1fc017bb12c tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:43.676843 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-585312f5-6eff-488c-9187-f1fc017bb12c tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de" status: 200 len: 1811 microversion: 2.20 time: 0.180429 Aug 24 11:38:43.677404 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 350/652] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:38:43 2022] GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de => generated 1811 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 11:38:44.409217 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-727c4a8e-b4a6-477e-9c80-a230d8133919 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "POST /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 14.746240 Aug 24 11:38:44.410009 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 303/653] 10.222.0.84 () {60 vars in 1323 bytes} [Wed Aug 24 11:38:29 2022] POST /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18/os-volume_attachments => generated 194 bytes in 14748 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:38:44.699729 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-f1b10118-3240-4bc9-a0b6-ace026ca18ba tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:38:44.700274 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-f1b10118-3240-4bc9-a0b6-ace026ca18ba tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: 2e661217-fb1a-48ad-9f1b-47985a4074de] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:38:44.707250 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f1b10118-3240-4bc9-a0b6-ace026ca18ba tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:44.707737 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f1b10118-3240-4bc9-a0b6-ace026ca18ba tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:44.708177 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f1b10118-3240-4bc9-a0b6-ace026ca18ba tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:44.708901 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f1b10118-3240-4bc9-a0b6-ace026ca18ba tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:44.709357 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f1b10118-3240-4bc9-a0b6-ace026ca18ba tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:44.709785 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f1b10118-3240-4bc9-a0b6-ace026ca18ba tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:44.849289 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-f1b10118-3240-4bc9-a0b6-ace026ca18ba tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:44.858596 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-f1b10118-3240-4bc9-a0b6-ace026ca18ba tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:44.860194 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-f1b10118-3240-4bc9-a0b6-ace026ca18ba tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:44.862207 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-f1b10118-3240-4bc9-a0b6-ace026ca18ba tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de" status: 200 len: 1811 microversion: 2.20 time: 0.166325 Aug 24 11:38:44.863021 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 351/654] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:38:44 2022] GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de => generated 1811 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:38:45.886852 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-6be58180-5f6e-4070-a2ed-422a1f130833 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:38:45.887571 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-6be58180-5f6e-4070-a2ed-422a1f130833 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: 2e661217-fb1a-48ad-9f1b-47985a4074de] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:38:45.896314 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6be58180-5f6e-4070-a2ed-422a1f130833 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:45.896871 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6be58180-5f6e-4070-a2ed-422a1f130833 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:45.897358 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6be58180-5f6e-4070-a2ed-422a1f130833 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:45.898077 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6be58180-5f6e-4070-a2ed-422a1f130833 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:45.898534 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6be58180-5f6e-4070-a2ed-422a1f130833 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:45.898965 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6be58180-5f6e-4070-a2ed-422a1f130833 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:46.046422 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-6be58180-5f6e-4070-a2ed-422a1f130833 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:46.056223 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-6be58180-5f6e-4070-a2ed-422a1f130833 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:46.057770 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-6be58180-5f6e-4070-a2ed-422a1f130833 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:46.059128 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-6be58180-5f6e-4070-a2ed-422a1f130833 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de" status: 200 len: 1811 microversion: 2.20 time: 0.176659 Aug 24 11:38:46.059697 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 304/655] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:38:45 2022] GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de => generated 1811 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:38:47.082967 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-4aadafb8-7521-4042-afd7-768a4c829211 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:38:47.083689 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-4aadafb8-7521-4042-afd7-768a4c829211 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: 2e661217-fb1a-48ad-9f1b-47985a4074de] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:38:47.097350 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-4aadafb8-7521-4042-afd7-768a4c829211 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:47.097840 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-4aadafb8-7521-4042-afd7-768a4c829211 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:47.098307 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-4aadafb8-7521-4042-afd7-768a4c829211 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:47.099010 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-4aadafb8-7521-4042-afd7-768a4c829211 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:47.099460 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-4aadafb8-7521-4042-afd7-768a4c829211 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:47.099886 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-4aadafb8-7521-4042-afd7-768a4c829211 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:47.102888 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG dbcounter [-] [124769] Writing DB stats nova_cell1:SELECT=100 {{(pid=124769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:38:47.269867 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-4aadafb8-7521-4042-afd7-768a4c829211 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:47.281599 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-4aadafb8-7521-4042-afd7-768a4c829211 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:47.283247 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-4aadafb8-7521-4042-afd7-768a4c829211 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:47.285106 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-4aadafb8-7521-4042-afd7-768a4c829211 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de" status: 200 len: 1811 microversion: 2.20 time: 0.206042 Aug 24 11:38:47.286473 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 352/656] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:38:47 2022] GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de => generated 1811 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:38:48.317392 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-cd0b1dce-1aac-4c01-ad92-9999a02bec9f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:38:48.320449 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-cd0b1dce-1aac-4c01-ad92-9999a02bec9f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: 2e661217-fb1a-48ad-9f1b-47985a4074de] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:38:48.325071 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-cd0b1dce-1aac-4c01-ad92-9999a02bec9f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:48.325597 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-cd0b1dce-1aac-4c01-ad92-9999a02bec9f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:48.326040 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-cd0b1dce-1aac-4c01-ad92-9999a02bec9f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:48.326760 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-cd0b1dce-1aac-4c01-ad92-9999a02bec9f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:48.327213 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-cd0b1dce-1aac-4c01-ad92-9999a02bec9f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:48.327668 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-cd0b1dce-1aac-4c01-ad92-9999a02bec9f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:48.499383 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-cd0b1dce-1aac-4c01-ad92-9999a02bec9f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:48.511089 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-cd0b1dce-1aac-4c01-ad92-9999a02bec9f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:48.512658 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-cd0b1dce-1aac-4c01-ad92-9999a02bec9f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:48.513920 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-cd0b1dce-1aac-4c01-ad92-9999a02bec9f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de" status: 200 len: 1811 microversion: 2.20 time: 0.200838 Aug 24 11:38:48.514520 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 305/657] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:38:48 2022] GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de => generated 1811 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 11:38:49.548545 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-1f4731af-16ed-4fe8-a93d-98976fe6b098 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:38:49.549139 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-1f4731af-16ed-4fe8-a93d-98976fe6b098 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: 2e661217-fb1a-48ad-9f1b-47985a4074de] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:38:49.556780 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-1f4731af-16ed-4fe8-a93d-98976fe6b098 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:49.557355 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-1f4731af-16ed-4fe8-a93d-98976fe6b098 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:49.557797 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-1f4731af-16ed-4fe8-a93d-98976fe6b098 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:49.558509 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-1f4731af-16ed-4fe8-a93d-98976fe6b098 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:49.558970 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-1f4731af-16ed-4fe8-a93d-98976fe6b098 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:49.559426 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-1f4731af-16ed-4fe8-a93d-98976fe6b098 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:49.719921 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-1f4731af-16ed-4fe8-a93d-98976fe6b098 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:49.730030 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-1f4731af-16ed-4fe8-a93d-98976fe6b098 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:49.731627 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-1f4731af-16ed-4fe8-a93d-98976fe6b098 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:49.732944 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-1f4731af-16ed-4fe8-a93d-98976fe6b098 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de" status: 200 len: 1811 microversion: 2.20 time: 0.188551 Aug 24 11:38:49.733510 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 353/658] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:38:49 2022] GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de => generated 1811 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:38:49.961695 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [req-a8e14520-7a92-48bf-88a3-33df66e4690f req-8a0c455f-6e79-440c-92db-84503fe96f50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e661217-fb1a-48ad-9f1b-47985a4074de", "name": "network-vif-plugged", "status": "completed", "tag": "e82d60e7-8369-4554-9da0-a0a3a25fe586"}]} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:38:49.973573 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-a8e14520-7a92-48bf-88a3-33df66e4690f req-8a0c455f-6e79-440c-92db-84503fe96f50 service nova] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:49.974061 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-a8e14520-7a92-48bf-88a3-33df66e4690f req-8a0c455f-6e79-440c-92db-84503fe96f50 service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:49.974526 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-a8e14520-7a92-48bf-88a3-33df66e4690f req-8a0c455f-6e79-440c-92db-84503fe96f50 service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:49.989067 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.compute.server_external_events [req-a8e14520-7a92-48bf-88a3-33df66e4690f req-8a0c455f-6e79-440c-92db-84503fe96f50 service nova] Creating event network-vif-plugged:e82d60e7-8369-4554-9da0-a0a3a25fe586 for instance 2e661217-fb1a-48ad-9f1b-47985a4074de on hv-cinder-85427 Aug 24 11:38:49.994724 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [req-a8e14520-7a92-48bf-88a3-33df66e4690f req-8a0c455f-6e79-440c-92db-84503fe96f50 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036784 Aug 24 11:38:50.006791 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 306/659] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Aug 24 11:38:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:38:50.757186 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-ec4dbefe-de3a-4002-acbb-674ab9034df2 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:38:50.758000 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-ec4dbefe-de3a-4002-acbb-674ab9034df2 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: 2e661217-fb1a-48ad-9f1b-47985a4074de] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:38:50.764438 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-ec4dbefe-de3a-4002-acbb-674ab9034df2 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:50.764958 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-ec4dbefe-de3a-4002-acbb-674ab9034df2 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:50.765413 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-ec4dbefe-de3a-4002-acbb-674ab9034df2 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:50.766149 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-ec4dbefe-de3a-4002-acbb-674ab9034df2 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:50.766607 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-ec4dbefe-de3a-4002-acbb-674ab9034df2 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:50.767034 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-ec4dbefe-de3a-4002-acbb-674ab9034df2 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:50.921827 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-ec4dbefe-de3a-4002-acbb-674ab9034df2 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:50.932598 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-ec4dbefe-de3a-4002-acbb-674ab9034df2 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:50.934256 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-ec4dbefe-de3a-4002-acbb-674ab9034df2 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:50.935634 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-ec4dbefe-de3a-4002-acbb-674ab9034df2 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de" status: 200 len: 1811 microversion: 2.20 time: 0.182642 Aug 24 11:38:50.936179 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 354/660] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:38:50 2022] GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de => generated 1811 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:38:51.961430 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-668ccc33-372c-467a-a89e-bde268dba7d8 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:38:51.962121 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-668ccc33-372c-467a-a89e-bde268dba7d8 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: 2e661217-fb1a-48ad-9f1b-47985a4074de] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:38:51.968369 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-668ccc33-372c-467a-a89e-bde268dba7d8 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:51.973234 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-668ccc33-372c-467a-a89e-bde268dba7d8 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:51.973234 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-668ccc33-372c-467a-a89e-bde268dba7d8 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:51.973234 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-668ccc33-372c-467a-a89e-bde268dba7d8 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:51.973234 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-668ccc33-372c-467a-a89e-bde268dba7d8 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:51.974114 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-668ccc33-372c-467a-a89e-bde268dba7d8 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:52.138627 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-668ccc33-372c-467a-a89e-bde268dba7d8 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:52.148196 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-668ccc33-372c-467a-a89e-bde268dba7d8 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:52.150997 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-668ccc33-372c-467a-a89e-bde268dba7d8 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:52.150997 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-668ccc33-372c-467a-a89e-bde268dba7d8 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de" status: 200 len: 1811 microversion: 2.20 time: 0.195313 Aug 24 11:38:52.151401 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 307/661] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:38:51 2022] GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de => generated 1811 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:38:52.688925 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-6551c123-2b61-4fa9-836c-912c8ca5874d tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-696066548", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1778781973", "security_groups": [{"name": "tempest-secgroup-smoke-233048073"}], "networks": [{"uuid": "03a5dc09-b7fd-4fbe-864f-efd39b8d9bb2"}], "block_device_mapping_v2": [{"uuid": "d1653a62-8727-4ae8-b6a1-c1c8c36ca132", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:38:52.818015 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.network.neutron [None req-6551c123-2b61-4fa9-836c-912c8ca5874d tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] validate_networks() for [('03a5dc09-b7fd-4fbe-864f-efd39b8d9bb2', None, None, None, None, None)] {{(pid=124769) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 11:38:53.176138 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-756b020a-cc27-4f80-bd65-29ee8d3b12e4 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:38:53.177187 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-756b020a-cc27-4f80-bd65-29ee8d3b12e4 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: 2e661217-fb1a-48ad-9f1b-47985a4074de] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:38:53.183802 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-756b020a-cc27-4f80-bd65-29ee8d3b12e4 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:53.184293 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-756b020a-cc27-4f80-bd65-29ee8d3b12e4 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:53.184756 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-756b020a-cc27-4f80-bd65-29ee8d3b12e4 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:53.185474 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-756b020a-cc27-4f80-bd65-29ee8d3b12e4 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:53.185922 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-756b020a-cc27-4f80-bd65-29ee8d3b12e4 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:53.186340 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-756b020a-cc27-4f80-bd65-29ee8d3b12e4 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:53.248307 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.virt.hardware [None req-6551c123-2b61-4fa9-836c-912c8ca5874d tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Flavor limits 0:0:0 {{(pid=124769) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 11:38:53.249012 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.virt.hardware [None req-6551c123-2b61-4fa9-836c-912c8ca5874d tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Image limits 0:0:0 {{(pid=124769) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 11:38:53.256409 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.virt.hardware [None req-6551c123-2b61-4fa9-836c-912c8ca5874d tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Flavor pref 0:0:0 {{(pid=124769) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 11:38:53.257574 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.virt.hardware [None req-6551c123-2b61-4fa9-836c-912c8ca5874d tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Image pref 0:0:0 {{(pid=124769) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 11:38:53.257888 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.virt.hardware [None req-6551c123-2b61-4fa9-836c-912c8ca5874d tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124769) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 11:38:53.273131 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-6551c123-2b61-4fa9-836c-912c8ca5874d tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:53.273986 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-6551c123-2b61-4fa9-836c-912c8ca5874d tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:53.274739 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-6551c123-2b61-4fa9-836c-912c8ca5874d tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:53.276236 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-6551c123-2b61-4fa9-836c-912c8ca5874d tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:53.277082 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-6551c123-2b61-4fa9-836c-912c8ca5874d tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:53.277718 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-6551c123-2b61-4fa9-836c-912c8ca5874d tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:53.305983 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.quota [None req-6551c123-2b61-4fa9-836c-912c8ca5874d tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Getting quotas for project 31998483af514a1a8f87ab761d5cf3ba. Resources: {'ram', 'cores', 'instances'} {{(pid=124769) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:38:53.310440 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.quota [None req-6551c123-2b61-4fa9-836c-912c8ca5874d tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Getting quotas for user 7ac5dffd3204413a8834d05db267c3ab and project 31998483af514a1a8f87ab761d5cf3ba. Resources: {'ram', 'cores', 'instances'} {{(pid=124769) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:38:53.369904 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-756b020a-cc27-4f80-bd65-29ee8d3b12e4 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:53.381282 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-756b020a-cc27-4f80-bd65-29ee8d3b12e4 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:53.383147 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-756b020a-cc27-4f80-bd65-29ee8d3b12e4 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:53.384692 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-756b020a-cc27-4f80-bd65-29ee8d3b12e4 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de" status: 200 len: 1811 microversion: 2.20 time: 0.212762 Aug 24 11:38:53.385377 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 308/662] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:38:53 2022] GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de => generated 1811 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 11:38:53.402010 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-6551c123-2b61-4fa9-836c-912c8ca5874d tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Going to run 1 instances... {{(pid=124769) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 11:38:53.404374 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-6551c123-2b61-4fa9-836c-912c8ca5874d tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] [instance: 52f331ec-d0ce-4940-8430-11e9b6732cfe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d1653a62-8727-4ae8-b6a1-c1c8c36ca132',volume_size=None,volume_type=None)] {{(pid=124769) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 11:38:53.981364 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-6551c123-2b61-4fa9-836c-912c8ca5874d tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] 10.222.0.84 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.296371 Aug 24 11:38:53.982395 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 355/663] 10.222.0.84 () {60 vars in 1147 bytes} [Wed Aug 24 11:38:52 2022] POST /compute/v2.1/servers => generated 405 bytes in 1298 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 11:38:54.003666 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-2cff0b6a-003c-4c3e-8ab4-b9ad37101254 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:38:54.004464 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-2cff0b6a-003c-4c3e-8ab4-b9ad37101254 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] [instance: 52f331ec-d0ce-4940-8430-11e9b6732cfe] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:38:54.077439 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-2cff0b6a-003c-4c3e-8ab4-b9ad37101254 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac5dffd3204413a8834d05db267c3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31998483af514a1a8f87ab761d5cf3ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:54.087296 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-2cff0b6a-003c-4c3e-8ab4-b9ad37101254 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] 10.222.0.84 "GET /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe" status: 200 len: 1088 microversion: 2.1 time: 0.089533 Aug 24 11:38:54.088672 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 309/664] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:38:53 2022] GET /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe => generated 1088 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:38:54.421865 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-a2cb29d1-9cf1-4b05-8e1d-59a1fc9140ad tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:38:54.422498 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-a2cb29d1-9cf1-4b05-8e1d-59a1fc9140ad tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: 2e661217-fb1a-48ad-9f1b-47985a4074de] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:38:54.430816 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-a2cb29d1-9cf1-4b05-8e1d-59a1fc9140ad tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:54.431357 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-a2cb29d1-9cf1-4b05-8e1d-59a1fc9140ad tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:54.431778 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-a2cb29d1-9cf1-4b05-8e1d-59a1fc9140ad tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:54.432516 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-a2cb29d1-9cf1-4b05-8e1d-59a1fc9140ad tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:54.433028 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-a2cb29d1-9cf1-4b05-8e1d-59a1fc9140ad tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:54.433462 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-a2cb29d1-9cf1-4b05-8e1d-59a1fc9140ad tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:54.611651 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-a2cb29d1-9cf1-4b05-8e1d-59a1fc9140ad tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:54.629316 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-a2cb29d1-9cf1-4b05-8e1d-59a1fc9140ad tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:54.632457 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-a2cb29d1-9cf1-4b05-8e1d-59a1fc9140ad tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:54.634678 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-a2cb29d1-9cf1-4b05-8e1d-59a1fc9140ad tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de" status: 200 len: 1811 microversion: 2.20 time: 0.216680 Aug 24 11:38:54.636946 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 356/665] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:38:54 2022] GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de => generated 1811 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:38:55.119889 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-1732f8fa-274c-48a7-951d-74ee3c62e266 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:38:55.122252 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-1732f8fa-274c-48a7-951d-74ee3c62e266 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] [instance: 52f331ec-d0ce-4940-8430-11e9b6732cfe] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:38:55.200903 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-1732f8fa-274c-48a7-951d-74ee3c62e266 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac5dffd3204413a8834d05db267c3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31998483af514a1a8f87ab761d5cf3ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:55.213169 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-1732f8fa-274c-48a7-951d-74ee3c62e266 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] 10.222.0.84 "GET /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe" status: 200 len: 1088 microversion: 2.1 time: 0.104639 Aug 24 11:38:55.216702 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 310/666] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:38:55 2022] GET /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe => generated 1088 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:38:55.671699 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-b0fe668f-a34d-446b-b9f9-6fa6c4f9872d tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:38:55.672440 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-b0fe668f-a34d-446b-b9f9-6fa6c4f9872d tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: 2e661217-fb1a-48ad-9f1b-47985a4074de] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:38:55.679706 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-b0fe668f-a34d-446b-b9f9-6fa6c4f9872d tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:55.680207 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-b0fe668f-a34d-446b-b9f9-6fa6c4f9872d tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:55.680659 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-b0fe668f-a34d-446b-b9f9-6fa6c4f9872d tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:55.681448 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-b0fe668f-a34d-446b-b9f9-6fa6c4f9872d tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:55.681912 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-b0fe668f-a34d-446b-b9f9-6fa6c4f9872d tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:55.682337 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-b0fe668f-a34d-446b-b9f9-6fa6c4f9872d tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:55.843933 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-b0fe668f-a34d-446b-b9f9-6fa6c4f9872d tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:55.854217 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-b0fe668f-a34d-446b-b9f9-6fa6c4f9872d tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:55.855602 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-b0fe668f-a34d-446b-b9f9-6fa6c4f9872d tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:55.856790 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-b0fe668f-a34d-446b-b9f9-6fa6c4f9872d tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de" status: 200 len: 1811 microversion: 2.20 time: 0.189095 Aug 24 11:38:55.857538 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 357/667] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:38:55 2022] GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de => generated 1811 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:38:56.244828 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-260e1a06-520b-4e91-82d9-917ac8a22b25 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:38:56.245949 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-260e1a06-520b-4e91-82d9-917ac8a22b25 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] [instance: 52f331ec-d0ce-4940-8430-11e9b6732cfe] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:38:56.253977 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-260e1a06-520b-4e91-82d9-917ac8a22b25 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:56.254477 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-260e1a06-520b-4e91-82d9-917ac8a22b25 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:56.254914 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-260e1a06-520b-4e91-82d9-917ac8a22b25 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:56.255619 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-260e1a06-520b-4e91-82d9-917ac8a22b25 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:56.256067 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-260e1a06-520b-4e91-82d9-917ac8a22b25 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:56.256485 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-260e1a06-520b-4e91-82d9-917ac8a22b25 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:56.324856 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-260e1a06-520b-4e91-82d9-917ac8a22b25 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac5dffd3204413a8834d05db267c3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31998483af514a1a8f87ab761d5cf3ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:56.333584 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-260e1a06-520b-4e91-82d9-917ac8a22b25 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] 10.222.0.84 "GET /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe" status: 200 len: 1138 microversion: 2.1 time: 0.092788 Aug 24 11:38:56.334402 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 311/668] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:38:56 2022] GET /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe => generated 1138 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:38:56.883346 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-ea27a66a-590c-46ca-8b16-fe5b18c094be tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:38:56.884103 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-ea27a66a-590c-46ca-8b16-fe5b18c094be tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: 2e661217-fb1a-48ad-9f1b-47985a4074de] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:38:56.891109 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-ea27a66a-590c-46ca-8b16-fe5b18c094be tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:56.891656 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-ea27a66a-590c-46ca-8b16-fe5b18c094be tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:56.892107 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-ea27a66a-590c-46ca-8b16-fe5b18c094be tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:56.893506 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-ea27a66a-590c-46ca-8b16-fe5b18c094be tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:56.894720 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-ea27a66a-590c-46ca-8b16-fe5b18c094be tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:56.895158 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-ea27a66a-590c-46ca-8b16-fe5b18c094be tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:57.043700 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-ea27a66a-590c-46ca-8b16-fe5b18c094be tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:57.054395 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-ea27a66a-590c-46ca-8b16-fe5b18c094be tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:57.056220 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-ea27a66a-590c-46ca-8b16-fe5b18c094be tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:57.057490 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-ea27a66a-590c-46ca-8b16-fe5b18c094be tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de" status: 200 len: 1798 microversion: 2.20 time: 0.178255 Aug 24 11:38:57.058064 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 358/669] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:38:56 2022] GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de => generated 1798 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:38:57.355644 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-bac86e44-ff38-4399-832d-3e2853472e21 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:38:57.356335 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-bac86e44-ff38-4399-832d-3e2853472e21 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] [instance: 52f331ec-d0ce-4940-8430-11e9b6732cfe] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:38:57.364396 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-bac86e44-ff38-4399-832d-3e2853472e21 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:57.365100 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-bac86e44-ff38-4399-832d-3e2853472e21 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:57.365562 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-bac86e44-ff38-4399-832d-3e2853472e21 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:57.366328 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-bac86e44-ff38-4399-832d-3e2853472e21 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:57.366822 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-bac86e44-ff38-4399-832d-3e2853472e21 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:57.367289 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-bac86e44-ff38-4399-832d-3e2853472e21 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:57.448617 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-f6994c44-61e0-48bc-a40f-1fed52ca1c88 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:38:57.451244 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-f6994c44-61e0-48bc-a40f-1fed52ca1c88 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: a8ce5b7f-1b02-4746-9aa5-0d826615df18] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:38:57.460018 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f6994c44-61e0-48bc-a40f-1fed52ca1c88 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:57.460958 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f6994c44-61e0-48bc-a40f-1fed52ca1c88 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:57.461826 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f6994c44-61e0-48bc-a40f-1fed52ca1c88 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:57.463091 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f6994c44-61e0-48bc-a40f-1fed52ca1c88 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:57.463939 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f6994c44-61e0-48bc-a40f-1fed52ca1c88 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:57.464512 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f6994c44-61e0-48bc-a40f-1fed52ca1c88 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:57.483378 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-bac86e44-ff38-4399-832d-3e2853472e21 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac5dffd3204413a8834d05db267c3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31998483af514a1a8f87ab761d5cf3ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:57.494394 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.objects.instance [None req-f6994c44-61e0-48bc-a40f-1fed52ca1c88 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lazy-loading 'flavor' on Instance uuid a8ce5b7f-1b02-4746-9aa5-0d826615df18 {{(pid=124769) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:38:57.496073 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-bac86e44-ff38-4399-832d-3e2853472e21 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] 10.222.0.84 "GET /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe" status: 200 len: 1194 microversion: 2.1 time: 0.144117 Aug 24 11:38:57.497356 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 312/670] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:38:57 2022] GET /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe => generated 1194 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:38:57.912865 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-f6994c44-61e0-48bc-a40f-1fed52ca1c88 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "POST /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18/action" status: 200 len: 32 microversion: 2.1 time: 0.468221 Aug 24 11:38:57.913550 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 359/671] 10.222.0.84 () {60 vars in 1278 bytes} [Wed Aug 24 11:38:57 2022] POST /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18/action => generated 32 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 11:38:57.924918 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-34a879b5-93eb-4c8a-8710-b24507673c83 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:38:57.925549 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-34a879b5-93eb-4c8a-8710-b24507673c83 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: a8ce5b7f-1b02-4746-9aa5-0d826615df18] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:38:57.932765 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-34a879b5-93eb-4c8a-8710-b24507673c83 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:57.933406 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-34a879b5-93eb-4c8a-8710-b24507673c83 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:57.934660 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-34a879b5-93eb-4c8a-8710-b24507673c83 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:57.935956 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-34a879b5-93eb-4c8a-8710-b24507673c83 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:57.936784 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-34a879b5-93eb-4c8a-8710-b24507673c83 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:57.937631 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-34a879b5-93eb-4c8a-8710-b24507673c83 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:58.302749 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-34a879b5-93eb-4c8a-8710-b24507673c83 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:58.315514 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-34a879b5-93eb-4c8a-8710-b24507673c83 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18" status: 200 len: 1735 microversion: 2.1 time: 0.394497 Aug 24 11:38:58.316563 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 313/672] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:38:57 2022] GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18 => generated 1735 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:38:58.521151 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-dedc73dd-8cec-4e11-8fbb-435b70fa0143 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:38:58.521868 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-dedc73dd-8cec-4e11-8fbb-435b70fa0143 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] [instance: 52f331ec-d0ce-4940-8430-11e9b6732cfe] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:38:58.531841 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-dedc73dd-8cec-4e11-8fbb-435b70fa0143 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:58.532960 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-dedc73dd-8cec-4e11-8fbb-435b70fa0143 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:58.534341 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-dedc73dd-8cec-4e11-8fbb-435b70fa0143 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:58.535620 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-dedc73dd-8cec-4e11-8fbb-435b70fa0143 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:58.536446 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-dedc73dd-8cec-4e11-8fbb-435b70fa0143 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:58.537280 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-dedc73dd-8cec-4e11-8fbb-435b70fa0143 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:58.623094 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-dedc73dd-8cec-4e11-8fbb-435b70fa0143 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac5dffd3204413a8834d05db267c3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31998483af514a1a8f87ab761d5cf3ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:58.641449 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-dedc73dd-8cec-4e11-8fbb-435b70fa0143 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] 10.222.0.84 "GET /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe" status: 200 len: 1204 microversion: 2.1 time: 0.124891 Aug 24 11:38:58.642137 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 360/673] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:38:58 2022] GET /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe => generated 1204 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:38:59.354851 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-bcc0f142-0f6e-4466-815b-fdeb4171530f tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:38:59.356575 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-bcc0f142-0f6e-4466-815b-fdeb4171530f tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: a8ce5b7f-1b02-4746-9aa5-0d826615df18] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:38:59.369684 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-bcc0f142-0f6e-4466-815b-fdeb4171530f tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:59.373175 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-bcc0f142-0f6e-4466-815b-fdeb4171530f tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:59.373175 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-bcc0f142-0f6e-4466-815b-fdeb4171530f tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:59.373175 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-bcc0f142-0f6e-4466-815b-fdeb4171530f tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:59.373175 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-bcc0f142-0f6e-4466-815b-fdeb4171530f tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:59.373602 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-bcc0f142-0f6e-4466-815b-fdeb4171530f tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:59.591152 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-bcc0f142-0f6e-4466-815b-fdeb4171530f tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:59.593090 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-bcc0f142-0f6e-4466-815b-fdeb4171530f tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18" status: 200 len: 1735 microversion: 2.1 time: 0.244567 Aug 24 11:38:59.593683 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 314/674] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:38:59 2022] GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18 => generated 1735 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:38:59.671578 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-da661f7e-ed56-4f8f-96cd-8f2d7168d37f tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:38:59.677099 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-da661f7e-ed56-4f8f-96cd-8f2d7168d37f tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] [instance: 52f331ec-d0ce-4940-8430-11e9b6732cfe] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:38:59.679626 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-da661f7e-ed56-4f8f-96cd-8f2d7168d37f tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:59.679951 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-da661f7e-ed56-4f8f-96cd-8f2d7168d37f tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:59.680117 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-da661f7e-ed56-4f8f-96cd-8f2d7168d37f tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:59.680885 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-da661f7e-ed56-4f8f-96cd-8f2d7168d37f tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:59.681439 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-da661f7e-ed56-4f8f-96cd-8f2d7168d37f tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:59.681818 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-da661f7e-ed56-4f8f-96cd-8f2d7168d37f tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:59.842174 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-da661f7e-ed56-4f8f-96cd-8f2d7168d37f tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac5dffd3204413a8834d05db267c3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31998483af514a1a8f87ab761d5cf3ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:59.850390 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-da661f7e-ed56-4f8f-96cd-8f2d7168d37f tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] 10.222.0.84 "GET /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe" status: 200 len: 1271 microversion: 2.1 time: 0.183672 Aug 24 11:38:59.850966 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 361/675] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:38:59 2022] GET /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe => generated 1271 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:39:00.418520 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [req-12efad1d-501c-42c9-ae8a-166bfb21549d req-5e8d0b85-c16a-47c9-8b04-2afd3cb770a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52f331ec-d0ce-4940-8430-11e9b6732cfe", "tag": "2922ba9f-42e7-4aaf-a9d1-30bc6103646f"}]} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:39:00.432848 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-12efad1d-501c-42c9-ae8a-166bfb21549d req-5e8d0b85-c16a-47c9-8b04-2afd3cb770a7 service nova] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:00.432848 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-12efad1d-501c-42c9-ae8a-166bfb21549d req-5e8d0b85-c16a-47c9-8b04-2afd3cb770a7 service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:00.432848 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-12efad1d-501c-42c9-ae8a-166bfb21549d req-5e8d0b85-c16a-47c9-8b04-2afd3cb770a7 service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:00.448775 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.compute.server_external_events [req-12efad1d-501c-42c9-ae8a-166bfb21549d req-5e8d0b85-c16a-47c9-8b04-2afd3cb770a7 service nova] Creating event network-changed:2922ba9f-42e7-4aaf-a9d1-30bc6103646f for instance 52f331ec-d0ce-4940-8430-11e9b6732cfe on hv-cinder-85427 Aug 24 11:39:00.454368 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [req-12efad1d-501c-42c9-ae8a-166bfb21549d req-5e8d0b85-c16a-47c9-8b04-2afd3cb770a7 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041275 Aug 24 11:39:00.454978 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 315/676] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Aug 24 11:39:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:39:00.620535 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-1adde5f1-fe31-4429-b5a3-71c25ca31063 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:39:00.621525 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-1adde5f1-fe31-4429-b5a3-71c25ca31063 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: a8ce5b7f-1b02-4746-9aa5-0d826615df18] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:39:00.624972 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG dbcounter [-] [124769] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3 {{(pid=124769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:39:00.628707 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-1adde5f1-fe31-4429-b5a3-71c25ca31063 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:00.632910 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-1adde5f1-fe31-4429-b5a3-71c25ca31063 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:00.632910 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-1adde5f1-fe31-4429-b5a3-71c25ca31063 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:00.632910 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-1adde5f1-fe31-4429-b5a3-71c25ca31063 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:00.632910 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-1adde5f1-fe31-4429-b5a3-71c25ca31063 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:00.633305 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-1adde5f1-fe31-4429-b5a3-71c25ca31063 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:00.808274 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-1adde5f1-fe31-4429-b5a3-71c25ca31063 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:39:00.821824 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-1adde5f1-fe31-4429-b5a3-71c25ca31063 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18" status: 200 len: 1735 microversion: 2.1 time: 0.205308 Aug 24 11:39:00.822532 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 362/677] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:39:00 2022] GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18 => generated 1735 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:39:00.872517 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-44e3eba9-9d0f-49f6-ac1e-f1bbefe2ac24 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:39:00.873307 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-44e3eba9-9d0f-49f6-ac1e-f1bbefe2ac24 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] [instance: 52f331ec-d0ce-4940-8430-11e9b6732cfe] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:39:00.881743 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-44e3eba9-9d0f-49f6-ac1e-f1bbefe2ac24 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:00.882234 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-44e3eba9-9d0f-49f6-ac1e-f1bbefe2ac24 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:00.882729 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-44e3eba9-9d0f-49f6-ac1e-f1bbefe2ac24 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:00.883506 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-44e3eba9-9d0f-49f6-ac1e-f1bbefe2ac24 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:00.883899 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-44e3eba9-9d0f-49f6-ac1e-f1bbefe2ac24 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:00.884520 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-44e3eba9-9d0f-49f6-ac1e-f1bbefe2ac24 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:01.129987 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-44e3eba9-9d0f-49f6-ac1e-f1bbefe2ac24 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac5dffd3204413a8834d05db267c3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31998483af514a1a8f87ab761d5cf3ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:39:01.138762 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-44e3eba9-9d0f-49f6-ac1e-f1bbefe2ac24 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] 10.222.0.84 "GET /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe" status: 200 len: 1259 microversion: 2.1 time: 0.270649 Aug 24 11:39:01.139658 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 316/678] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:39:00 2022] GET /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe => generated 1259 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:39:01.843518 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-8e558d77-5d74-46db-8849-0f0ea44f50ee tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:39:01.844163 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-8e558d77-5d74-46db-8849-0f0ea44f50ee tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: a8ce5b7f-1b02-4746-9aa5-0d826615df18] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:39:01.851886 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-8e558d77-5d74-46db-8849-0f0ea44f50ee tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:01.852371 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-8e558d77-5d74-46db-8849-0f0ea44f50ee tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:01.852820 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-8e558d77-5d74-46db-8849-0f0ea44f50ee tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:01.853535 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-8e558d77-5d74-46db-8849-0f0ea44f50ee tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:01.853986 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-8e558d77-5d74-46db-8849-0f0ea44f50ee tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:01.854413 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-8e558d77-5d74-46db-8849-0f0ea44f50ee tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:01.998259 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-8e558d77-5d74-46db-8849-0f0ea44f50ee tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:39:02.007496 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-8e558d77-5d74-46db-8849-0f0ea44f50ee tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18" status: 200 len: 1735 microversion: 2.1 time: 0.167785 Aug 24 11:39:02.008109 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 363/679] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:39:01 2022] GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18 => generated 1735 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:39:02.160551 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-8de0eb5e-cb4f-4e2c-97e3-241c8480e354 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:39:02.161157 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-8de0eb5e-cb4f-4e2c-97e3-241c8480e354 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] [instance: 52f331ec-d0ce-4940-8430-11e9b6732cfe] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:39:02.167749 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8de0eb5e-cb4f-4e2c-97e3-241c8480e354 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:02.168222 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8de0eb5e-cb4f-4e2c-97e3-241c8480e354 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:02.168649 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8de0eb5e-cb4f-4e2c-97e3-241c8480e354 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:02.169358 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8de0eb5e-cb4f-4e2c-97e3-241c8480e354 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:02.169825 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8de0eb5e-cb4f-4e2c-97e3-241c8480e354 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:02.170237 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8de0eb5e-cb4f-4e2c-97e3-241c8480e354 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:02.313896 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-8de0eb5e-cb4f-4e2c-97e3-241c8480e354 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac5dffd3204413a8834d05db267c3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31998483af514a1a8f87ab761d5cf3ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:39:02.322187 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-8de0eb5e-cb4f-4e2c-97e3-241c8480e354 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] 10.222.0.84 "GET /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe" status: 200 len: 1259 microversion: 2.1 time: 0.166259 Aug 24 11:39:02.322760 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 317/680] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:39:02 2022] GET /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe => generated 1259 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:39:03.029727 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-348c6573-95ba-4c80-9b9f-11ba07a5e538 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:39:03.030476 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-348c6573-95ba-4c80-9b9f-11ba07a5e538 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: a8ce5b7f-1b02-4746-9aa5-0d826615df18] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:39:03.037064 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-348c6573-95ba-4c80-9b9f-11ba07a5e538 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:03.037577 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-348c6573-95ba-4c80-9b9f-11ba07a5e538 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:03.038005 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-348c6573-95ba-4c80-9b9f-11ba07a5e538 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:03.038714 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-348c6573-95ba-4c80-9b9f-11ba07a5e538 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:03.039171 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-348c6573-95ba-4c80-9b9f-11ba07a5e538 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:03.039599 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-348c6573-95ba-4c80-9b9f-11ba07a5e538 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:03.186532 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-348c6573-95ba-4c80-9b9f-11ba07a5e538 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:39:03.195638 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-348c6573-95ba-4c80-9b9f-11ba07a5e538 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18" status: 200 len: 1735 microversion: 2.1 time: 0.169952 Aug 24 11:39:03.196206 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 364/681] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:39:03 2022] GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18 => generated 1735 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:39:03.343990 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-f9733c40-9161-41cb-a5ea-f97a2a635768 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:39:03.344659 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-f9733c40-9161-41cb-a5ea-f97a2a635768 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] [instance: 52f331ec-d0ce-4940-8430-11e9b6732cfe] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:39:03.351591 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-f9733c40-9161-41cb-a5ea-f97a2a635768 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:03.357472 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-f9733c40-9161-41cb-a5ea-f97a2a635768 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:03.357472 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-f9733c40-9161-41cb-a5ea-f97a2a635768 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:03.357472 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-f9733c40-9161-41cb-a5ea-f97a2a635768 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:03.357472 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-f9733c40-9161-41cb-a5ea-f97a2a635768 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:03.357971 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-f9733c40-9161-41cb-a5ea-f97a2a635768 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:03.503524 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-f9733c40-9161-41cb-a5ea-f97a2a635768 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac5dffd3204413a8834d05db267c3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31998483af514a1a8f87ab761d5cf3ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:39:03.511592 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-f9733c40-9161-41cb-a5ea-f97a2a635768 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] 10.222.0.84 "GET /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe" status: 200 len: 1259 microversion: 2.1 time: 0.172338 Aug 24 11:39:03.512159 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 318/682] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:39:03 2022] GET /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe => generated 1259 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:39:04.215119 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG dbcounter [-] [124769] Writing DB stats nova_cell0:SELECT=2 {{(pid=124769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:39:04.215892 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG dbcounter [-] [124769] Writing DB stats nova_cell0:SELECT=6 {{(pid=124769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:39:04.220347 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-44b8f7fe-df58-499f-9db1-d439e728aa87 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:39:04.221639 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-44b8f7fe-df58-499f-9db1-d439e728aa87 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: a8ce5b7f-1b02-4746-9aa5-0d826615df18] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:39:04.228000 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-44b8f7fe-df58-499f-9db1-d439e728aa87 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:04.228494 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-44b8f7fe-df58-499f-9db1-d439e728aa87 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:04.229100 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-44b8f7fe-df58-499f-9db1-d439e728aa87 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:04.229723 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-44b8f7fe-df58-499f-9db1-d439e728aa87 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:04.230189 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-44b8f7fe-df58-499f-9db1-d439e728aa87 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:04.230613 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-44b8f7fe-df58-499f-9db1-d439e728aa87 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:04.390040 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-44b8f7fe-df58-499f-9db1-d439e728aa87 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:39:04.405430 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-44b8f7fe-df58-499f-9db1-d439e728aa87 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18" status: 200 len: 1735 microversion: 2.1 time: 0.190641 Aug 24 11:39:04.406271 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 365/683] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:39:04 2022] GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18 => generated 1735 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:39:04.534405 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-a8c55ea1-6f86-4d9e-b0dc-66968074ceb8 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:39:04.534916 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-a8c55ea1-6f86-4d9e-b0dc-66968074ceb8 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] [instance: 52f331ec-d0ce-4940-8430-11e9b6732cfe] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:39:04.541461 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a8c55ea1-6f86-4d9e-b0dc-66968074ceb8 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:04.541944 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a8c55ea1-6f86-4d9e-b0dc-66968074ceb8 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:04.542374 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a8c55ea1-6f86-4d9e-b0dc-66968074ceb8 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:04.543054 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a8c55ea1-6f86-4d9e-b0dc-66968074ceb8 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:04.543502 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a8c55ea1-6f86-4d9e-b0dc-66968074ceb8 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:04.543915 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a8c55ea1-6f86-4d9e-b0dc-66968074ceb8 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:04.694382 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-a8c55ea1-6f86-4d9e-b0dc-66968074ceb8 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac5dffd3204413a8834d05db267c3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31998483af514a1a8f87ab761d5cf3ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:39:04.707748 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-a8c55ea1-6f86-4d9e-b0dc-66968074ceb8 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] 10.222.0.84 "GET /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe" status: 200 len: 1259 microversion: 2.1 time: 0.177649 Aug 24 11:39:04.708608 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 319/684] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:39:04 2022] GET /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe => generated 1259 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:39:05.429183 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-b6794a89-cfc8-48ee-b662-53f96799e747 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:39:05.429940 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-b6794a89-cfc8-48ee-b662-53f96799e747 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: a8ce5b7f-1b02-4746-9aa5-0d826615df18] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:39:05.436239 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-b6794a89-cfc8-48ee-b662-53f96799e747 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:05.436729 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-b6794a89-cfc8-48ee-b662-53f96799e747 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:05.437202 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-b6794a89-cfc8-48ee-b662-53f96799e747 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:05.437906 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-b6794a89-cfc8-48ee-b662-53f96799e747 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:05.438359 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-b6794a89-cfc8-48ee-b662-53f96799e747 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:05.438783 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-b6794a89-cfc8-48ee-b662-53f96799e747 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:05.600941 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-b6794a89-cfc8-48ee-b662-53f96799e747 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:39:05.615782 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-b6794a89-cfc8-48ee-b662-53f96799e747 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18" status: 200 len: 1735 microversion: 2.1 time: 0.191027 Aug 24 11:39:05.616682 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 366/685] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:39:05 2022] GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18 => generated 1735 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:39:05.732176 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-8e7d8871-9806-42a1-a49f-43d96b2052cc tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:39:05.733164 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-8e7d8871-9806-42a1-a49f-43d96b2052cc tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] [instance: 52f331ec-d0ce-4940-8430-11e9b6732cfe] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:39:05.735038 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_cell0:SELECT=4 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:39:05.741896 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8e7d8871-9806-42a1-a49f-43d96b2052cc tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:05.742447 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8e7d8871-9806-42a1-a49f-43d96b2052cc tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:05.742860 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8e7d8871-9806-42a1-a49f-43d96b2052cc tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:05.743568 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8e7d8871-9806-42a1-a49f-43d96b2052cc tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:05.744028 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8e7d8871-9806-42a1-a49f-43d96b2052cc tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:05.744429 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8e7d8871-9806-42a1-a49f-43d96b2052cc tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:05.916817 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-8e7d8871-9806-42a1-a49f-43d96b2052cc tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac5dffd3204413a8834d05db267c3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31998483af514a1a8f87ab761d5cf3ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:39:05.925967 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-8e7d8871-9806-42a1-a49f-43d96b2052cc tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] 10.222.0.84 "GET /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe" status: 200 len: 1259 microversion: 2.1 time: 0.197957 Aug 24 11:39:05.926552 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 320/686] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:39:05 2022] GET /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe => generated 1259 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:39:06.649623 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-4d12c1d6-23d6-4b33-9452-297753b87e54 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:39:06.650169 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-4d12c1d6-23d6-4b33-9452-297753b87e54 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: a8ce5b7f-1b02-4746-9aa5-0d826615df18] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:39:06.657400 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-4d12c1d6-23d6-4b33-9452-297753b87e54 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:06.657904 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-4d12c1d6-23d6-4b33-9452-297753b87e54 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:06.659651 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-4d12c1d6-23d6-4b33-9452-297753b87e54 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:06.660412 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-4d12c1d6-23d6-4b33-9452-297753b87e54 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:06.661260 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-4d12c1d6-23d6-4b33-9452-297753b87e54 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:06.661715 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-4d12c1d6-23d6-4b33-9452-297753b87e54 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:06.680593 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG dbcounter [-] [124769] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:39:06.833513 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-4d12c1d6-23d6-4b33-9452-297753b87e54 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:39:06.845129 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-4d12c1d6-23d6-4b33-9452-297753b87e54 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18" status: 200 len: 1735 microversion: 2.1 time: 0.199715 Aug 24 11:39:06.846423 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 367/687] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:39:06 2022] GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18 => generated 1735 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:39:06.947965 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-8206fc8a-9521-4d0b-af62-803cac3d50d6 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:39:06.948657 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-8206fc8a-9521-4d0b-af62-803cac3d50d6 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] [instance: 52f331ec-d0ce-4940-8430-11e9b6732cfe] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:39:06.957889 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8206fc8a-9521-4d0b-af62-803cac3d50d6 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:06.958491 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8206fc8a-9521-4d0b-af62-803cac3d50d6 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:06.959024 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8206fc8a-9521-4d0b-af62-803cac3d50d6 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:06.959861 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8206fc8a-9521-4d0b-af62-803cac3d50d6 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:06.960589 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8206fc8a-9521-4d0b-af62-803cac3d50d6 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:06.961331 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8206fc8a-9521-4d0b-af62-803cac3d50d6 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:07.113925 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-8206fc8a-9521-4d0b-af62-803cac3d50d6 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac5dffd3204413a8834d05db267c3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31998483af514a1a8f87ab761d5cf3ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:39:07.122401 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-8206fc8a-9521-4d0b-af62-803cac3d50d6 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] 10.222.0.84 "GET /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe" status: 200 len: 1259 microversion: 2.1 time: 0.178364 Aug 24 11:39:07.123233 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 321/688] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:39:06 2022] GET /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe => generated 1259 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:39:07.873009 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-fb153863-0745-40c9-af8e-c8739339cc1d tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:39:07.873687 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-fb153863-0745-40c9-af8e-c8739339cc1d tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: a8ce5b7f-1b02-4746-9aa5-0d826615df18] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:39:07.882307 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-fb153863-0745-40c9-af8e-c8739339cc1d tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:07.882761 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-fb153863-0745-40c9-af8e-c8739339cc1d tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:07.882761 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-fb153863-0745-40c9-af8e-c8739339cc1d tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:07.883796 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-fb153863-0745-40c9-af8e-c8739339cc1d tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:07.884307 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-fb153863-0745-40c9-af8e-c8739339cc1d tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:07.884684 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-fb153863-0745-40c9-af8e-c8739339cc1d tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:08.047554 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-fb153863-0745-40c9-af8e-c8739339cc1d tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:39:08.056651 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-fb153863-0745-40c9-af8e-c8739339cc1d tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18" status: 200 len: 1735 microversion: 2.1 time: 0.191468 Aug 24 11:39:08.057319 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 368/689] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:39:07 2022] GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18 => generated 1735 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:39:08.146022 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-57ee6033-3311-42ce-abe7-1fd644a26bca tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:39:08.146640 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-57ee6033-3311-42ce-abe7-1fd644a26bca tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] [instance: 52f331ec-d0ce-4940-8430-11e9b6732cfe] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:39:08.153372 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-57ee6033-3311-42ce-abe7-1fd644a26bca tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:08.153863 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-57ee6033-3311-42ce-abe7-1fd644a26bca tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:08.154352 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-57ee6033-3311-42ce-abe7-1fd644a26bca tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:08.155041 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-57ee6033-3311-42ce-abe7-1fd644a26bca tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:08.155493 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-57ee6033-3311-42ce-abe7-1fd644a26bca tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:08.155917 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-57ee6033-3311-42ce-abe7-1fd644a26bca tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:08.177608 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:39:08.351261 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-57ee6033-3311-42ce-abe7-1fd644a26bca tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac5dffd3204413a8834d05db267c3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31998483af514a1a8f87ab761d5cf3ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:39:08.362237 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-57ee6033-3311-42ce-abe7-1fd644a26bca tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] 10.222.0.84 "GET /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe" status: 200 len: 1259 microversion: 2.1 time: 0.221547 Aug 24 11:39:08.363177 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 322/690] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:39:08 2022] GET /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe => generated 1259 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:39:09.083518 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-7318ddae-2780-4dc0-8de5-cb1869495b5d tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:39:09.084487 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-7318ddae-2780-4dc0-8de5-cb1869495b5d tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: a8ce5b7f-1b02-4746-9aa5-0d826615df18] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:39:09.091279 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-7318ddae-2780-4dc0-8de5-cb1869495b5d tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:09.091774 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-7318ddae-2780-4dc0-8de5-cb1869495b5d tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:09.092216 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-7318ddae-2780-4dc0-8de5-cb1869495b5d tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:09.092969 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-7318ddae-2780-4dc0-8de5-cb1869495b5d tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:09.093432 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-7318ddae-2780-4dc0-8de5-cb1869495b5d tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:09.093923 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-7318ddae-2780-4dc0-8de5-cb1869495b5d tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:09.275924 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-7318ddae-2780-4dc0-8de5-cb1869495b5d tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:39:09.290470 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-7318ddae-2780-4dc0-8de5-cb1869495b5d tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18" status: 200 len: 1735 microversion: 2.1 time: 0.212702 Aug 24 11:39:09.291381 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 369/691] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:39:09 2022] GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18 => generated 1735 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:39:09.391820 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-340f5538-3e6e-41ca-98ba-288d23c8baa0 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:39:09.392871 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-340f5538-3e6e-41ca-98ba-288d23c8baa0 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] [instance: 52f331ec-d0ce-4940-8430-11e9b6732cfe] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:39:09.403252 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-340f5538-3e6e-41ca-98ba-288d23c8baa0 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:09.404073 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-340f5538-3e6e-41ca-98ba-288d23c8baa0 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:09.404777 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-340f5538-3e6e-41ca-98ba-288d23c8baa0 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:09.405918 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-340f5538-3e6e-41ca-98ba-288d23c8baa0 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:09.406647 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-340f5538-3e6e-41ca-98ba-288d23c8baa0 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:09.407341 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-340f5538-3e6e-41ca-98ba-288d23c8baa0 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:09.565163 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-340f5538-3e6e-41ca-98ba-288d23c8baa0 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac5dffd3204413a8834d05db267c3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31998483af514a1a8f87ab761d5cf3ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:39:09.573321 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-340f5538-3e6e-41ca-98ba-288d23c8baa0 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] 10.222.0.84 "GET /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe" status: 200 len: 1259 microversion: 2.1 time: 0.188139 Aug 24 11:39:09.573903 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 323/692] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:39:09 2022] GET /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe => generated 1259 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:39:10.327489 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-684e480a-4a78-4d5e-b8f8-d33fd35b7d04 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:39:10.328104 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-684e480a-4a78-4d5e-b8f8-d33fd35b7d04 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: a8ce5b7f-1b02-4746-9aa5-0d826615df18] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:39:10.335472 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-684e480a-4a78-4d5e-b8f8-d33fd35b7d04 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:10.336112 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-684e480a-4a78-4d5e-b8f8-d33fd35b7d04 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:10.336550 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-684e480a-4a78-4d5e-b8f8-d33fd35b7d04 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:10.337316 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-684e480a-4a78-4d5e-b8f8-d33fd35b7d04 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:10.337805 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-684e480a-4a78-4d5e-b8f8-d33fd35b7d04 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:10.338230 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-684e480a-4a78-4d5e-b8f8-d33fd35b7d04 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:10.502913 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-684e480a-4a78-4d5e-b8f8-d33fd35b7d04 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:39:10.516535 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-684e480a-4a78-4d5e-b8f8-d33fd35b7d04 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18" status: 200 len: 1735 microversion: 2.1 time: 0.192607 Aug 24 11:39:10.517537 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 370/693] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:39:10 2022] GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18 => generated 1735 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:39:10.597079 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-ac63bfd6-0010-4406-87ce-d99e6232d6a1 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:39:10.597902 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-ac63bfd6-0010-4406-87ce-d99e6232d6a1 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] [instance: 52f331ec-d0ce-4940-8430-11e9b6732cfe] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:39:10.600313 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_api:SELECT=45 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:39:10.605608 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ac63bfd6-0010-4406-87ce-d99e6232d6a1 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:10.610568 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ac63bfd6-0010-4406-87ce-d99e6232d6a1 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:10.610568 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ac63bfd6-0010-4406-87ce-d99e6232d6a1 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:10.610568 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ac63bfd6-0010-4406-87ce-d99e6232d6a1 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:10.610568 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ac63bfd6-0010-4406-87ce-d99e6232d6a1 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:10.611862 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ac63bfd6-0010-4406-87ce-d99e6232d6a1 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:10.789824 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-ac63bfd6-0010-4406-87ce-d99e6232d6a1 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac5dffd3204413a8834d05db267c3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31998483af514a1a8f87ab761d5cf3ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:39:10.798168 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-ac63bfd6-0010-4406-87ce-d99e6232d6a1 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] 10.222.0.84 "GET /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe" status: 200 len: 1259 microversion: 2.1 time: 0.205835 Aug 24 11:39:10.799343 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 324/694] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:39:10 2022] GET /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe => generated 1259 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:39:11.548160 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-dcc1e31f-b973-4cd8-9f48-a7e980d0541e tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:39:11.549550 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-dcc1e31f-b973-4cd8-9f48-a7e980d0541e tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: a8ce5b7f-1b02-4746-9aa5-0d826615df18] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:39:11.556939 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-dcc1e31f-b973-4cd8-9f48-a7e980d0541e tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:11.557436 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-dcc1e31f-b973-4cd8-9f48-a7e980d0541e tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:11.557874 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-dcc1e31f-b973-4cd8-9f48-a7e980d0541e tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:11.558578 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-dcc1e31f-b973-4cd8-9f48-a7e980d0541e tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:11.559085 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-dcc1e31f-b973-4cd8-9f48-a7e980d0541e tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:11.559454 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-dcc1e31f-b973-4cd8-9f48-a7e980d0541e tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:11.703135 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-dcc1e31f-b973-4cd8-9f48-a7e980d0541e tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:39:11.712263 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-dcc1e31f-b973-4cd8-9f48-a7e980d0541e tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18" status: 200 len: 1735 microversion: 2.1 time: 0.168372 Aug 24 11:39:11.712863 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 371/695] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:39:11 2022] GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18 => generated 1735 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:39:11.824522 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-8af00f03-2ea4-44b1-b765-46f6f7953a19 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:39:11.825667 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-8af00f03-2ea4-44b1-b765-46f6f7953a19 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] [instance: 52f331ec-d0ce-4940-8430-11e9b6732cfe] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:39:11.834714 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8af00f03-2ea4-44b1-b765-46f6f7953a19 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:11.836300 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8af00f03-2ea4-44b1-b765-46f6f7953a19 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:11.836300 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8af00f03-2ea4-44b1-b765-46f6f7953a19 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:11.836542 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8af00f03-2ea4-44b1-b765-46f6f7953a19 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:11.837268 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8af00f03-2ea4-44b1-b765-46f6f7953a19 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:11.837947 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8af00f03-2ea4-44b1-b765-46f6f7953a19 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:11.992314 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-8af00f03-2ea4-44b1-b765-46f6f7953a19 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac5dffd3204413a8834d05db267c3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31998483af514a1a8f87ab761d5cf3ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:39:12.000832 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-8af00f03-2ea4-44b1-b765-46f6f7953a19 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] 10.222.0.84 "GET /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe" status: 200 len: 1259 microversion: 2.1 time: 0.182890 Aug 24 11:39:12.001415 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 325/696] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:39:11 2022] GET /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe => generated 1259 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:39:12.734063 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-9bf1673e-b8a1-4367-8e18-949ff1156a01 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:39:12.734748 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-9bf1673e-b8a1-4367-8e18-949ff1156a01 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: a8ce5b7f-1b02-4746-9aa5-0d826615df18] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:39:12.741974 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-9bf1673e-b8a1-4367-8e18-949ff1156a01 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:12.742450 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-9bf1673e-b8a1-4367-8e18-949ff1156a01 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:12.742881 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-9bf1673e-b8a1-4367-8e18-949ff1156a01 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:12.743566 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-9bf1673e-b8a1-4367-8e18-949ff1156a01 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:12.744017 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-9bf1673e-b8a1-4367-8e18-949ff1156a01 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:12.744435 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-9bf1673e-b8a1-4367-8e18-949ff1156a01 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:12.903105 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-9bf1673e-b8a1-4367-8e18-949ff1156a01 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:39:12.921454 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-9bf1673e-b8a1-4367-8e18-949ff1156a01 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18" status: 200 len: 1735 microversion: 2.1 time: 0.190895 Aug 24 11:39:12.921454 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 372/697] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:39:12 2022] GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18 => generated 1735 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:39:13.025786 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-79a9a74c-de44-4960-9475-75373787ab63 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:39:13.027145 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-79a9a74c-de44-4960-9475-75373787ab63 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] [instance: 52f331ec-d0ce-4940-8430-11e9b6732cfe] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:39:13.034422 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-79a9a74c-de44-4960-9475-75373787ab63 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:13.034971 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-79a9a74c-de44-4960-9475-75373787ab63 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:13.035437 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-79a9a74c-de44-4960-9475-75373787ab63 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:13.036199 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-79a9a74c-de44-4960-9475-75373787ab63 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:13.036696 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-79a9a74c-de44-4960-9475-75373787ab63 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:13.037167 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-79a9a74c-de44-4960-9475-75373787ab63 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:13.185412 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-79a9a74c-de44-4960-9475-75373787ab63 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac5dffd3204413a8834d05db267c3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31998483af514a1a8f87ab761d5cf3ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:39:13.194039 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-79a9a74c-de44-4960-9475-75373787ab63 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] 10.222.0.84 "GET /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe" status: 200 len: 1259 microversion: 2.1 time: 0.172192 Aug 24 11:39:13.194617 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 326/698] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:39:13 2022] GET /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe => generated 1259 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:39:13.945184 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-ed34f37c-f7e8-4f90-b82e-a32c148ecd83 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:39:13.945739 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-ed34f37c-f7e8-4f90-b82e-a32c148ecd83 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: a8ce5b7f-1b02-4746-9aa5-0d826615df18] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:39:13.952720 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-ed34f37c-f7e8-4f90-b82e-a32c148ecd83 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:13.953284 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-ed34f37c-f7e8-4f90-b82e-a32c148ecd83 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:13.953813 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-ed34f37c-f7e8-4f90-b82e-a32c148ecd83 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:13.955239 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-ed34f37c-f7e8-4f90-b82e-a32c148ecd83 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:13.956069 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-ed34f37c-f7e8-4f90-b82e-a32c148ecd83 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:13.956785 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-ed34f37c-f7e8-4f90-b82e-a32c148ecd83 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:14.115071 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-ed34f37c-f7e8-4f90-b82e-a32c148ecd83 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:39:14.123987 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-ed34f37c-f7e8-4f90-b82e-a32c148ecd83 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18" status: 200 len: 1735 microversion: 2.1 time: 0.183434 Aug 24 11:39:14.124545 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 373/699] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:39:13 2022] GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18 => generated 1735 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:39:14.214930 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-46bf9690-f7fd-461f-9b57-4c7e53f045ff tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:39:14.215496 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-46bf9690-f7fd-461f-9b57-4c7e53f045ff tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] [instance: 52f331ec-d0ce-4940-8430-11e9b6732cfe] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:39:14.224253 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-46bf9690-f7fd-461f-9b57-4c7e53f045ff tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:14.224724 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-46bf9690-f7fd-461f-9b57-4c7e53f045ff tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:14.225195 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-46bf9690-f7fd-461f-9b57-4c7e53f045ff tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:14.225954 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-46bf9690-f7fd-461f-9b57-4c7e53f045ff tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:14.226412 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-46bf9690-f7fd-461f-9b57-4c7e53f045ff tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:14.226853 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-46bf9690-f7fd-461f-9b57-4c7e53f045ff tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:14.374029 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-46bf9690-f7fd-461f-9b57-4c7e53f045ff tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac5dffd3204413a8834d05db267c3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31998483af514a1a8f87ab761d5cf3ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:39:14.383189 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-46bf9690-f7fd-461f-9b57-4c7e53f045ff tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] 10.222.0.84 "GET /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe" status: 200 len: 1259 microversion: 2.1 time: 0.172116 Aug 24 11:39:14.383762 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 327/700] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:39:14 2022] GET /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe => generated 1259 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:39:14.944188 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [req-335c6bd0-d6c5-4075-a855-e26d9c6fa0b2 req-06bca693-03a5-4dc8-b1b5-db51c0d229b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52f331ec-d0ce-4940-8430-11e9b6732cfe", "name": "network-vif-plugged", "status": "completed", "tag": "2922ba9f-42e7-4aaf-a9d1-30bc6103646f"}]} {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:39:14.951772 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [req-335c6bd0-d6c5-4075-a855-e26d9c6fa0b2 req-06bca693-03a5-4dc8-b1b5-db51c0d229b0 service nova] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:14.952873 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [req-335c6bd0-d6c5-4075-a855-e26d9c6fa0b2 req-06bca693-03a5-4dc8-b1b5-db51c0d229b0 service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:14.953066 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [req-335c6bd0-d6c5-4075-a855-e26d9c6fa0b2 req-06bca693-03a5-4dc8-b1b5-db51c0d229b0 service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:14.964646 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.compute.server_external_events [req-335c6bd0-d6c5-4075-a855-e26d9c6fa0b2 req-06bca693-03a5-4dc8-b1b5-db51c0d229b0 service nova] Creating event network-vif-plugged:2922ba9f-42e7-4aaf-a9d1-30bc6103646f for instance 52f331ec-d0ce-4940-8430-11e9b6732cfe on hv-cinder-85427 Aug 24 11:39:14.969866 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [req-335c6bd0-d6c5-4075-a855-e26d9c6fa0b2 req-06bca693-03a5-4dc8-b1b5-db51c0d229b0 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033228 Aug 24 11:39:14.971200 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 374/701] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Aug 24 11:39:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:39:15.147306 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-723abb10-2b96-4895-9af8-948834f374f7 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:39:15.147918 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-723abb10-2b96-4895-9af8-948834f374f7 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: a8ce5b7f-1b02-4746-9aa5-0d826615df18] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:39:15.154379 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-723abb10-2b96-4895-9af8-948834f374f7 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:15.162954 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-723abb10-2b96-4895-9af8-948834f374f7 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:15.162954 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-723abb10-2b96-4895-9af8-948834f374f7 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:15.162954 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-723abb10-2b96-4895-9af8-948834f374f7 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:15.162954 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-723abb10-2b96-4895-9af8-948834f374f7 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:15.163327 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-723abb10-2b96-4895-9af8-948834f374f7 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:15.315588 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-723abb10-2b96-4895-9af8-948834f374f7 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:39:15.324830 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-723abb10-2b96-4895-9af8-948834f374f7 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18" status: 200 len: 1735 microversion: 2.1 time: 0.181578 Aug 24 11:39:15.325787 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 328/702] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:39:15 2022] GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18 => generated 1735 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:39:15.407307 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-01284fcf-4b7a-4f92-8388-833ec4cd23d4 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:39:15.408561 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-01284fcf-4b7a-4f92-8388-833ec4cd23d4 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] [instance: 52f331ec-d0ce-4940-8430-11e9b6732cfe] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:39:15.416506 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-01284fcf-4b7a-4f92-8388-833ec4cd23d4 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:15.417046 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-01284fcf-4b7a-4f92-8388-833ec4cd23d4 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:15.417482 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-01284fcf-4b7a-4f92-8388-833ec4cd23d4 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:15.418191 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-01284fcf-4b7a-4f92-8388-833ec4cd23d4 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:15.418644 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-01284fcf-4b7a-4f92-8388-833ec4cd23d4 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:15.419073 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-01284fcf-4b7a-4f92-8388-833ec4cd23d4 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:15.585478 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-01284fcf-4b7a-4f92-8388-833ec4cd23d4 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac5dffd3204413a8834d05db267c3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31998483af514a1a8f87ab761d5cf3ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:39:15.593601 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-01284fcf-4b7a-4f92-8388-833ec4cd23d4 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] 10.222.0.84 "GET /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe" status: 200 len: 1259 microversion: 2.1 time: 0.191728 Aug 24 11:39:15.594180 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 375/703] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:39:15 2022] GET /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe => generated 1259 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:39:16.352595 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-587b7697-91d1-448e-8ef9-09cc111762ca tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:39:16.353230 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-587b7697-91d1-448e-8ef9-09cc111762ca tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: a8ce5b7f-1b02-4746-9aa5-0d826615df18] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:39:16.359859 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-587b7697-91d1-448e-8ef9-09cc111762ca tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:16.360359 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-587b7697-91d1-448e-8ef9-09cc111762ca tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:16.361477 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-587b7697-91d1-448e-8ef9-09cc111762ca tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:16.362179 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-587b7697-91d1-448e-8ef9-09cc111762ca tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:16.362634 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-587b7697-91d1-448e-8ef9-09cc111762ca tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:16.363061 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-587b7697-91d1-448e-8ef9-09cc111762ca tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:16.510609 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-587b7697-91d1-448e-8ef9-09cc111762ca tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:39:16.520915 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-587b7697-91d1-448e-8ef9-09cc111762ca tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18" status: 200 len: 1735 microversion: 2.1 time: 0.172291 Aug 24 11:39:16.521510 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 329/704] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:39:16 2022] GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18 => generated 1735 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:39:16.615690 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-fc2167a8-3341-4b6e-a199-58575ce6c841 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:39:16.616249 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-fc2167a8-3341-4b6e-a199-58575ce6c841 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] [instance: 52f331ec-d0ce-4940-8430-11e9b6732cfe] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:39:16.623565 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-fc2167a8-3341-4b6e-a199-58575ce6c841 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:16.624054 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-fc2167a8-3341-4b6e-a199-58575ce6c841 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:16.624492 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-fc2167a8-3341-4b6e-a199-58575ce6c841 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:16.625360 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-fc2167a8-3341-4b6e-a199-58575ce6c841 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:16.625816 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-fc2167a8-3341-4b6e-a199-58575ce6c841 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:16.626234 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-fc2167a8-3341-4b6e-a199-58575ce6c841 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:16.773591 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-fc2167a8-3341-4b6e-a199-58575ce6c841 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac5dffd3204413a8834d05db267c3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31998483af514a1a8f87ab761d5cf3ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:39:16.781717 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-fc2167a8-3341-4b6e-a199-58575ce6c841 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] 10.222.0.84 "GET /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe" status: 200 len: 1259 microversion: 2.1 time: 0.170972 Aug 24 11:39:16.782321 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 376/705] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:39:16 2022] GET /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe => generated 1259 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:39:17.544104 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-7088a213-bb96-406b-a1a9-c1c2c80f28c0 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:39:17.544719 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-7088a213-bb96-406b-a1a9-c1c2c80f28c0 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: a8ce5b7f-1b02-4746-9aa5-0d826615df18] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:39:17.552629 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-7088a213-bb96-406b-a1a9-c1c2c80f28c0 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:17.554560 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-7088a213-bb96-406b-a1a9-c1c2c80f28c0 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:17.554560 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-7088a213-bb96-406b-a1a9-c1c2c80f28c0 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:17.554560 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-7088a213-bb96-406b-a1a9-c1c2c80f28c0 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:17.554969 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-7088a213-bb96-406b-a1a9-c1c2c80f28c0 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:17.555260 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-7088a213-bb96-406b-a1a9-c1c2c80f28c0 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:17.699957 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-7088a213-bb96-406b-a1a9-c1c2c80f28c0 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:39:17.709319 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-7088a213-bb96-406b-a1a9-c1c2c80f28c0 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18" status: 200 len: 1735 microversion: 2.1 time: 0.168982 Aug 24 11:39:17.709909 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 330/706] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:39:17 2022] GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18 => generated 1735 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:39:17.802847 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-5cdf13ec-382d-4461-a348-47518a87461c tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:39:17.803479 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-5cdf13ec-382d-4461-a348-47518a87461c tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] [instance: 52f331ec-d0ce-4940-8430-11e9b6732cfe] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:39:17.812614 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-5cdf13ec-382d-4461-a348-47518a87461c tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:17.813234 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-5cdf13ec-382d-4461-a348-47518a87461c tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:17.813676 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-5cdf13ec-382d-4461-a348-47518a87461c tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:17.815006 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-5cdf13ec-382d-4461-a348-47518a87461c tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:17.815584 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-5cdf13ec-382d-4461-a348-47518a87461c tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:17.816010 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-5cdf13ec-382d-4461-a348-47518a87461c tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:17.964066 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-5cdf13ec-382d-4461-a348-47518a87461c tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac5dffd3204413a8834d05db267c3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31998483af514a1a8f87ab761d5cf3ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:39:17.973424 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-5cdf13ec-382d-4461-a348-47518a87461c tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] 10.222.0.84 "GET /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe" status: 200 len: 1259 microversion: 2.1 time: 0.174363 Aug 24 11:39:17.974014 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 377/707] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:39:17 2022] GET /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe => generated 1259 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:39:18.731866 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-e352d04a-7f6e-416e-86e2-8b5da462bc13 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:39:18.732557 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-e352d04a-7f6e-416e-86e2-8b5da462bc13 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: a8ce5b7f-1b02-4746-9aa5-0d826615df18] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:39:18.740426 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e352d04a-7f6e-416e-86e2-8b5da462bc13 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:18.741002 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e352d04a-7f6e-416e-86e2-8b5da462bc13 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:18.741444 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e352d04a-7f6e-416e-86e2-8b5da462bc13 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:18.742160 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e352d04a-7f6e-416e-86e2-8b5da462bc13 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:18.742617 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e352d04a-7f6e-416e-86e2-8b5da462bc13 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:18.743137 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e352d04a-7f6e-416e-86e2-8b5da462bc13 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:18.890604 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-e352d04a-7f6e-416e-86e2-8b5da462bc13 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:39:18.899719 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-e352d04a-7f6e-416e-86e2-8b5da462bc13 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18" status: 200 len: 1735 microversion: 2.1 time: 0.171647 Aug 24 11:39:18.900310 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 331/708] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:39:18 2022] GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18 => generated 1735 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:39:18.995082 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-e5192f9f-0929-46cf-b00f-fd9afba40567 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:39:18.995965 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-e5192f9f-0929-46cf-b00f-fd9afba40567 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] [instance: 52f331ec-d0ce-4940-8430-11e9b6732cfe] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:39:19.004663 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-e5192f9f-0929-46cf-b00f-fd9afba40567 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:19.005201 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-e5192f9f-0929-46cf-b00f-fd9afba40567 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:19.005695 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-e5192f9f-0929-46cf-b00f-fd9afba40567 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:19.006420 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-e5192f9f-0929-46cf-b00f-fd9afba40567 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:19.006956 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-e5192f9f-0929-46cf-b00f-fd9afba40567 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:19.007305 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-e5192f9f-0929-46cf-b00f-fd9afba40567 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:19.163186 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-e5192f9f-0929-46cf-b00f-fd9afba40567 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac5dffd3204413a8834d05db267c3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31998483af514a1a8f87ab761d5cf3ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:39:19.179117 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-e5192f9f-0929-46cf-b00f-fd9afba40567 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] 10.222.0.84 "GET /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe" status: 200 len: 1259 microversion: 2.1 time: 0.187887 Aug 24 11:39:19.179732 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 378/709] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:39:18 2022] GET /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe => generated 1259 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:39:19.924040 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-de4f6e3c-1a90-4d7c-a455-252878cd6910 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:39:19.924721 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-de4f6e3c-1a90-4d7c-a455-252878cd6910 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: a8ce5b7f-1b02-4746-9aa5-0d826615df18] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:39:19.931123 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-de4f6e3c-1a90-4d7c-a455-252878cd6910 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:19.931607 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-de4f6e3c-1a90-4d7c-a455-252878cd6910 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:19.932063 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-de4f6e3c-1a90-4d7c-a455-252878cd6910 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:19.932734 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-de4f6e3c-1a90-4d7c-a455-252878cd6910 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:19.933238 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-de4f6e3c-1a90-4d7c-a455-252878cd6910 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:19.933638 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-de4f6e3c-1a90-4d7c-a455-252878cd6910 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:20.099171 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-de4f6e3c-1a90-4d7c-a455-252878cd6910 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:39:20.114632 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-de4f6e3c-1a90-4d7c-a455-252878cd6910 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18" status: 200 len: 1735 microversion: 2.1 time: 0.194161 Aug 24 11:39:20.115668 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 332/710] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:39:19 2022] GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18 => generated 1735 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:39:20.208104 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-83b67ce1-a800-4d00-bcb6-fd5c275558b6 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:39:20.209011 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-83b67ce1-a800-4d00-bcb6-fd5c275558b6 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] [instance: 52f331ec-d0ce-4940-8430-11e9b6732cfe] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:39:20.220975 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-83b67ce1-a800-4d00-bcb6-fd5c275558b6 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:20.221864 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-83b67ce1-a800-4d00-bcb6-fd5c275558b6 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:20.222666 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-83b67ce1-a800-4d00-bcb6-fd5c275558b6 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:20.224001 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-83b67ce1-a800-4d00-bcb6-fd5c275558b6 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:20.224856 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-83b67ce1-a800-4d00-bcb6-fd5c275558b6 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:20.225638 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-83b67ce1-a800-4d00-bcb6-fd5c275558b6 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:20.398226 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-83b67ce1-a800-4d00-bcb6-fd5c275558b6 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac5dffd3204413a8834d05db267c3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31998483af514a1a8f87ab761d5cf3ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:39:20.407707 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-83b67ce1-a800-4d00-bcb6-fd5c275558b6 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] 10.222.0.84 "GET /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe" status: 200 len: 1442 microversion: 2.1 time: 0.208074 Aug 24 11:39:20.408644 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 379/711] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:39:20 2022] GET /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe => generated 1442 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:39:20.428256 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-032899a7-2172-48f8-8bb5-87ee03e5af51 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:39:20.428890 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-032899a7-2172-48f8-8bb5-87ee03e5af51 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] [instance: 52f331ec-d0ce-4940-8430-11e9b6732cfe] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:39:20.435156 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-032899a7-2172-48f8-8bb5-87ee03e5af51 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:20.435640 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-032899a7-2172-48f8-8bb5-87ee03e5af51 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:20.436084 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-032899a7-2172-48f8-8bb5-87ee03e5af51 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:20.436785 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-032899a7-2172-48f8-8bb5-87ee03e5af51 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:20.437262 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-032899a7-2172-48f8-8bb5-87ee03e5af51 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:20.437686 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-032899a7-2172-48f8-8bb5-87ee03e5af51 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:20.598496 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-032899a7-2172-48f8-8bb5-87ee03e5af51 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac5dffd3204413a8834d05db267c3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31998483af514a1a8f87ab761d5cf3ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:39:20.607458 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-032899a7-2172-48f8-8bb5-87ee03e5af51 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] 10.222.0.84 "GET /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe" status: 200 len: 1442 microversion: 2.1 time: 0.183141 Aug 24 11:39:20.608041 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 333/712] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:39:20 2022] GET /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe => generated 1442 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:39:21.145683 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-778a209e-38c5-43a9-ad55-f36853ce7657 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:39:21.146816 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-778a209e-38c5-43a9-ad55-f36853ce7657 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: a8ce5b7f-1b02-4746-9aa5-0d826615df18] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:39:21.158143 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-778a209e-38c5-43a9-ad55-f36853ce7657 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:21.159052 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-778a209e-38c5-43a9-ad55-f36853ce7657 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:21.159817 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-778a209e-38c5-43a9-ad55-f36853ce7657 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:21.161172 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-778a209e-38c5-43a9-ad55-f36853ce7657 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:21.161978 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-778a209e-38c5-43a9-ad55-f36853ce7657 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:21.162730 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-778a209e-38c5-43a9-ad55-f36853ce7657 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:21.346708 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-778a209e-38c5-43a9-ad55-f36853ce7657 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:39:21.358149 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-778a209e-38c5-43a9-ad55-f36853ce7657 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18" status: 200 len: 1715 microversion: 2.1 time: 0.224258 Aug 24 11:39:21.358928 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 380/713] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:39:21 2022] GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18 => generated 1715 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:39:21.455098 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-be12690b-42bb-411b-bebf-6b14e8ae5450 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:39:21.455818 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-be12690b-42bb-411b-bebf-6b14e8ae5450 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: a8ce5b7f-1b02-4746-9aa5-0d826615df18] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:39:21.471457 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-be12690b-42bb-411b-bebf-6b14e8ae5450 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:21.471457 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-be12690b-42bb-411b-bebf-6b14e8ae5450 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:21.471457 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-be12690b-42bb-411b-bebf-6b14e8ae5450 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:21.471457 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-be12690b-42bb-411b-bebf-6b14e8ae5450 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:21.471961 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-be12690b-42bb-411b-bebf-6b14e8ae5450 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:21.471961 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-be12690b-42bb-411b-bebf-6b14e8ae5450 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:21.577903 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.wsgi [None req-be12690b-42bb-411b-bebf-6b14e8ae5450 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] HTTP exception thrown: Cannot 'detach_volume' instance a8ce5b7f-1b02-4746-9aa5-0d826615df18 while it is in vm_state rescued Aug 24 11:39:21.579638 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-be12690b-42bb-411b-bebf-6b14e8ae5450 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Request method failure captured: Aug 24 11:39:21.579638 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: request: DELETE /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18/os-volume_attachments/6427e65b-6458-4f62-9b33-99bdc9a6a645 HTTP/1.1 Aug 24 11:39:21.579638 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Accept: application/json Aug 24 11:39:21.579638 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Accept-Encoding: identity Aug 24 11:39:21.579638 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Connection: close Aug 24 11:39:21.579638 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Content-Length: 0 Aug 24 11:39:21.579638 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Content-Type: application/json Aug 24 11:39:21.579638 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Host: 10.222.0.84 Aug 24 11:39:21.579638 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Openstack-System-Scope: None Aug 24 11:39:21.579638 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: User-Agent: python-urllib3/1.26.11 Aug 24 11:39:21.579638 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Auth-Token: gAAAAABjBgwcqa0CYUPhW6H0Ka_8PQo6WuRnVZxjJiGxVsP8OjBajZzTfRi-wT8euSPFOEzkWOlYPU2oyt3p2sSsquSlSFvb_OOqjFi6GL1r-duvQ_e_lEwQ5SQEw1PDuzr4YOYFBd4Fp8LuJKTid5FAIFqTau26udI57bZEjikHTi6akUiQBpI Aug 24 11:39:21.579638 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Domain-Id: None Aug 24 11:39:21.579638 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Domain-Name: None Aug 24 11:39:21.579638 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Identity-Status: Confirmed Aug 24 11:39:21.579638 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Is-Admin-Project: True Aug 24 11:39:21.579638 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Project-Domain-Id: default Aug 24 11:39:21.579638 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Project-Domain-Name: Default Aug 24 11:39:21.579638 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Project-Id: 048c7f026f304084960d77bf46f367d8 Aug 24 11:39:21.579638 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-309471798 Aug 24 11:39:21.579638 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Role: reader,member Aug 24 11:39:21.579638 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Roles: reader,member Aug 24 11:39:21.582092 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/volume/v3/048c7f026f304084960d77bf46f367d8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/volume/v3/048c7f026f304084960d77bf46f367d8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/compute/v2/048c7f026f304084960d77bf46f367d8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84:8080/v1/AUTH_048c7f026f304084960d77bf46f367d8", "adminURL": "http://10.222.0.84:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/placement"}]}] Aug 24 11:39:21.582092 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Tenant: tempest-ServerRescueNegativeTestJSON-309471798 Aug 24 11:39:21.582092 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Tenant-Id: 048c7f026f304084960d77bf46f367d8 Aug 24 11:39:21.582092 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-309471798 Aug 24 11:39:21.582092 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User: tempest-ServerRescueNegativeTestJSON-309471798-project Aug 24 11:39:21.582092 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User-Domain-Id: default Aug 24 11:39:21.582092 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User-Domain-Name: Default Aug 24 11:39:21.582092 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User-Id: 2d5bfffc316f481183093e386a326946 Aug 24 11:39:21.582092 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User-Name: tempest-ServerRescueNegativeTestJSON-309471798-project Aug 24 11:39:21.582092 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: method: > Aug 24 11:39:21.582092 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: exception: Cannot 'detach_volume' instance a8ce5b7f-1b02-4746-9aa5-0d826615df18 while it is in vm_state rescued Aug 24 11:39:21.583288 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: action_args: {'server_id': 'a8ce5b7f-1b02-4746-9aa5-0d826615df18', 'id': '6427e65b-6458-4f62-9b33-99bdc9a6a645'} Aug 24 11:39:21.583288 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:39:21.583288 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:39:21.583288 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 24 11:39:21.583288 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 24 11:39:21.583288 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 11:39:21.583288 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 11:39:21.583288 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 24 11:39:21.583288 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 24 11:39:21.583288 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a8ce5b7f-1b02-4746-9aa5-0d826615df18 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 24 11:39:21.583288 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:39:21.583288 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:39:21.583288 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:39:21.583288 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:39:21.583288 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:39:21.583288 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:39:21.583288 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:39:21.583288 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:39:21.583288 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:39:21.583288 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:39:21.585257 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 24 11:39:21.585257 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 24 11:39:21.585257 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 24 11:39:21.585257 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 24 11:39:21.585257 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance a8ce5b7f-1b02-4746-9aa5-0d826615df18 while it is in vm_state rescued Aug 24 11:39:21.585257 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:39:21.585257 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:39:21.585257 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:39:21.585257 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:39:21.585257 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:39:21.585257 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:39:21.585257 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:39:21.585257 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:39:21.585257 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance a8ce5b7f-1b02-4746-9aa5-0d826615df18 while it is in vm_state rescued Aug 24 11:39:21.585257 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:39:21.585257 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-be12690b-42bb-411b-bebf-6b14e8ae5450 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Returning 409 to user: Cannot 'detach_volume' instance a8ce5b7f-1b02-4746-9aa5-0d826615df18 while it is in vm_state rescued {{(pid=124770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:39:21.587424 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-be12690b-42bb-411b-bebf-6b14e8ae5450 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "DELETE /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18/os-volume_attachments/6427e65b-6458-4f62-9b33-99bdc9a6a645" status: 409 len: 152 microversion: 2.1 time: 0.130527 Aug 24 11:39:21.587424 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 334/714] 10.222.0.84 () {58 vars in 1416 bytes} [Wed Aug 24 11:39:21 2022] DELETE /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18/os-volume_attachments/6427e65b-6458-4f62-9b33-99bdc9a6a645 => generated 152 bytes in 132 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 24 11:39:21.598039 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-9c7ee560-647c-453d-bbec-aca6e8df3263 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:39:21.598985 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-9c7ee560-647c-453d-bbec-aca6e8df3263 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: a8ce5b7f-1b02-4746-9aa5-0d826615df18] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:39:21.609791 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-9c7ee560-647c-453d-bbec-aca6e8df3263 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:21.611226 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-9c7ee560-647c-453d-bbec-aca6e8df3263 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:21.612024 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-9c7ee560-647c-453d-bbec-aca6e8df3263 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:21.613318 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-9c7ee560-647c-453d-bbec-aca6e8df3263 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:21.614169 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-9c7ee560-647c-453d-bbec-aca6e8df3263 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:21.614952 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-9c7ee560-647c-453d-bbec-aca6e8df3263 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:21.914557 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-9c7ee560-647c-453d-bbec-aca6e8df3263 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "POST /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18/action" status: 202 len: 0 microversion: 2.1 time: 0.323378 Aug 24 11:39:21.920980 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 381/715] 10.222.0.84 () {60 vars in 1278 bytes} [Wed Aug 24 11:39:21 2022] POST /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18/action => generated 0 bytes in 327 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:39:21.929404 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-f98083be-bc99-4b73-a77b-00437c01ee9a tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:39:21.930401 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-f98083be-bc99-4b73-a77b-00437c01ee9a tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: a8ce5b7f-1b02-4746-9aa5-0d826615df18] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:39:21.941345 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-f98083be-bc99-4b73-a77b-00437c01ee9a tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:21.942663 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-f98083be-bc99-4b73-a77b-00437c01ee9a tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:21.943530 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-f98083be-bc99-4b73-a77b-00437c01ee9a tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:21.945261 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-f98083be-bc99-4b73-a77b-00437c01ee9a tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:21.945555 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-f98083be-bc99-4b73-a77b-00437c01ee9a tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:21.946171 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-f98083be-bc99-4b73-a77b-00437c01ee9a tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:22.299307 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-f98083be-bc99-4b73-a77b-00437c01ee9a tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:39:22.308353 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-f98083be-bc99-4b73-a77b-00437c01ee9a tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18" status: 200 len: 1723 microversion: 2.1 time: 0.385570 Aug 24 11:39:22.309291 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 335/716] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:39:21 2022] GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18 => generated 1723 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:39:23.334544 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-fd518492-6fa3-4f19-ae00-fe857c87b5ad tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:39:23.335348 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-fd518492-6fa3-4f19-ae00-fe857c87b5ad tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: a8ce5b7f-1b02-4746-9aa5-0d826615df18] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:39:23.346846 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-fd518492-6fa3-4f19-ae00-fe857c87b5ad tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:23.347814 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-fd518492-6fa3-4f19-ae00-fe857c87b5ad tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:23.348686 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-fd518492-6fa3-4f19-ae00-fe857c87b5ad tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:23.350071 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-fd518492-6fa3-4f19-ae00-fe857c87b5ad tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:23.351026 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-fd518492-6fa3-4f19-ae00-fe857c87b5ad tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:23.351889 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-fd518492-6fa3-4f19-ae00-fe857c87b5ad tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:23.535527 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-fd518492-6fa3-4f19-ae00-fe857c87b5ad tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:39:23.545110 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-fd518492-6fa3-4f19-ae00-fe857c87b5ad tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18" status: 200 len: 1723 microversion: 2.1 time: 0.216754 Aug 24 11:39:23.545654 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 382/717] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:39:23 2022] GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18 => generated 1723 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:39:23.950281 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [req-e304cd68-0aab-43fe-b9ae-a38a93281678 req-1ca37df4-c02e-4445-8ed5-d0108978185a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52f331ec-d0ce-4940-8430-11e9b6732cfe", "tag": "2922ba9f-42e7-4aaf-a9d1-30bc6103646f"}]} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:39:23.961283 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-e304cd68-0aab-43fe-b9ae-a38a93281678 req-1ca37df4-c02e-4445-8ed5-d0108978185a service nova] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:23.961764 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-e304cd68-0aab-43fe-b9ae-a38a93281678 req-1ca37df4-c02e-4445-8ed5-d0108978185a service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:23.962252 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-e304cd68-0aab-43fe-b9ae-a38a93281678 req-1ca37df4-c02e-4445-8ed5-d0108978185a service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:23.986861 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.compute.server_external_events [req-e304cd68-0aab-43fe-b9ae-a38a93281678 req-1ca37df4-c02e-4445-8ed5-d0108978185a service nova] Creating event network-changed:2922ba9f-42e7-4aaf-a9d1-30bc6103646f for instance 52f331ec-d0ce-4940-8430-11e9b6732cfe on hv-cinder-85427 Aug 24 11:39:23.991859 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [req-e304cd68-0aab-43fe-b9ae-a38a93281678 req-1ca37df4-c02e-4445-8ed5-d0108978185a service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045354 Aug 24 11:39:23.992638 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 336/718] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Aug 24 11:39:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:39:24.580080 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-44878d9e-cac2-48e1-99f5-655a95375586 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:39:24.581305 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-44878d9e-cac2-48e1-99f5-655a95375586 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: a8ce5b7f-1b02-4746-9aa5-0d826615df18] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:39:24.591383 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-44878d9e-cac2-48e1-99f5-655a95375586 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:24.591882 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-44878d9e-cac2-48e1-99f5-655a95375586 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:24.592343 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-44878d9e-cac2-48e1-99f5-655a95375586 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:24.593094 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-44878d9e-cac2-48e1-99f5-655a95375586 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:24.593565 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-44878d9e-cac2-48e1-99f5-655a95375586 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:24.593993 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-44878d9e-cac2-48e1-99f5-655a95375586 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:24.763572 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-44878d9e-cac2-48e1-99f5-655a95375586 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:39:24.765936 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG dbcounter [-] [124769] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:39:24.773469 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-44878d9e-cac2-48e1-99f5-655a95375586 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18" status: 200 len: 1723 microversion: 2.1 time: 0.200846 Aug 24 11:39:24.774037 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 383/719] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:39:24 2022] GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18 => generated 1723 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:39:25.796266 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-343204ac-1836-4157-ba31-43a932e74f9d tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:39:25.797007 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-343204ac-1836-4157-ba31-43a932e74f9d tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: a8ce5b7f-1b02-4746-9aa5-0d826615df18] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:39:25.804184 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-343204ac-1836-4157-ba31-43a932e74f9d tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:25.804716 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-343204ac-1836-4157-ba31-43a932e74f9d tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:25.805305 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-343204ac-1836-4157-ba31-43a932e74f9d tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:25.806069 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-343204ac-1836-4157-ba31-43a932e74f9d tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:25.806588 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-343204ac-1836-4157-ba31-43a932e74f9d tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:25.807058 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-343204ac-1836-4157-ba31-43a932e74f9d tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:25.948566 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-343204ac-1836-4157-ba31-43a932e74f9d tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:39:25.957438 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-343204ac-1836-4157-ba31-43a932e74f9d tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18" status: 200 len: 1723 microversion: 2.1 time: 0.165505 Aug 24 11:39:25.958009 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 337/720] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:39:25 2022] GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:39:26.987317 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-e54563f5-9b23-419a-aebf-9de1155d009a tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:39:26.988339 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-e54563f5-9b23-419a-aebf-9de1155d009a tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: a8ce5b7f-1b02-4746-9aa5-0d826615df18] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:39:26.994446 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-e54563f5-9b23-419a-aebf-9de1155d009a tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:26.994943 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-e54563f5-9b23-419a-aebf-9de1155d009a tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:26.995384 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-e54563f5-9b23-419a-aebf-9de1155d009a tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:26.996090 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-e54563f5-9b23-419a-aebf-9de1155d009a tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:26.996839 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-e54563f5-9b23-419a-aebf-9de1155d009a tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:26.997275 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-e54563f5-9b23-419a-aebf-9de1155d009a tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:27.152691 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-e54563f5-9b23-419a-aebf-9de1155d009a tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:39:27.162306 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-e54563f5-9b23-419a-aebf-9de1155d009a tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18" status: 200 len: 1723 microversion: 2.1 time: 0.187012 Aug 24 11:39:27.162884 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 384/721] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:39:26 2022] GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18 => generated 1723 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:39:28.187726 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-1430efb7-9e58-4e9f-858b-acd4693fe6b8 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:39:28.188350 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-1430efb7-9e58-4e9f-858b-acd4693fe6b8 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: a8ce5b7f-1b02-4746-9aa5-0d826615df18] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:39:28.195156 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1430efb7-9e58-4e9f-858b-acd4693fe6b8 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:28.195580 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1430efb7-9e58-4e9f-858b-acd4693fe6b8 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:28.196035 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1430efb7-9e58-4e9f-858b-acd4693fe6b8 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:28.196731 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1430efb7-9e58-4e9f-858b-acd4693fe6b8 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:28.197218 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1430efb7-9e58-4e9f-858b-acd4693fe6b8 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:28.197641 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1430efb7-9e58-4e9f-858b-acd4693fe6b8 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:28.365857 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-1430efb7-9e58-4e9f-858b-acd4693fe6b8 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:39:28.365857 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-1430efb7-9e58-4e9f-858b-acd4693fe6b8 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18" status: 200 len: 1729 microversion: 2.1 time: 0.162003 Aug 24 11:39:28.365857 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 338/722] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:39:28 2022] GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18 => generated 1729 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:39:28.368576 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-77bc77b2-1eec-44c2-aae0-b20a4e18413d tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:39:28.369100 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-77bc77b2-1eec-44c2-aae0-b20a4e18413d tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: a8ce5b7f-1b02-4746-9aa5-0d826615df18] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:39:28.375907 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-77bc77b2-1eec-44c2-aae0-b20a4e18413d tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:28.376382 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-77bc77b2-1eec-44c2-aae0-b20a4e18413d tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:28.376858 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-77bc77b2-1eec-44c2-aae0-b20a4e18413d tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:28.377562 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-77bc77b2-1eec-44c2-aae0-b20a4e18413d tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:28.378014 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-77bc77b2-1eec-44c2-aae0-b20a4e18413d tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:28.378439 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-77bc77b2-1eec-44c2-aae0-b20a4e18413d tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:28.555218 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-77bc77b2-1eec-44c2-aae0-b20a4e18413d tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.098324 Aug 24 11:39:28.555218 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 385/723] 10.222.0.84 () {58 vars in 1275 bytes} [Wed Aug 24 11:39:28 2022] GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18/os-interface => generated 284 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:39:29.623289 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [req-1e63161e-e1d3-4b14-bebf-e89a282c635d req-c2722125-5985-4087-a33a-c627c533dcd3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8ce5b7f-1b02-4746-9aa5-0d826615df18", "tag": "808cd754-982d-460a-8dbd-1ce9354861d7"}]} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:39:29.647002 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-1e63161e-e1d3-4b14-bebf-e89a282c635d req-c2722125-5985-4087-a33a-c627c533dcd3 service nova] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:29.651409 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-1e63161e-e1d3-4b14-bebf-e89a282c635d req-c2722125-5985-4087-a33a-c627c533dcd3 service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:29.652043 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-1e63161e-e1d3-4b14-bebf-e89a282c635d req-c2722125-5985-4087-a33a-c627c533dcd3 service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:29.667410 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.compute.server_external_events [req-1e63161e-e1d3-4b14-bebf-e89a282c635d req-c2722125-5985-4087-a33a-c627c533dcd3 service nova] Creating event network-changed:808cd754-982d-460a-8dbd-1ce9354861d7 for instance a8ce5b7f-1b02-4746-9aa5-0d826615df18 on hv-cinder-85427 Aug 24 11:39:29.674032 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [req-1e63161e-e1d3-4b14-bebf-e89a282c635d req-c2722125-5985-4087-a33a-c627c533dcd3 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053572 Aug 24 11:39:29.674869 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 339/724] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Aug 24 11:39:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:39:31.697750 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [req-5962e3f8-207c-421e-839e-47c5b46d9930 req-af1b952e-0ed6-4c72-af30-3766fddb5b18 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8ce5b7f-1b02-4746-9aa5-0d826615df18", "tag": "808cd754-982d-460a-8dbd-1ce9354861d7"}]} {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:39:31.709115 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [req-5962e3f8-207c-421e-839e-47c5b46d9930 req-af1b952e-0ed6-4c72-af30-3766fddb5b18 service nova] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:31.709591 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [req-5962e3f8-207c-421e-839e-47c5b46d9930 req-af1b952e-0ed6-4c72-af30-3766fddb5b18 service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:31.710013 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [req-5962e3f8-207c-421e-839e-47c5b46d9930 req-af1b952e-0ed6-4c72-af30-3766fddb5b18 service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:31.722593 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.compute.server_external_events [req-5962e3f8-207c-421e-839e-47c5b46d9930 req-af1b952e-0ed6-4c72-af30-3766fddb5b18 service nova] Creating event network-changed:808cd754-982d-460a-8dbd-1ce9354861d7 for instance a8ce5b7f-1b02-4746-9aa5-0d826615df18 on hv-cinder-85427 Aug 24 11:39:31.728076 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [req-5962e3f8-207c-421e-839e-47c5b46d9930 req-af1b952e-0ed6-4c72-af30-3766fddb5b18 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037978 Aug 24 11:39:31.728760 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 386/725] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Aug 24 11:39:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:39:45.535160 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_api:SELECT=31 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:39:45.536026 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_cell1:SELECT=96 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:39:45.540463 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-5cfb016a-98b6-48ab-8c79-600ba74967a5 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:39:45.541113 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-5cfb016a-98b6-48ab-8c79-600ba74967a5 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] [instance: 15d4a46e-9504-4897-918d-39aafc20d22a] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:39:45.547725 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5cfb016a-98b6-48ab-8c79-600ba74967a5 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:45.547725 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5cfb016a-98b6-48ab-8c79-600ba74967a5 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:45.548770 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5cfb016a-98b6-48ab-8c79-600ba74967a5 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:45.549497 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5cfb016a-98b6-48ab-8c79-600ba74967a5 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:45.549968 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5cfb016a-98b6-48ab-8c79-600ba74967a5 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:45.550398 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5cfb016a-98b6-48ab-8c79-600ba74967a5 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:45.640132 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.objects.instance [None req-5cfb016a-98b6-48ab-8c79-600ba74967a5 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lazy-loading 'services' on Instance uuid 15d4a46e-9504-4897-918d-39aafc20d22a {{(pid=124770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:39:45.905278 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-5cfb016a-98b6-48ab-8c79-600ba74967a5 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] 10.222.0.84 "DELETE /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a/os-volume_attachments/c8978236-e2cb-4be5-bda9-9fe571421f02" status: 202 len: 0 microversion: 2.1 time: 0.372371 Aug 24 11:39:45.905872 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 340/726] 10.222.0.84 () {58 vars in 1416 bytes} [Wed Aug 24 11:39:45 2022] DELETE /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a/os-volume_attachments/c8978236-e2cb-4be5-bda9-9fe571421f02 => generated 0 bytes in 375 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:39:48.135807 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-f6488212-6a4e-49d2-87bb-daa7a9427b47 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:39:48.139361 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG dbcounter [-] [124769] Writing DB stats nova_api:SELECT=49 {{(pid=124769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:39:48.140343 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG dbcounter [-] [124769] Writing DB stats nova_cell1:SELECT=13 {{(pid=124769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:39:48.148212 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f6488212-6a4e-49d2-87bb-daa7a9427b47 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:48.149175 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f6488212-6a4e-49d2-87bb-daa7a9427b47 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:48.149917 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f6488212-6a4e-49d2-87bb-daa7a9427b47 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:48.259980 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-f6488212-6a4e-49d2-87bb-daa7a9427b47 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] [instance: 15d4a46e-9504-4897-918d-39aafc20d22a] Going to try to stop instance {{(pid=124769) force_stop /opt/stack/nova/nova/compute/api.py:2749}} Aug 24 11:39:48.640111 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-f6488212-6a4e-49d2-87bb-daa7a9427b47 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] 10.222.0.84 "POST /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a/action" status: 202 len: 0 microversion: 2.1 time: 0.510040 Aug 24 11:39:48.648524 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 387/727] 10.222.0.84 () {60 vars in 1278 bytes} [Wed Aug 24 11:39:48 2022] POST /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a/action => generated 0 bytes in 520 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:39:48.651575 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-c80d8f70-e2d7-46ef-a550-c7919f09d05c tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:39:48.652340 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-c80d8f70-e2d7-46ef-a550-c7919f09d05c tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] [instance: 15d4a46e-9504-4897-918d-39aafc20d22a] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:39:48.659753 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c80d8f70-e2d7-46ef-a550-c7919f09d05c tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:48.660251 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c80d8f70-e2d7-46ef-a550-c7919f09d05c tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:48.660697 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c80d8f70-e2d7-46ef-a550-c7919f09d05c tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:48.661454 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c80d8f70-e2d7-46ef-a550-c7919f09d05c tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:48.661921 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c80d8f70-e2d7-46ef-a550-c7919f09d05c tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:48.663062 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c80d8f70-e2d7-46ef-a550-c7919f09d05c tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:48.804891 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-c80d8f70-e2d7-46ef-a550-c7919f09d05c tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031939e16194f63b99e6f27f700fa8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecec6d0c155f4d658197c4779ab9ffce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:39:48.814682 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-c80d8f70-e2d7-46ef-a550-c7919f09d05c tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] 10.222.0.84 "GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a" status: 200 len: 1677 microversion: 2.1 time: 0.168203 Aug 24 11:39:48.815269 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 341/728] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:39:48 2022] GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a => generated 1677 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:39:49.842534 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-77f853bc-00ea-462e-aa33-0fbf0309f7bd tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:39:49.843319 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-77f853bc-00ea-462e-aa33-0fbf0309f7bd tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] [instance: 15d4a46e-9504-4897-918d-39aafc20d22a] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:39:49.849887 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-77f853bc-00ea-462e-aa33-0fbf0309f7bd tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:49.850363 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-77f853bc-00ea-462e-aa33-0fbf0309f7bd tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:49.850873 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-77f853bc-00ea-462e-aa33-0fbf0309f7bd tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:49.851662 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-77f853bc-00ea-462e-aa33-0fbf0309f7bd tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:49.852112 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-77f853bc-00ea-462e-aa33-0fbf0309f7bd tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:49.852529 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-77f853bc-00ea-462e-aa33-0fbf0309f7bd tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:50.012814 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-77f853bc-00ea-462e-aa33-0fbf0309f7bd tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031939e16194f63b99e6f27f700fa8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecec6d0c155f4d658197c4779ab9ffce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:39:50.022611 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-77f853bc-00ea-462e-aa33-0fbf0309f7bd tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] 10.222.0.84 "GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a" status: 200 len: 1677 microversion: 2.1 time: 0.184757 Aug 24 11:39:50.023293 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 388/729] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:39:49 2022] GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a => generated 1677 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:39:51.045302 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-24cc6455-cf2e-4d4c-b6f1-b26a90e8d165 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:39:51.045901 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-24cc6455-cf2e-4d4c-b6f1-b26a90e8d165 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] [instance: 15d4a46e-9504-4897-918d-39aafc20d22a] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:39:51.053167 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-24cc6455-cf2e-4d4c-b6f1-b26a90e8d165 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:51.053655 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-24cc6455-cf2e-4d4c-b6f1-b26a90e8d165 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:51.054091 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-24cc6455-cf2e-4d4c-b6f1-b26a90e8d165 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:51.054784 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-24cc6455-cf2e-4d4c-b6f1-b26a90e8d165 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:51.055241 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-24cc6455-cf2e-4d4c-b6f1-b26a90e8d165 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:51.055665 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-24cc6455-cf2e-4d4c-b6f1-b26a90e8d165 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:51.202492 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-24cc6455-cf2e-4d4c-b6f1-b26a90e8d165 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031939e16194f63b99e6f27f700fa8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecec6d0c155f4d658197c4779ab9ffce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:39:51.211616 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-24cc6455-cf2e-4d4c-b6f1-b26a90e8d165 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] 10.222.0.84 "GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a" status: 200 len: 1677 microversion: 2.1 time: 0.170234 Aug 24 11:39:51.212321 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 342/730] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:39:51 2022] GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a => generated 1677 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:39:52.243623 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-f16f4428-77e9-4428-ab37-7176ea19cbe8 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:39:52.244254 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-f16f4428-77e9-4428-ab37-7176ea19cbe8 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] [instance: 15d4a46e-9504-4897-918d-39aafc20d22a] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:39:52.252926 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f16f4428-77e9-4428-ab37-7176ea19cbe8 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:52.253467 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f16f4428-77e9-4428-ab37-7176ea19cbe8 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:52.254848 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f16f4428-77e9-4428-ab37-7176ea19cbe8 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:52.255565 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f16f4428-77e9-4428-ab37-7176ea19cbe8 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:52.256020 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f16f4428-77e9-4428-ab37-7176ea19cbe8 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:52.256440 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f16f4428-77e9-4428-ab37-7176ea19cbe8 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:52.396999 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-f16f4428-77e9-4428-ab37-7176ea19cbe8 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031939e16194f63b99e6f27f700fa8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecec6d0c155f4d658197c4779ab9ffce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:39:52.405319 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-f16f4428-77e9-4428-ab37-7176ea19cbe8 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] 10.222.0.84 "GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a" status: 200 len: 1677 microversion: 2.1 time: 0.173423 Aug 24 11:39:52.405899 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 389/731] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:39:52 2022] GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a => generated 1677 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:39:53.426873 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-662137c4-b9f1-4a67-af4c-8092afcb77e3 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:39:53.427483 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-662137c4-b9f1-4a67-af4c-8092afcb77e3 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] [instance: 15d4a46e-9504-4897-918d-39aafc20d22a] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:39:53.434200 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-662137c4-b9f1-4a67-af4c-8092afcb77e3 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:53.434685 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-662137c4-b9f1-4a67-af4c-8092afcb77e3 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:53.435119 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-662137c4-b9f1-4a67-af4c-8092afcb77e3 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:53.435849 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-662137c4-b9f1-4a67-af4c-8092afcb77e3 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:53.436300 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-662137c4-b9f1-4a67-af4c-8092afcb77e3 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:53.436720 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-662137c4-b9f1-4a67-af4c-8092afcb77e3 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:53.582630 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-662137c4-b9f1-4a67-af4c-8092afcb77e3 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031939e16194f63b99e6f27f700fa8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecec6d0c155f4d658197c4779ab9ffce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:39:53.590708 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-662137c4-b9f1-4a67-af4c-8092afcb77e3 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] 10.222.0.84 "GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a" status: 200 len: 1677 microversion: 2.1 time: 0.167655 Aug 24 11:39:53.591277 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 343/732] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:39:53 2022] GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a => generated 1677 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:39:54.612595 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-64aa32ff-cbfd-40d2-8cb6-d4d0de522b46 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:39:54.613235 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-64aa32ff-cbfd-40d2-8cb6-d4d0de522b46 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] [instance: 15d4a46e-9504-4897-918d-39aafc20d22a] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:39:54.619732 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-64aa32ff-cbfd-40d2-8cb6-d4d0de522b46 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:54.620221 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-64aa32ff-cbfd-40d2-8cb6-d4d0de522b46 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:54.620660 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-64aa32ff-cbfd-40d2-8cb6-d4d0de522b46 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:54.621385 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-64aa32ff-cbfd-40d2-8cb6-d4d0de522b46 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:54.622109 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-64aa32ff-cbfd-40d2-8cb6-d4d0de522b46 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:54.622533 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-64aa32ff-cbfd-40d2-8cb6-d4d0de522b46 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:54.768522 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-64aa32ff-cbfd-40d2-8cb6-d4d0de522b46 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031939e16194f63b99e6f27f700fa8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecec6d0c155f4d658197c4779ab9ffce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:39:54.776662 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-64aa32ff-cbfd-40d2-8cb6-d4d0de522b46 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] 10.222.0.84 "GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a" status: 200 len: 1677 microversion: 2.1 time: 0.168628 Aug 24 11:39:54.777279 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 390/733] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:39:54 2022] GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a => generated 1677 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:39:55.801080 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-056156ee-d4d4-466f-bac4-0f616bbebd5b tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:39:55.801827 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-056156ee-d4d4-466f-bac4-0f616bbebd5b tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] [instance: 15d4a46e-9504-4897-918d-39aafc20d22a] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:39:55.808207 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-056156ee-d4d4-466f-bac4-0f616bbebd5b tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:55.808705 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-056156ee-d4d4-466f-bac4-0f616bbebd5b tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:55.809152 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-056156ee-d4d4-466f-bac4-0f616bbebd5b tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:55.809842 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-056156ee-d4d4-466f-bac4-0f616bbebd5b tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:55.810293 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-056156ee-d4d4-466f-bac4-0f616bbebd5b tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:55.810707 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-056156ee-d4d4-466f-bac4-0f616bbebd5b tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:55.947883 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-056156ee-d4d4-466f-bac4-0f616bbebd5b tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031939e16194f63b99e6f27f700fa8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecec6d0c155f4d658197c4779ab9ffce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:39:55.957152 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-056156ee-d4d4-466f-bac4-0f616bbebd5b tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] 10.222.0.84 "GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a" status: 200 len: 1677 microversion: 2.1 time: 0.160151 Aug 24 11:39:55.957742 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 344/734] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:39:55 2022] GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a => generated 1677 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:39:56.979291 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-31ea3626-6f6c-4381-b969-f3031750891d tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:39:56.979840 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-31ea3626-6f6c-4381-b969-f3031750891d tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] [instance: 15d4a46e-9504-4897-918d-39aafc20d22a] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:39:56.987221 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-31ea3626-6f6c-4381-b969-f3031750891d tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:56.988126 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-31ea3626-6f6c-4381-b969-f3031750891d tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:56.988126 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-31ea3626-6f6c-4381-b969-f3031750891d tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:56.988989 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-31ea3626-6f6c-4381-b969-f3031750891d tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:56.989441 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-31ea3626-6f6c-4381-b969-f3031750891d tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:56.989860 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-31ea3626-6f6c-4381-b969-f3031750891d tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:57.125432 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-31ea3626-6f6c-4381-b969-f3031750891d tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031939e16194f63b99e6f27f700fa8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecec6d0c155f4d658197c4779ab9ffce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:39:57.133289 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-31ea3626-6f6c-4381-b969-f3031750891d tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] 10.222.0.84 "GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a" status: 200 len: 1677 microversion: 2.1 time: 0.157880 Aug 24 11:39:57.133823 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 391/735] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:39:56 2022] GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a => generated 1677 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:39:58.155484 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-5a68aa0d-6d36-419b-ac3d-47f3bcc6b199 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:39:58.156040 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-5a68aa0d-6d36-419b-ac3d-47f3bcc6b199 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] [instance: 15d4a46e-9504-4897-918d-39aafc20d22a] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:39:58.162907 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5a68aa0d-6d36-419b-ac3d-47f3bcc6b199 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:58.163389 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5a68aa0d-6d36-419b-ac3d-47f3bcc6b199 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:58.163819 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5a68aa0d-6d36-419b-ac3d-47f3bcc6b199 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:58.164748 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5a68aa0d-6d36-419b-ac3d-47f3bcc6b199 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:58.165162 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5a68aa0d-6d36-419b-ac3d-47f3bcc6b199 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:58.165581 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5a68aa0d-6d36-419b-ac3d-47f3bcc6b199 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:58.314474 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-5a68aa0d-6d36-419b-ac3d-47f3bcc6b199 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031939e16194f63b99e6f27f700fa8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecec6d0c155f4d658197c4779ab9ffce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:39:58.322298 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-5a68aa0d-6d36-419b-ac3d-47f3bcc6b199 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] 10.222.0.84 "GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a" status: 200 len: 1677 microversion: 2.1 time: 0.170844 Aug 24 11:39:58.322867 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 345/736] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:39:58 2022] GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a => generated 1677 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:39:59.344647 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-4e600e7a-8d9e-409a-9dcf-201519915e36 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:39:59.345770 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-4e600e7a-8d9e-409a-9dcf-201519915e36 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] [instance: 15d4a46e-9504-4897-918d-39aafc20d22a] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:39:59.355086 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-4e600e7a-8d9e-409a-9dcf-201519915e36 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:59.355594 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-4e600e7a-8d9e-409a-9dcf-201519915e36 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:59.356055 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-4e600e7a-8d9e-409a-9dcf-201519915e36 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:59.356759 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-4e600e7a-8d9e-409a-9dcf-201519915e36 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:59.357245 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-4e600e7a-8d9e-409a-9dcf-201519915e36 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:59.357668 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-4e600e7a-8d9e-409a-9dcf-201519915e36 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:59.497551 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-4e600e7a-8d9e-409a-9dcf-201519915e36 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031939e16194f63b99e6f27f700fa8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecec6d0c155f4d658197c4779ab9ffce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:39:59.506055 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-4e600e7a-8d9e-409a-9dcf-201519915e36 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] 10.222.0.84 "GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a" status: 200 len: 1677 microversion: 2.1 time: 0.166017 Aug 24 11:39:59.506619 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 392/737] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:39:59 2022] GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a => generated 1677 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:40:00.529064 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-80dc5b1c-cbf3-4425-92a9-0258a7e55bb3 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:40:00.529721 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-80dc5b1c-cbf3-4425-92a9-0258a7e55bb3 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] [instance: 15d4a46e-9504-4897-918d-39aafc20d22a] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:40:00.536340 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-80dc5b1c-cbf3-4425-92a9-0258a7e55bb3 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:00.536838 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-80dc5b1c-cbf3-4425-92a9-0258a7e55bb3 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:00.537276 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-80dc5b1c-cbf3-4425-92a9-0258a7e55bb3 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:00.537960 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-80dc5b1c-cbf3-4425-92a9-0258a7e55bb3 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:00.538406 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-80dc5b1c-cbf3-4425-92a9-0258a7e55bb3 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:00.538823 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-80dc5b1c-cbf3-4425-92a9-0258a7e55bb3 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:00.684136 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-80dc5b1c-cbf3-4425-92a9-0258a7e55bb3 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031939e16194f63b99e6f27f700fa8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecec6d0c155f4d658197c4779ab9ffce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:00.692720 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-80dc5b1c-cbf3-4425-92a9-0258a7e55bb3 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] 10.222.0.84 "GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a" status: 200 len: 1677 microversion: 2.1 time: 0.167447 Aug 24 11:40:00.693356 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 346/738] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:40:00 2022] GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a => generated 1677 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:40:01.714434 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-639fc042-3f5f-42e7-8ac6-d77a5bc550f9 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:40:01.714971 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-639fc042-3f5f-42e7-8ac6-d77a5bc550f9 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] [instance: 15d4a46e-9504-4897-918d-39aafc20d22a] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:40:01.726209 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-639fc042-3f5f-42e7-8ac6-d77a5bc550f9 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:01.726740 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-639fc042-3f5f-42e7-8ac6-d77a5bc550f9 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:01.727111 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-639fc042-3f5f-42e7-8ac6-d77a5bc550f9 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:01.727816 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-639fc042-3f5f-42e7-8ac6-d77a5bc550f9 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:01.728263 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-639fc042-3f5f-42e7-8ac6-d77a5bc550f9 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:01.728679 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-639fc042-3f5f-42e7-8ac6-d77a5bc550f9 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:01.879745 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-639fc042-3f5f-42e7-8ac6-d77a5bc550f9 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031939e16194f63b99e6f27f700fa8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecec6d0c155f4d658197c4779ab9ffce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:01.887831 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-639fc042-3f5f-42e7-8ac6-d77a5bc550f9 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] 10.222.0.84 "GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a" status: 200 len: 1677 microversion: 2.1 time: 0.177357 Aug 24 11:40:01.888426 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 393/739] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:40:01 2022] GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a => generated 1677 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:40:02.915150 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-5a07cce9-ef28-4889-9f5c-fbd8e83edafb tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:40:02.915709 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-5a07cce9-ef28-4889-9f5c-fbd8e83edafb tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] [instance: 15d4a46e-9504-4897-918d-39aafc20d22a] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:40:02.924086 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5a07cce9-ef28-4889-9f5c-fbd8e83edafb tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:02.924583 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5a07cce9-ef28-4889-9f5c-fbd8e83edafb tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:02.925060 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5a07cce9-ef28-4889-9f5c-fbd8e83edafb tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:02.925777 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5a07cce9-ef28-4889-9f5c-fbd8e83edafb tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:02.926250 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5a07cce9-ef28-4889-9f5c-fbd8e83edafb tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:02.926678 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5a07cce9-ef28-4889-9f5c-fbd8e83edafb tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:03.089647 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-5a07cce9-ef28-4889-9f5c-fbd8e83edafb tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031939e16194f63b99e6f27f700fa8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecec6d0c155f4d658197c4779ab9ffce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:03.098167 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-5a07cce9-ef28-4889-9f5c-fbd8e83edafb tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] 10.222.0.84 "GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a" status: 200 len: 1677 microversion: 2.1 time: 0.186969 Aug 24 11:40:03.098838 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 347/740] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:40:02 2022] GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a => generated 1677 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:40:03.598888 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 11:40:03.599509 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Wed Aug 24 11:40:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 11:40:04.119759 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-49d43398-9ac7-45bb-8974-c2b5c7214e02 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:40:04.120382 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-49d43398-9ac7-45bb-8974-c2b5c7214e02 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] [instance: 15d4a46e-9504-4897-918d-39aafc20d22a] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:40:04.130453 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-49d43398-9ac7-45bb-8974-c2b5c7214e02 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:04.130949 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-49d43398-9ac7-45bb-8974-c2b5c7214e02 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:04.131388 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-49d43398-9ac7-45bb-8974-c2b5c7214e02 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:04.132086 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-49d43398-9ac7-45bb-8974-c2b5c7214e02 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:04.132539 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-49d43398-9ac7-45bb-8974-c2b5c7214e02 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:04.133012 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-49d43398-9ac7-45bb-8974-c2b5c7214e02 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:04.277964 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-49d43398-9ac7-45bb-8974-c2b5c7214e02 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031939e16194f63b99e6f27f700fa8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecec6d0c155f4d658197c4779ab9ffce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:04.286653 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-49d43398-9ac7-45bb-8974-c2b5c7214e02 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] 10.222.0.84 "GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a" status: 200 len: 1677 microversion: 2.1 time: 0.170768 Aug 24 11:40:04.287232 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 394/741] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:40:04 2022] GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a => generated 1677 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:40:05.158666 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 11:40:05.159480 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Wed Aug 24 11:40:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 11:40:05.308522 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-5bbf5216-6572-45dd-967f-958fca4cbac2 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:40:05.309163 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-5bbf5216-6572-45dd-967f-958fca4cbac2 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] [instance: 15d4a46e-9504-4897-918d-39aafc20d22a] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:40:05.316643 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5bbf5216-6572-45dd-967f-958fca4cbac2 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:05.317189 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5bbf5216-6572-45dd-967f-958fca4cbac2 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:05.317628 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5bbf5216-6572-45dd-967f-958fca4cbac2 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:05.318321 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5bbf5216-6572-45dd-967f-958fca4cbac2 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:05.318775 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5bbf5216-6572-45dd-967f-958fca4cbac2 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:05.319293 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5bbf5216-6572-45dd-967f-958fca4cbac2 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:05.466088 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-5bbf5216-6572-45dd-967f-958fca4cbac2 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031939e16194f63b99e6f27f700fa8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecec6d0c155f4d658197c4779ab9ffce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:05.473992 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-5bbf5216-6572-45dd-967f-958fca4cbac2 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] 10.222.0.84 "GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a" status: 200 len: 1654 microversion: 2.1 time: 0.170041 Aug 24 11:40:05.474572 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 348/742] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:40:05 2022] GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a => generated 1654 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:40:05.495070 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-b81612a2-7523-4fd2-a710-e52433f48906 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:40:05.502441 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-b81612a2-7523-4fd2-a710-e52433f48906 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:05.502915 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-b81612a2-7523-4fd2-a710-e52433f48906 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:05.503368 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-b81612a2-7523-4fd2-a710-e52433f48906 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:05.527997 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-b81612a2-7523-4fd2-a710-e52433f48906 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] [instance: 15d4a46e-9504-4897-918d-39aafc20d22a] Going to try to start instance {{(pid=124769) start /opt/stack/nova/nova/compute/api.py:2772}} Aug 24 11:40:05.742221 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-b81612a2-7523-4fd2-a710-e52433f48906 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] 10.222.0.84 "POST /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a/action" status: 202 len: 0 microversion: 2.1 time: 0.250906 Aug 24 11:40:05.742724 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 395/743] 10.222.0.84 () {60 vars in 1278 bytes} [Wed Aug 24 11:40:05 2022] POST /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a/action => generated 0 bytes in 252 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:40:05.751984 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-58f0cd29-7d32-4cdb-9bbe-4fe50573eccc tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:40:05.752593 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-58f0cd29-7d32-4cdb-9bbe-4fe50573eccc tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] [instance: 15d4a46e-9504-4897-918d-39aafc20d22a] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:40:05.759101 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-58f0cd29-7d32-4cdb-9bbe-4fe50573eccc tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:05.759587 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-58f0cd29-7d32-4cdb-9bbe-4fe50573eccc tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:05.760018 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-58f0cd29-7d32-4cdb-9bbe-4fe50573eccc tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:05.760832 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-58f0cd29-7d32-4cdb-9bbe-4fe50573eccc tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:05.761358 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-58f0cd29-7d32-4cdb-9bbe-4fe50573eccc tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:05.763322 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-58f0cd29-7d32-4cdb-9bbe-4fe50573eccc tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:05.903074 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-58f0cd29-7d32-4cdb-9bbe-4fe50573eccc tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031939e16194f63b99e6f27f700fa8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecec6d0c155f4d658197c4779ab9ffce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:05.912051 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-58f0cd29-7d32-4cdb-9bbe-4fe50573eccc tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] 10.222.0.84 "GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a" status: 200 len: 1663 microversion: 2.1 time: 0.164528 Aug 24 11:40:05.912629 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 349/744] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:40:05 2022] GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a => generated 1663 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:40:06.935848 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-348262b4-08f9-4e66-83f9-627edea4da25 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:40:06.936478 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-348262b4-08f9-4e66-83f9-627edea4da25 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] [instance: 15d4a46e-9504-4897-918d-39aafc20d22a] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:40:06.943408 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-348262b4-08f9-4e66-83f9-627edea4da25 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:06.943977 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-348262b4-08f9-4e66-83f9-627edea4da25 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:06.944423 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-348262b4-08f9-4e66-83f9-627edea4da25 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:06.945216 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-348262b4-08f9-4e66-83f9-627edea4da25 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:06.945669 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-348262b4-08f9-4e66-83f9-627edea4da25 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:06.946090 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-348262b4-08f9-4e66-83f9-627edea4da25 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:07.098378 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-348262b4-08f9-4e66-83f9-627edea4da25 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031939e16194f63b99e6f27f700fa8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecec6d0c155f4d658197c4779ab9ffce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:07.107986 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-348262b4-08f9-4e66-83f9-627edea4da25 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] 10.222.0.84 "GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a" status: 200 len: 1663 microversion: 2.1 time: 0.177212 Aug 24 11:40:07.108587 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 396/745] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:40:06 2022] GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a => generated 1663 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:40:08.131249 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-bc6ccc75-b8a0-4d5c-9b7a-833368b6bf9a tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:40:08.131847 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-bc6ccc75-b8a0-4d5c-9b7a-833368b6bf9a tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] [instance: 15d4a46e-9504-4897-918d-39aafc20d22a] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:40:08.138645 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-bc6ccc75-b8a0-4d5c-9b7a-833368b6bf9a tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:08.139135 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-bc6ccc75-b8a0-4d5c-9b7a-833368b6bf9a tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:08.139571 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-bc6ccc75-b8a0-4d5c-9b7a-833368b6bf9a tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:08.140302 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-bc6ccc75-b8a0-4d5c-9b7a-833368b6bf9a tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:08.140763 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-bc6ccc75-b8a0-4d5c-9b7a-833368b6bf9a tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:08.141220 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-bc6ccc75-b8a0-4d5c-9b7a-833368b6bf9a tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:08.278896 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-bc6ccc75-b8a0-4d5c-9b7a-833368b6bf9a tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031939e16194f63b99e6f27f700fa8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecec6d0c155f4d658197c4779ab9ffce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:08.287761 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-bc6ccc75-b8a0-4d5c-9b7a-833368b6bf9a tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] 10.222.0.84 "GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a" status: 200 len: 1667 microversion: 2.1 time: 0.160808 Aug 24 11:40:08.288524 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 350/746] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:40:08 2022] GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a => generated 1667 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:40:08.570183 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-41051cf4-5f2d-4728-bff4-6064993faa90 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:40:08.570797 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-41051cf4-5f2d-4728-bff4-6064993faa90 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: ea26410d-7ad5-47e7-8d4a-ade5827e511c] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:40:08.577254 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-41051cf4-5f2d-4728-bff4-6064993faa90 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:08.579247 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-41051cf4-5f2d-4728-bff4-6064993faa90 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:08.579247 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-41051cf4-5f2d-4728-bff4-6064993faa90 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:08.579529 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-41051cf4-5f2d-4728-bff4-6064993faa90 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:08.579981 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-41051cf4-5f2d-4728-bff4-6064993faa90 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:08.580404 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-41051cf4-5f2d-4728-bff4-6064993faa90 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:08.605462 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-41051cf4-5f2d-4728-bff4-6064993faa90 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "GET /compute/v2.1/servers/ea26410d-7ad5-47e7-8d4a-ade5827e511c/ips" status: 200 len: 150 microversion: 2.1 time: 0.039198 Aug 24 11:40:08.606060 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 397/747] 10.222.0.84 () {58 vars in 1248 bytes} [Wed Aug 24 11:40:08 2022] GET /compute/v2.1/servers/ea26410d-7ad5-47e7-8d4a-ade5827e511c/ips => generated 150 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:40:08.619295 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-35ee9abc-4c52-4125-ac5d-75ad6edc93c4 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dadd263d-3941-44f8-8b67-c190cf334748"}} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:40:08.622276 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-35ee9abc-4c52-4125-ac5d-75ad6edc93c4 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: ea26410d-7ad5-47e7-8d4a-ade5827e511c] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:40:08.628423 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-35ee9abc-4c52-4125-ac5d-75ad6edc93c4 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:08.628927 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-35ee9abc-4c52-4125-ac5d-75ad6edc93c4 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:08.629357 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-35ee9abc-4c52-4125-ac5d-75ad6edc93c4 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:08.630038 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-35ee9abc-4c52-4125-ac5d-75ad6edc93c4 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:08.630489 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-35ee9abc-4c52-4125-ac5d-75ad6edc93c4 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:08.630897 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-35ee9abc-4c52-4125-ac5d-75ad6edc93c4 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:08.723011 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.wsgi [None req-35ee9abc-4c52-4125-ac5d-75ad6edc93c4 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] HTTP exception thrown: Invalid volume: volume dadd263d-3941-44f8-8b67-c190cf334748 is already attached to instances: e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311 Aug 24 11:40:08.725036 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-35ee9abc-4c52-4125-ac5d-75ad6edc93c4 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Request method failure captured: Aug 24 11:40:08.725036 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: request: POST /compute/v2.1/servers/ea26410d-7ad5-47e7-8d4a-ade5827e511c/os-volume_attachments HTTP/1.1 Aug 24 11:40:08.725036 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Accept: application/json Aug 24 11:40:08.725036 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Accept-Encoding: identity Aug 24 11:40:08.725036 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Connection: close Aug 24 11:40:08.725036 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Content-Length: 74 Aug 24 11:40:08.725036 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Content-Type: application/json Aug 24 11:40:08.725036 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Host: 10.222.0.84 Aug 24 11:40:08.725036 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Openstack-System-Scope: None Aug 24 11:40:08.725036 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: User-Agent: python-urllib3/1.26.11 Aug 24 11:40:08.725036 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Auth-Token: gAAAAABjBgweR4cEvCTKaEtRPVxZbNsTt1me1RX2L8orBaoPmyfbKHmzEiPGrzhUPAZ-dVqobDImAozYNHZy-giT-StyTeTjwVyRR-kCHyxEj3vuiJ5-SAwaDdad7hiiarcqgu_OA8lN_aNGemV1KcSFFCiGn60rq1bxi6ViCi6rFYftaJqzRGY Aug 24 11:40:08.725036 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Domain-Id: None Aug 24 11:40:08.725036 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Domain-Name: None Aug 24 11:40:08.725036 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Identity-Status: Confirmed Aug 24 11:40:08.725036 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Is-Admin-Project: True Aug 24 11:40:08.725036 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Project-Domain-Id: default Aug 24 11:40:08.725036 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Project-Domain-Name: Default Aug 24 11:40:08.725036 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Project-Id: 4a4159dc366f41bc9e4057a079f6fb5a Aug 24 11:40:08.725036 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Project-Name: tempest-AttachVolumeNegativeTest-1758140935 Aug 24 11:40:08.725036 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Role: reader,member Aug 24 11:40:08.725036 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Roles: reader,member Aug 24 11:40:08.726691 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/volume/v3/4a4159dc366f41bc9e4057a079f6fb5a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/volume/v3/4a4159dc366f41bc9e4057a079f6fb5a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/compute/v2/4a4159dc366f41bc9e4057a079f6fb5a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84:8080/v1/AUTH_4a4159dc366f41bc9e4057a079f6fb5a", "adminURL": "http://10.222.0.84:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/placement"}]}] Aug 24 11:40:08.726691 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Tenant: tempest-AttachVolumeNegativeTest-1758140935 Aug 24 11:40:08.726691 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Tenant-Id: 4a4159dc366f41bc9e4057a079f6fb5a Aug 24 11:40:08.726691 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1758140935 Aug 24 11:40:08.726691 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User: tempest-AttachVolumeNegativeTest-1758140935-project Aug 24 11:40:08.726691 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User-Domain-Id: default Aug 24 11:40:08.726691 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User-Domain-Name: Default Aug 24 11:40:08.726691 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User-Id: 2715cf2a5129439c83a5347bb963f1a9 Aug 24 11:40:08.726691 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User-Name: tempest-AttachVolumeNegativeTest-1758140935-project Aug 24 11:40:08.726691 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Aug 24 11:40:08.726691 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: {"volumeAttachment": {"volumeId": "dadd263d-3941-44f8-8b67-c190cf334748"}} Aug 24 11:40:08.726691 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: method: > Aug 24 11:40:08.727877 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: exception: Invalid volume: volume dadd263d-3941-44f8-8b67-c190cf334748 is already attached to instances: e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311 Aug 24 11:40:08.727877 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: action_args: {'server_id': 'ea26410d-7ad5-47e7-8d4a-ade5827e511c', 'body': {'volumeAttachment': {'volumeId': 'dadd263d-3941-44f8-8b67-c190cf334748'}}} Aug 24 11:40:08.727877 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:40:08.727877 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:40:08.727877 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 24 11:40:08.727877 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 24 11:40:08.727877 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 11:40:08.727877 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 11:40:08.727877 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 24 11:40:08.727877 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 24 11:40:08.727877 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5113, in attach_volume Aug 24 11:40:08.727877 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 24 11:40:08.727877 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4953, in _check_volume_already_attached Aug 24 11:40:08.727877 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 24 11:40:08.727877 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume dadd263d-3941-44f8-8b67-c190cf334748 is already attached to instances: e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311 Aug 24 11:40:08.727877 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:40:08.727877 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:40:08.727877 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:40:08.727877 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:40:08.730407 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:40:08.730407 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:40:08.730407 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:40:08.730407 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:40:08.730407 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:40:08.730407 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:40:08.730407 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 11:40:08.730407 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 11:40:08.730407 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 11:40:08.730407 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 11:40:08.730407 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 11:40:08.730407 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 11:40:08.730407 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 24 11:40:08.730407 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 24 11:40:08.730407 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume dadd263d-3941-44f8-8b67-c190cf334748 is already attached to instances: e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311 Aug 24 11:40:08.730407 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:40:08.730407 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:40:08.730407 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:40:08.730407 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:40:08.730407 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:40:08.733101 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:40:08.733101 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:40:08.733101 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:40:08.733101 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume dadd263d-3941-44f8-8b67-c190cf334748 is already attached to instances: e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311 Aug 24 11:40:08.733101 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:40:08.733101 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-35ee9abc-4c52-4125-ac5d-75ad6edc93c4 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Returning 400 to user: Invalid volume: volume dadd263d-3941-44f8-8b67-c190cf334748 is already attached to instances: e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311 {{(pid=124770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:40:08.733101 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-35ee9abc-4c52-4125-ac5d-75ad6edc93c4 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "POST /compute/v2.1/servers/ea26410d-7ad5-47e7-8d4a-ade5827e511c/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.111485 Aug 24 11:40:08.733101 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 351/748] 10.222.0.84 () {60 vars in 1323 bytes} [Wed Aug 24 11:40:08 2022] POST /compute/v2.1/servers/ea26410d-7ad5-47e7-8d4a-ade5827e511c/os-volume_attachments => generated 174 bytes in 113 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 11:40:08.736172 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-a37a2263-c5cd-4edc-bdfa-5386f0e04c9a tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:40:08.736674 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-a37a2263-c5cd-4edc-bdfa-5386f0e04c9a tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: ea26410d-7ad5-47e7-8d4a-ade5827e511c] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:40:08.743246 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-a37a2263-c5cd-4edc-bdfa-5386f0e04c9a tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:08.743708 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-a37a2263-c5cd-4edc-bdfa-5386f0e04c9a tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:08.744136 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-a37a2263-c5cd-4edc-bdfa-5386f0e04c9a tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:08.744876 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-a37a2263-c5cd-4edc-bdfa-5386f0e04c9a tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:08.745283 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-a37a2263-c5cd-4edc-bdfa-5386f0e04c9a tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:08.745699 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-a37a2263-c5cd-4edc-bdfa-5386f0e04c9a tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:08.773935 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-a37a2263-c5cd-4edc-bdfa-5386f0e04c9a tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: ea26410d-7ad5-47e7-8d4a-ade5827e511c] Going to try to terminate instance {{(pid=124769) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 11:40:09.121677 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-a37a2263-c5cd-4edc-bdfa-5386f0e04c9a tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "DELETE /compute/v2.1/servers/ea26410d-7ad5-47e7-8d4a-ade5827e511c" status: 204 len: 0 microversion: 2.1 time: 0.389536 Aug 24 11:40:09.122555 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 398/749] 10.222.0.84 () {58 vars in 1239 bytes} [Wed Aug 24 11:40:08 2022] DELETE /compute/v2.1/servers/ea26410d-7ad5-47e7-8d4a-ade5827e511c => generated 0 bytes in 391 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 11:40:09.131204 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-1c3040c8-ddd5-4f72-a81c-4ffd08316dc0 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:40:09.132223 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-1c3040c8-ddd5-4f72-a81c-4ffd08316dc0 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: ea26410d-7ad5-47e7-8d4a-ade5827e511c] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:40:09.138846 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1c3040c8-ddd5-4f72-a81c-4ffd08316dc0 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:09.139334 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1c3040c8-ddd5-4f72-a81c-4ffd08316dc0 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:09.139775 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1c3040c8-ddd5-4f72-a81c-4ffd08316dc0 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:09.140602 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1c3040c8-ddd5-4f72-a81c-4ffd08316dc0 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:09.141587 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1c3040c8-ddd5-4f72-a81c-4ffd08316dc0 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:09.142016 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1c3040c8-ddd5-4f72-a81c-4ffd08316dc0 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:09.286123 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-1c3040c8-ddd5-4f72-a81c-4ffd08316dc0 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2715cf2a5129439c83a5347bb963f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4159dc366f41bc9e4057a079f6fb5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:09.294406 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-1c3040c8-ddd5-4f72-a81c-4ffd08316dc0 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "GET /compute/v2.1/servers/ea26410d-7ad5-47e7-8d4a-ade5827e511c" status: 200 len: 1681 microversion: 2.1 time: 0.167199 Aug 24 11:40:09.294979 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 352/750] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:40:09 2022] GET /compute/v2.1/servers/ea26410d-7ad5-47e7-8d4a-ade5827e511c => generated 1681 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:40:10.318403 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-35bd8bfd-bc2c-48d5-bb8f-2d8861871e9c tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:40:10.319301 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-35bd8bfd-bc2c-48d5-bb8f-2d8861871e9c tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: ea26410d-7ad5-47e7-8d4a-ade5827e511c] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:40:10.326512 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-35bd8bfd-bc2c-48d5-bb8f-2d8861871e9c tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:10.326998 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-35bd8bfd-bc2c-48d5-bb8f-2d8861871e9c tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:10.327434 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-35bd8bfd-bc2c-48d5-bb8f-2d8861871e9c tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:10.329029 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-35bd8bfd-bc2c-48d5-bb8f-2d8861871e9c tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:10.329498 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-35bd8bfd-bc2c-48d5-bb8f-2d8861871e9c tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:10.329923 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-35bd8bfd-bc2c-48d5-bb8f-2d8861871e9c tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:10.497973 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-35bd8bfd-bc2c-48d5-bb8f-2d8861871e9c tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2715cf2a5129439c83a5347bb963f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4159dc366f41bc9e4057a079f6fb5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:10.506750 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-35bd8bfd-bc2c-48d5-bb8f-2d8861871e9c tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "GET /compute/v2.1/servers/ea26410d-7ad5-47e7-8d4a-ade5827e511c" status: 200 len: 1681 microversion: 2.1 time: 0.192746 Aug 24 11:40:10.507437 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 399/751] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:40:10 2022] GET /compute/v2.1/servers/ea26410d-7ad5-47e7-8d4a-ade5827e511c => generated 1681 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:40:11.529171 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-5717e7df-29a5-4f43-8d28-8b88afc0f145 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:40:11.529977 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-5717e7df-29a5-4f43-8d28-8b88afc0f145 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: ea26410d-7ad5-47e7-8d4a-ade5827e511c] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:40:11.539517 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5717e7df-29a5-4f43-8d28-8b88afc0f145 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:11.540492 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5717e7df-29a5-4f43-8d28-8b88afc0f145 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:11.541163 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5717e7df-29a5-4f43-8d28-8b88afc0f145 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:11.542246 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5717e7df-29a5-4f43-8d28-8b88afc0f145 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:11.542931 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5717e7df-29a5-4f43-8d28-8b88afc0f145 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:11.543565 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5717e7df-29a5-4f43-8d28-8b88afc0f145 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:11.841358 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-5717e7df-29a5-4f43-8d28-8b88afc0f145 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2715cf2a5129439c83a5347bb963f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4159dc366f41bc9e4057a079f6fb5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:11.850047 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-5717e7df-29a5-4f43-8d28-8b88afc0f145 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "GET /compute/v2.1/servers/ea26410d-7ad5-47e7-8d4a-ade5827e511c" status: 200 len: 1681 microversion: 2.1 time: 0.324800 Aug 24 11:40:11.850725 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 353/752] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:40:11 2022] GET /compute/v2.1/servers/ea26410d-7ad5-47e7-8d4a-ade5827e511c => generated 1681 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:40:12.569012 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [req-96653bae-85c8-4702-9b77-33ef626dd175 req-d707b6f7-4a6c-42b5-835d-638a0613637a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea26410d-7ad5-47e7-8d4a-ade5827e511c", "name": "network-vif-deleted", "tag": "b747c4d8-3ba6-4e33-ada3-b81ba17dac29"}]} {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:40:12.582235 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [req-96653bae-85c8-4702-9b77-33ef626dd175 req-d707b6f7-4a6c-42b5-835d-638a0613637a service nova] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:12.582720 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [req-96653bae-85c8-4702-9b77-33ef626dd175 req-d707b6f7-4a6c-42b5-835d-638a0613637a service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:12.583237 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [req-96653bae-85c8-4702-9b77-33ef626dd175 req-d707b6f7-4a6c-42b5-835d-638a0613637a service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:12.588330 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG dbcounter [-] [124769] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=124769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:40:12.596620 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.compute.server_external_events [req-96653bae-85c8-4702-9b77-33ef626dd175 req-d707b6f7-4a6c-42b5-835d-638a0613637a service nova] Creating event network-vif-deleted:b747c4d8-3ba6-4e33-ada3-b81ba17dac29 for instance ea26410d-7ad5-47e7-8d4a-ade5827e511c on hv-cinder-85427 Aug 24 11:40:12.603825 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [req-96653bae-85c8-4702-9b77-33ef626dd175 req-d707b6f7-4a6c-42b5-835d-638a0613637a service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041424 Aug 24 11:40:12.605147 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 400/753] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Aug 24 11:40:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:40:12.876609 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-ada7a569-7651-46d0-b0ca-768072fbf028 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:40:12.878472 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-ada7a569-7651-46d0-b0ca-768072fbf028 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: ea26410d-7ad5-47e7-8d4a-ade5827e511c] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:40:12.889077 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ada7a569-7651-46d0-b0ca-768072fbf028 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:12.889819 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ada7a569-7651-46d0-b0ca-768072fbf028 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:12.891153 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ada7a569-7651-46d0-b0ca-768072fbf028 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:12.892024 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ada7a569-7651-46d0-b0ca-768072fbf028 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:12.892665 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ada7a569-7651-46d0-b0ca-768072fbf028 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:12.893405 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ada7a569-7651-46d0-b0ca-768072fbf028 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:12.974773 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-ada7a569-7651-46d0-b0ca-768072fbf028 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2715cf2a5129439c83a5347bb963f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4159dc366f41bc9e4057a079f6fb5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:12.988351 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-ada7a569-7651-46d0-b0ca-768072fbf028 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "GET /compute/v2.1/servers/ea26410d-7ad5-47e7-8d4a-ade5827e511c" status: 200 len: 1326 microversion: 2.1 time: 0.118945 Aug 24 11:40:12.990356 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 354/754] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:40:12 2022] GET /compute/v2.1/servers/ea26410d-7ad5-47e7-8d4a-ade5827e511c => generated 1326 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:40:14.017997 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-d9177908-8e50-4e17-affd-d57968a0b193 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:40:14.019287 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-d9177908-8e50-4e17-affd-d57968a0b193 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: ea26410d-7ad5-47e7-8d4a-ade5827e511c] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:40:14.036262 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-d9177908-8e50-4e17-affd-d57968a0b193 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:14.042517 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-d9177908-8e50-4e17-affd-d57968a0b193 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:14.042517 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-d9177908-8e50-4e17-affd-d57968a0b193 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:14.042517 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-d9177908-8e50-4e17-affd-d57968a0b193 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:14.042517 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-d9177908-8e50-4e17-affd-d57968a0b193 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:14.043201 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-d9177908-8e50-4e17-affd-d57968a0b193 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:14.097574 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-d9177908-8e50-4e17-affd-d57968a0b193 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:14.098174 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-d9177908-8e50-4e17-affd-d57968a0b193 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:14.098819 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-d9177908-8e50-4e17-affd-d57968a0b193 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:14.099452 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.objects.instance [None req-d9177908-8e50-4e17-affd-d57968a0b193 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lazy-loading 'fault' on Instance uuid ea26410d-7ad5-47e7-8d4a-ade5827e511c {{(pid=124769) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:40:14.163920 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-d9177908-8e50-4e17-affd-d57968a0b193 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2715cf2a5129439c83a5347bb963f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4159dc366f41bc9e4057a079f6fb5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:14.177302 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-d9177908-8e50-4e17-affd-d57968a0b193 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "GET /compute/v2.1/servers/ea26410d-7ad5-47e7-8d4a-ade5827e511c" status: 200 len: 1331 microversion: 2.1 time: 0.165871 Aug 24 11:40:14.178292 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 401/755] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:40:14 2022] GET /compute/v2.1/servers/ea26410d-7ad5-47e7-8d4a-ade5827e511c => generated 1331 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:40:15.207611 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-3da0431c-5c26-4310-ad43-694bbf91de7f tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:40:15.208227 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-3da0431c-5c26-4310-ad43-694bbf91de7f tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: ea26410d-7ad5-47e7-8d4a-ade5827e511c] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:40:15.214828 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-3da0431c-5c26-4310-ad43-694bbf91de7f tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:15.215314 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-3da0431c-5c26-4310-ad43-694bbf91de7f tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:15.215753 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-3da0431c-5c26-4310-ad43-694bbf91de7f tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:15.216445 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-3da0431c-5c26-4310-ad43-694bbf91de7f tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:15.216932 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-3da0431c-5c26-4310-ad43-694bbf91de7f tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:15.217354 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-3da0431c-5c26-4310-ad43-694bbf91de7f tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:15.233986 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.wsgi [None req-3da0431c-5c26-4310-ad43-694bbf91de7f tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] HTTP exception thrown: Instance ea26410d-7ad5-47e7-8d4a-ade5827e511c could not be found. Aug 24 11:40:15.235698 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-3da0431c-5c26-4310-ad43-694bbf91de7f tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Request method failure captured: Aug 24 11:40:15.235698 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: request: GET /compute/v2.1/servers/ea26410d-7ad5-47e7-8d4a-ade5827e511c HTTP/1.1 Aug 24 11:40:15.235698 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Accept: application/json Aug 24 11:40:15.235698 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Accept-Encoding: identity Aug 24 11:40:15.235698 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Connection: close Aug 24 11:40:15.235698 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Content-Length: 0 Aug 24 11:40:15.235698 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Content-Type: application/json Aug 24 11:40:15.235698 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Host: 10.222.0.84 Aug 24 11:40:15.235698 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Openstack-System-Scope: None Aug 24 11:40:15.235698 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: User-Agent: python-urllib3/1.26.11 Aug 24 11:40:15.235698 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Auth-Token: gAAAAABjBgweR4cEvCTKaEtRPVxZbNsTt1me1RX2L8orBaoPmyfbKHmzEiPGrzhUPAZ-dVqobDImAozYNHZy-giT-StyTeTjwVyRR-kCHyxEj3vuiJ5-SAwaDdad7hiiarcqgu_OA8lN_aNGemV1KcSFFCiGn60rq1bxi6ViCi6rFYftaJqzRGY Aug 24 11:40:15.235698 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Domain-Id: None Aug 24 11:40:15.235698 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Domain-Name: None Aug 24 11:40:15.235698 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Identity-Status: Confirmed Aug 24 11:40:15.235698 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Is-Admin-Project: True Aug 24 11:40:15.235698 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Project-Domain-Id: default Aug 24 11:40:15.235698 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Project-Domain-Name: Default Aug 24 11:40:15.235698 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Project-Id: 4a4159dc366f41bc9e4057a079f6fb5a Aug 24 11:40:15.235698 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Project-Name: tempest-AttachVolumeNegativeTest-1758140935 Aug 24 11:40:15.235698 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Role: reader,member Aug 24 11:40:15.235698 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Roles: reader,member Aug 24 11:40:15.237248 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/volume/v3/4a4159dc366f41bc9e4057a079f6fb5a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/volume/v3/4a4159dc366f41bc9e4057a079f6fb5a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/compute/v2/4a4159dc366f41bc9e4057a079f6fb5a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84:8080/v1/AUTH_4a4159dc366f41bc9e4057a079f6fb5a", "adminURL": "http://10.222.0.84:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/placement"}]}] Aug 24 11:40:15.237248 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Tenant: tempest-AttachVolumeNegativeTest-1758140935 Aug 24 11:40:15.237248 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Tenant-Id: 4a4159dc366f41bc9e4057a079f6fb5a Aug 24 11:40:15.237248 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1758140935 Aug 24 11:40:15.237248 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User: tempest-AttachVolumeNegativeTest-1758140935-project Aug 24 11:40:15.237248 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User-Domain-Id: default Aug 24 11:40:15.237248 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User-Domain-Name: Default Aug 24 11:40:15.237248 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User-Id: 2715cf2a5129439c83a5347bb963f1a9 Aug 24 11:40:15.237248 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User-Name: tempest-AttachVolumeNegativeTest-1758140935-project Aug 24 11:40:15.237248 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: method: > Aug 24 11:40:15.237248 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: exception: Instance ea26410d-7ad5-47e7-8d4a-ade5827e511c could not be found. Aug 24 11:40:15.237248 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: action_args: {'id': 'ea26410d-7ad5-47e7-8d4a-ade5827e511c'} Aug 24 11:40:15.238116 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:40:15.238116 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:40:15.238116 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:40:15.238116 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:40:15.238116 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:40:15.238116 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:40:15.238116 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:40:15.238116 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:40:15.238116 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:40:15.238116 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:40:15.238116 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea26410d-7ad5-47e7-8d4a-ade5827e511c could not be found. Aug 24 11:40:15.238116 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:40:15.238116 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:40:15.238116 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:40:15.238116 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:40:15.238116 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:40:15.238116 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:40:15.238116 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:40:15.238116 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:40:15.238116 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:40:15.239568 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:40:15.239568 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:40:15.239568 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:40:15.239568 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:40:15.239568 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:40:15.239568 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:40:15.239568 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:40:15.239568 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea26410d-7ad5-47e7-8d4a-ade5827e511c could not be found. Aug 24 11:40:15.239568 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:40:15.239568 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:40:15.239568 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:40:15.239568 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:40:15.239568 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:40:15.239568 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:40:15.239568 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:40:15.239568 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:40:15.239568 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea26410d-7ad5-47e7-8d4a-ade5827e511c could not be found. Aug 24 11:40:15.239568 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:40:15.241028 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-3da0431c-5c26-4310-ad43-694bbf91de7f tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Returning 404 to user: Instance ea26410d-7ad5-47e7-8d4a-ade5827e511c could not be found. {{(pid=124770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:40:15.241028 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-3da0431c-5c26-4310-ad43-694bbf91de7f tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "GET /compute/v2.1/servers/ea26410d-7ad5-47e7-8d4a-ade5827e511c" status: 404 len: 111 microversion: 2.1 time: 0.034303 Aug 24 11:40:15.241028 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 355/756] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:40:15 2022] GET /compute/v2.1/servers/ea26410d-7ad5-47e7-8d4a-ade5827e511c => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:40:15.246463 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-a7ca2a26-900c-4321-abc9-bdfcbaafee64 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '.version_select at 0x7f0e2a481e50>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:40:15.329456 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-a7ca2a26-900c-4321-abc9-bdfcbaafee64 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2021479066" status: 202 len: 0 microversion: 2.1 time: 0.086661 Aug 24 11:40:15.330051 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 402/757] 10.222.0.84 () {58 vars in 1221 bytes} [Wed Aug 24 11:40:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2021479066 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:40:16.254403 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-b852a5a0-c844-4735-80eb-d451ca2ff239 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:40:16.254987 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-b852a5a0-c844-4735-80eb-d451ca2ff239 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:40:16.257379 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_api:SELECT=33 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:40:16.262355 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b852a5a0-c844-4735-80eb-d451ca2ff239 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:16.262836 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b852a5a0-c844-4735-80eb-d451ca2ff239 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:16.263279 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b852a5a0-c844-4735-80eb-d451ca2ff239 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:16.263977 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b852a5a0-c844-4735-80eb-d451ca2ff239 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:16.264471 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b852a5a0-c844-4735-80eb-d451ca2ff239 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:16.264936 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b852a5a0-c844-4735-80eb-d451ca2ff239 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:16.269655 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=1 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:40:16.356007 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.objects.instance [None req-b852a5a0-c844-4735-80eb-d451ca2ff239 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lazy-loading 'services' on Instance uuid e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311 {{(pid=124770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:40:16.664121 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-b852a5a0-c844-4735-80eb-d451ca2ff239 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "DELETE /compute/v2.1/servers/e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311/os-volume_attachments/dadd263d-3941-44f8-8b67-c190cf334748" status: 202 len: 0 microversion: 2.1 time: 0.414685 Aug 24 11:40:16.664900 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 356/758] 10.222.0.84 () {58 vars in 1416 bytes} [Wed Aug 24 11:40:16 2022] DELETE /compute/v2.1/servers/e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311/os-volume_attachments/dadd263d-3941-44f8-8b67-c190cf334748 => generated 0 bytes in 416 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:40:16.674911 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-6128b995-ef14-4256-a155-dfc6a6b7fb7c tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:40:16.677106 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-6128b995-ef14-4256-a155-dfc6a6b7fb7c tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:40:16.684668 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-6128b995-ef14-4256-a155-dfc6a6b7fb7c tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:16.684668 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-6128b995-ef14-4256-a155-dfc6a6b7fb7c tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:16.685576 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-6128b995-ef14-4256-a155-dfc6a6b7fb7c tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:16.685576 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-6128b995-ef14-4256-a155-dfc6a6b7fb7c tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:16.685950 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-6128b995-ef14-4256-a155-dfc6a6b7fb7c tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:16.686368 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-6128b995-ef14-4256-a155-dfc6a6b7fb7c tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:16.718901 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-6128b995-ef14-4256-a155-dfc6a6b7fb7c tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "GET /compute/v2.1/servers/e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048722 Aug 24 11:40:16.724569 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 403/759] 10.222.0.84 () {58 vars in 1302 bytes} [Wed Aug 24 11:40:16 2022] GET /compute/v2.1/servers/e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:40:16.998655 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-1b86d711-a5a5-492b-9f2d-b8f7693632ca tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:40:17.002489 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-1b86d711-a5a5-492b-9f2d-b8f7693632ca tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: 2e661217-fb1a-48ad-9f1b-47985a4074de] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:40:17.006091 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1b86d711-a5a5-492b-9f2d-b8f7693632ca tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:17.006582 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1b86d711-a5a5-492b-9f2d-b8f7693632ca tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:17.007020 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1b86d711-a5a5-492b-9f2d-b8f7693632ca tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:17.007754 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1b86d711-a5a5-492b-9f2d-b8f7693632ca tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:17.008208 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1b86d711-a5a5-492b-9f2d-b8f7693632ca tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:17.008638 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1b86d711-a5a5-492b-9f2d-b8f7693632ca tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:17.040452 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-1b86d711-a5a5-492b-9f2d-b8f7693632ca tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de/os-volume_attachments/3849f947-d442-4b46-890b-db2ae706ef5a" status: 200 len: 194 microversion: 2.20 time: 0.046477 Aug 24 11:40:17.041089 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 357/760] 10.222.0.84 () {60 vars in 1454 bytes} [Wed Aug 24 11:40:16 2022] GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de/os-volume_attachments/3849f947-d442-4b46-890b-db2ae706ef5a => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 11:40:17.113885 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-92391f83-a523-40f0-8886-09d17169693f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:40:17.114408 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-92391f83-a523-40f0-8886-09d17169693f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: 2e661217-fb1a-48ad-9f1b-47985a4074de] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:40:17.120574 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-92391f83-a523-40f0-8886-09d17169693f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:17.121088 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-92391f83-a523-40f0-8886-09d17169693f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:17.121553 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-92391f83-a523-40f0-8886-09d17169693f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:17.122537 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-92391f83-a523-40f0-8886-09d17169693f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:17.122990 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-92391f83-a523-40f0-8886-09d17169693f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:17.123424 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-92391f83-a523-40f0-8886-09d17169693f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:17.262147 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.objects.instance [None req-92391f83-a523-40f0-8886-09d17169693f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lazy-loading 'services' on Instance uuid 2e661217-fb1a-48ad-9f1b-47985a4074de {{(pid=124769) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:40:17.595691 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-92391f83-a523-40f0-8886-09d17169693f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "DELETE /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de/os-volume_attachments/3849f947-d442-4b46-890b-db2ae706ef5a" status: 202 len: 0 microversion: 2.20 time: 0.485789 Aug 24 11:40:17.596575 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 404/761] 10.222.0.84 () {60 vars in 1457 bytes} [Wed Aug 24 11:40:17 2022] DELETE /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de/os-volume_attachments/3849f947-d442-4b46-890b-db2ae706ef5a => generated 0 bytes in 488 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 11:40:17.609876 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-dd2567ed-56d2-4aba-9c48-7a74b342acce tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:40:17.613275 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-dd2567ed-56d2-4aba-9c48-7a74b342acce tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: 2e661217-fb1a-48ad-9f1b-47985a4074de] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:40:17.620198 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-dd2567ed-56d2-4aba-9c48-7a74b342acce tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:17.620675 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-dd2567ed-56d2-4aba-9c48-7a74b342acce tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:17.621209 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-dd2567ed-56d2-4aba-9c48-7a74b342acce tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:17.622195 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-dd2567ed-56d2-4aba-9c48-7a74b342acce tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:17.622642 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-dd2567ed-56d2-4aba-9c48-7a74b342acce tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:17.623060 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-dd2567ed-56d2-4aba-9c48-7a74b342acce tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:17.659092 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-dd2567ed-56d2-4aba-9c48-7a74b342acce tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056931 Aug 24 11:40:17.666676 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 358/762] 10.222.0.84 () {60 vars in 1343 bytes} [Wed Aug 24 11:40:17 2022] GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 11:40:17.732913 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-2ec51501-fd89-4f21-bffe-e40efb071ccf tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:40:17.736260 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-2ec51501-fd89-4f21-bffe-e40efb071ccf tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:40:17.743373 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-2ec51501-fd89-4f21-bffe-e40efb071ccf tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:17.743861 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-2ec51501-fd89-4f21-bffe-e40efb071ccf tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:17.744307 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-2ec51501-fd89-4f21-bffe-e40efb071ccf tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:17.752832 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-2ec51501-fd89-4f21-bffe-e40efb071ccf tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:17.752832 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-2ec51501-fd89-4f21-bffe-e40efb071ccf tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:17.752832 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-2ec51501-fd89-4f21-bffe-e40efb071ccf tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:17.777868 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-2ec51501-fd89-4f21-bffe-e40efb071ccf tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "GET /compute/v2.1/servers/e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049994 Aug 24 11:40:17.778459 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 405/763] 10.222.0.84 () {58 vars in 1302 bytes} [Wed Aug 24 11:40:17 2022] GET /compute/v2.1/servers/e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:40:18.674773 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-2c899428-8c77-4d90-b1e6-3a11fb6b2f91 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:40:18.677251 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-2c899428-8c77-4d90-b1e6-3a11fb6b2f91 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: 2e661217-fb1a-48ad-9f1b-47985a4074de] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:40:18.684091 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-2c899428-8c77-4d90-b1e6-3a11fb6b2f91 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:18.684621 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-2c899428-8c77-4d90-b1e6-3a11fb6b2f91 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:18.685180 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-2c899428-8c77-4d90-b1e6-3a11fb6b2f91 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:18.685880 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-2c899428-8c77-4d90-b1e6-3a11fb6b2f91 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:18.686380 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-2c899428-8c77-4d90-b1e6-3a11fb6b2f91 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:18.687148 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-2c899428-8c77-4d90-b1e6-3a11fb6b2f91 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:18.717582 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-2c899428-8c77-4d90-b1e6-3a11fb6b2f91 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047609 Aug 24 11:40:18.718648 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 359/764] 10.222.0.84 () {60 vars in 1343 bytes} [Wed Aug 24 11:40:18 2022] GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 11:40:18.791956 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-e11155f9-bf70-4f6b-b91a-510274764078 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:40:18.794089 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-e11155f9-bf70-4f6b-b91a-510274764078 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:40:18.797345 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG dbcounter [-] [124769] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:40:18.802352 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-e11155f9-bf70-4f6b-b91a-510274764078 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:18.802841 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-e11155f9-bf70-4f6b-b91a-510274764078 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:18.803281 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-e11155f9-bf70-4f6b-b91a-510274764078 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:18.803971 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-e11155f9-bf70-4f6b-b91a-510274764078 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:18.804419 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-e11155f9-bf70-4f6b-b91a-510274764078 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:18.804869 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-e11155f9-bf70-4f6b-b91a-510274764078 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:18.836432 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-e11155f9-bf70-4f6b-b91a-510274764078 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "GET /compute/v2.1/servers/e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048551 Aug 24 11:40:18.837052 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 406/765] 10.222.0.84 () {58 vars in 1302 bytes} [Wed Aug 24 11:40:18 2022] GET /compute/v2.1/servers/e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:40:19.731096 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-3855985d-91ed-467d-b6ae-c94a805eb318 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:40:19.734203 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-3855985d-91ed-467d-b6ae-c94a805eb318 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: 2e661217-fb1a-48ad-9f1b-47985a4074de] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:40:19.740678 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-3855985d-91ed-467d-b6ae-c94a805eb318 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:19.741185 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-3855985d-91ed-467d-b6ae-c94a805eb318 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:19.741614 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-3855985d-91ed-467d-b6ae-c94a805eb318 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:19.742392 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-3855985d-91ed-467d-b6ae-c94a805eb318 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:19.742844 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-3855985d-91ed-467d-b6ae-c94a805eb318 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:19.743261 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-3855985d-91ed-467d-b6ae-c94a805eb318 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:19.774144 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-3855985d-91ed-467d-b6ae-c94a805eb318 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047140 Aug 24 11:40:19.774702 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 360/766] 10.222.0.84 () {60 vars in 1343 bytes} [Wed Aug 24 11:40:19 2022] GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:40:19.837772 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-f42058f9-fff8-438b-a565-d9224f6edadf tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:40:19.838445 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-f42058f9-fff8-438b-a565-d9224f6edadf tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: 2e661217-fb1a-48ad-9f1b-47985a4074de] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:40:19.845852 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f42058f9-fff8-438b-a565-d9224f6edadf tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:19.846339 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f42058f9-fff8-438b-a565-d9224f6edadf tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:19.846773 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f42058f9-fff8-438b-a565-d9224f6edadf tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:19.847470 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f42058f9-fff8-438b-a565-d9224f6edadf tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:19.847931 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f42058f9-fff8-438b-a565-d9224f6edadf tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:19.848358 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f42058f9-fff8-438b-a565-d9224f6edadf tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:19.849608 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-ea69de91-b974-4404-9fb6-375e4dec4b67 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:40:19.851812 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-ea69de91-b974-4404-9fb6-375e4dec4b67 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:40:19.857826 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ea69de91-b974-4404-9fb6-375e4dec4b67 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:19.861105 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ea69de91-b974-4404-9fb6-375e4dec4b67 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:19.861105 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ea69de91-b974-4404-9fb6-375e4dec4b67 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:19.861105 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ea69de91-b974-4404-9fb6-375e4dec4b67 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:19.861105 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ea69de91-b974-4404-9fb6-375e4dec4b67 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:19.861501 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ea69de91-b974-4404-9fb6-375e4dec4b67 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:19.878125 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-f42058f9-fff8-438b-a565-d9224f6edadf tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: 2e661217-fb1a-48ad-9f1b-47985a4074de] Going to try to terminate instance {{(pid=124769) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 11:40:19.891274 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-ea69de91-b974-4404-9fb6-375e4dec4b67 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "GET /compute/v2.1/servers/e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045843 Aug 24 11:40:19.891843 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 361/767] 10.222.0.84 () {58 vars in 1302 bytes} [Wed Aug 24 11:40:19 2022] GET /compute/v2.1/servers/e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 11:40:19.968782 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-a6ffd6cb-67d0-4dc2-8b42-d33b75071b32 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:40:19.969423 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-a6ffd6cb-67d0-4dc2-8b42-d33b75071b32 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:40:19.975847 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a6ffd6cb-67d0-4dc2-8b42-d33b75071b32 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:19.976379 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a6ffd6cb-67d0-4dc2-8b42-d33b75071b32 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:19.976848 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a6ffd6cb-67d0-4dc2-8b42-d33b75071b32 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:19.978010 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a6ffd6cb-67d0-4dc2-8b42-d33b75071b32 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:19.978010 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a6ffd6cb-67d0-4dc2-8b42-d33b75071b32 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:19.978478 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a6ffd6cb-67d0-4dc2-8b42-d33b75071b32 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:20.014147 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-a6ffd6cb-67d0-4dc2-8b42-d33b75071b32 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311] Going to try to terminate instance {{(pid=124770) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 11:40:20.287132 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-f42058f9-fff8-438b-a565-d9224f6edadf tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "DELETE /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de" status: 204 len: 0 microversion: 2.20 time: 0.453307 Aug 24 11:40:20.287645 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 407/768] 10.222.0.84 () {60 vars in 1280 bytes} [Wed Aug 24 11:40:19 2022] DELETE /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de => generated 0 bytes in 455 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 11:40:20.296485 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-f9fd39f2-12f1-49e5-9bb9-d242875f5c03 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:40:20.297965 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-f9fd39f2-12f1-49e5-9bb9-d242875f5c03 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: 2e661217-fb1a-48ad-9f1b-47985a4074de] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:40:20.305633 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f9fd39f2-12f1-49e5-9bb9-d242875f5c03 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:20.306115 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f9fd39f2-12f1-49e5-9bb9-d242875f5c03 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:20.306551 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f9fd39f2-12f1-49e5-9bb9-d242875f5c03 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:20.307269 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f9fd39f2-12f1-49e5-9bb9-d242875f5c03 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:20.307830 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f9fd39f2-12f1-49e5-9bb9-d242875f5c03 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:20.308253 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f9fd39f2-12f1-49e5-9bb9-d242875f5c03 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:20.472250 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-a6ffd6cb-67d0-4dc2-8b42-d33b75071b32 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "DELETE /compute/v2.1/servers/e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311" status: 204 len: 0 microversion: 2.1 time: 0.507809 Aug 24 11:40:20.473112 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 362/769] 10.222.0.84 () {58 vars in 1239 bytes} [Wed Aug 24 11:40:19 2022] DELETE /compute/v2.1/servers/e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311 => generated 0 bytes in 510 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 11:40:20.477622 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-f9fd39f2-12f1-49e5-9bb9-d242875f5c03 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:20.487121 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-dc7183e6-396d-4bd8-a13c-5d8bcb1f01da tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:40:20.487890 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-dc7183e6-396d-4bd8-a13c-5d8bcb1f01da tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:40:20.489234 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-f9fd39f2-12f1-49e5-9bb9-d242875f5c03 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:20.497498 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-f9fd39f2-12f1-49e5-9bb9-d242875f5c03 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:20.497498 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-f9fd39f2-12f1-49e5-9bb9-d242875f5c03 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de" status: 200 len: 1726 microversion: 2.20 time: 0.199817 Aug 24 11:40:20.497498 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 408/770] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:40:20 2022] GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de => generated 1726 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 11:40:20.498025 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-dc7183e6-396d-4bd8-a13c-5d8bcb1f01da tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:20.498025 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-dc7183e6-396d-4bd8-a13c-5d8bcb1f01da tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:20.498025 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-dc7183e6-396d-4bd8-a13c-5d8bcb1f01da tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:20.498025 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-dc7183e6-396d-4bd8-a13c-5d8bcb1f01da tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:20.498871 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-dc7183e6-396d-4bd8-a13c-5d8bcb1f01da tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:20.499027 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-dc7183e6-396d-4bd8-a13c-5d8bcb1f01da tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:20.667768 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-dc7183e6-396d-4bd8-a13c-5d8bcb1f01da tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2715cf2a5129439c83a5347bb963f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4159dc366f41bc9e4057a079f6fb5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:20.674295 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-dc7183e6-396d-4bd8-a13c-5d8bcb1f01da tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "GET /compute/v2.1/servers/e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311" status: 200 len: 1681 microversion: 2.1 time: 0.195104 Aug 24 11:40:20.674886 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 363/771] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:40:20 2022] GET /compute/v2.1/servers/e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311 => generated 1681 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:40:21.527963 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-a5effe9e-fa26-4143-8574-9e0483adc9b8 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:40:21.528555 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-a5effe9e-fa26-4143-8574-9e0483adc9b8 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: 2e661217-fb1a-48ad-9f1b-47985a4074de] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:40:21.536088 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-a5effe9e-fa26-4143-8574-9e0483adc9b8 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:21.536630 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-a5effe9e-fa26-4143-8574-9e0483adc9b8 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:21.537121 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-a5effe9e-fa26-4143-8574-9e0483adc9b8 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:21.537824 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-a5effe9e-fa26-4143-8574-9e0483adc9b8 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:21.538337 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-a5effe9e-fa26-4143-8574-9e0483adc9b8 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:21.538777 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-a5effe9e-fa26-4143-8574-9e0483adc9b8 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:21.681357 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-a5effe9e-fa26-4143-8574-9e0483adc9b8 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:21.695103 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-a5effe9e-fa26-4143-8574-9e0483adc9b8 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:21.695464 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-d5255f20-2c33-4bd9-b052-8919c9a4063b tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:40:21.696078 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-d5255f20-2c33-4bd9-b052-8919c9a4063b tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:40:21.697335 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-a5effe9e-fa26-4143-8574-9e0483adc9b8 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:21.698770 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-a5effe9e-fa26-4143-8574-9e0483adc9b8 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de" status: 200 len: 1726 microversion: 2.20 time: 0.174866 Aug 24 11:40:21.699442 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 409/772] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:40:21 2022] GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de => generated 1726 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 11:40:21.702963 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d5255f20-2c33-4bd9-b052-8919c9a4063b tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:21.703524 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d5255f20-2c33-4bd9-b052-8919c9a4063b tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:21.703990 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d5255f20-2c33-4bd9-b052-8919c9a4063b tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:21.704814 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d5255f20-2c33-4bd9-b052-8919c9a4063b tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:21.705275 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d5255f20-2c33-4bd9-b052-8919c9a4063b tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:21.705695 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d5255f20-2c33-4bd9-b052-8919c9a4063b tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:21.854448 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-d5255f20-2c33-4bd9-b052-8919c9a4063b tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2715cf2a5129439c83a5347bb963f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4159dc366f41bc9e4057a079f6fb5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:21.864346 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-d5255f20-2c33-4bd9-b052-8919c9a4063b tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "GET /compute/v2.1/servers/e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311" status: 200 len: 1681 microversion: 2.1 time: 0.172611 Aug 24 11:40:21.864924 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 364/773] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:40:21 2022] GET /compute/v2.1/servers/e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311 => generated 1681 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:40:22.725723 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-4994894d-91a3-4cac-b9b3-0cdd14b90fb5 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:40:22.726322 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-4994894d-91a3-4cac-b9b3-0cdd14b90fb5 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: 2e661217-fb1a-48ad-9f1b-47985a4074de] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:40:22.733231 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-4994894d-91a3-4cac-b9b3-0cdd14b90fb5 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:22.733714 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-4994894d-91a3-4cac-b9b3-0cdd14b90fb5 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:22.734155 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-4994894d-91a3-4cac-b9b3-0cdd14b90fb5 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:22.735178 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-4994894d-91a3-4cac-b9b3-0cdd14b90fb5 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:22.735632 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-4994894d-91a3-4cac-b9b3-0cdd14b90fb5 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:22.736113 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-4994894d-91a3-4cac-b9b3-0cdd14b90fb5 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:22.886973 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-925ceb70-4ce3-4088-91c3-2a0be4c6e871 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:40:22.887632 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-4994894d-91a3-4cac-b9b3-0cdd14b90fb5 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:22.887772 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-925ceb70-4ce3-4088-91c3-2a0be4c6e871 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:40:22.895966 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-925ceb70-4ce3-4088-91c3-2a0be4c6e871 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:22.896513 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-925ceb70-4ce3-4088-91c3-2a0be4c6e871 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:22.897138 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-925ceb70-4ce3-4088-91c3-2a0be4c6e871 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:22.897961 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-4994894d-91a3-4cac-b9b3-0cdd14b90fb5 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:22.898183 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-925ceb70-4ce3-4088-91c3-2a0be4c6e871 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:22.898568 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-925ceb70-4ce3-4088-91c3-2a0be4c6e871 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:22.899016 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-925ceb70-4ce3-4088-91c3-2a0be4c6e871 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:22.899563 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-4994894d-91a3-4cac-b9b3-0cdd14b90fb5 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:22.900967 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-4994894d-91a3-4cac-b9b3-0cdd14b90fb5 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de" status: 200 len: 1726 microversion: 2.20 time: 0.179139 Aug 24 11:40:22.901767 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 410/774] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:40:22 2022] GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de => generated 1726 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 11:40:23.047340 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-925ceb70-4ce3-4088-91c3-2a0be4c6e871 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2715cf2a5129439c83a5347bb963f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4159dc366f41bc9e4057a079f6fb5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:23.055845 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-925ceb70-4ce3-4088-91c3-2a0be4c6e871 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "GET /compute/v2.1/servers/e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311" status: 200 len: 1681 microversion: 2.1 time: 0.172820 Aug 24 11:40:23.056485 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 365/775] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:40:22 2022] GET /compute/v2.1/servers/e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311 => generated 1681 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:40:23.925919 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-f9b66c90-c173-44f0-a372-27788dfec9c9 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:40:23.926816 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-f9b66c90-c173-44f0-a372-27788dfec9c9 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: 2e661217-fb1a-48ad-9f1b-47985a4074de] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:40:23.933379 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f9b66c90-c173-44f0-a372-27788dfec9c9 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:23.933989 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f9b66c90-c173-44f0-a372-27788dfec9c9 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:23.934622 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f9b66c90-c173-44f0-a372-27788dfec9c9 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:23.935562 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f9b66c90-c173-44f0-a372-27788dfec9c9 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:23.938252 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f9b66c90-c173-44f0-a372-27788dfec9c9 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:23.938252 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f9b66c90-c173-44f0-a372-27788dfec9c9 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:24.079704 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-b868e692-02fc-47d8-8a11-905be6b6de14 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:40:24.080608 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-b868e692-02fc-47d8-8a11-905be6b6de14 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:40:24.089427 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b868e692-02fc-47d8-8a11-905be6b6de14 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:24.090424 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b868e692-02fc-47d8-8a11-905be6b6de14 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:24.091398 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b868e692-02fc-47d8-8a11-905be6b6de14 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:24.092229 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b868e692-02fc-47d8-8a11-905be6b6de14 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:24.092831 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b868e692-02fc-47d8-8a11-905be6b6de14 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:24.093402 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b868e692-02fc-47d8-8a11-905be6b6de14 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:24.123710 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-f9b66c90-c173-44f0-a372-27788dfec9c9 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:24.133308 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-f9b66c90-c173-44f0-a372-27788dfec9c9 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:24.134806 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-f9b66c90-c173-44f0-a372-27788dfec9c9 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:24.135961 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-f9b66c90-c173-44f0-a372-27788dfec9c9 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de" status: 200 len: 1726 microversion: 2.20 time: 0.214638 Aug 24 11:40:24.136520 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 411/776] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:40:23 2022] GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de => generated 1726 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 11:40:24.260060 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-b868e692-02fc-47d8-8a11-905be6b6de14 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2715cf2a5129439c83a5347bb963f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4159dc366f41bc9e4057a079f6fb5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:24.268776 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-b868e692-02fc-47d8-8a11-905be6b6de14 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "GET /compute/v2.1/servers/e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311" status: 200 len: 1681 microversion: 2.1 time: 0.193502 Aug 24 11:40:24.269387 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 366/777] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:40:24 2022] GET /compute/v2.1/servers/e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311 => generated 1681 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:40:25.130508 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [req-85815f7d-5c46-4a28-9f73-ef00b161fd8c req-cb80f158-ccd6-4b26-9271-080a17f78310 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e661217-fb1a-48ad-9f1b-47985a4074de", "name": "network-vif-deleted", "tag": "e82d60e7-8369-4554-9da0-a0a3a25fe586"}]} {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:40:25.144077 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [req-85815f7d-5c46-4a28-9f73-ef00b161fd8c req-cb80f158-ccd6-4b26-9271-080a17f78310 service nova] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:25.144915 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [req-85815f7d-5c46-4a28-9f73-ef00b161fd8c req-cb80f158-ccd6-4b26-9271-080a17f78310 service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:25.154391 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [req-85815f7d-5c46-4a28-9f73-ef00b161fd8c req-cb80f158-ccd6-4b26-9271-080a17f78310 service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:25.158049 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.compute.server_external_events [req-85815f7d-5c46-4a28-9f73-ef00b161fd8c req-cb80f158-ccd6-4b26-9271-080a17f78310 service nova] Creating event network-vif-deleted:e82d60e7-8369-4554-9da0-a0a3a25fe586 for instance 2e661217-fb1a-48ad-9f1b-47985a4074de on hv-cinder-85427 Aug 24 11:40:25.160029 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-99193f2a-7d21-4ca8-b17f-7613a8006ee6 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:40:25.160642 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-99193f2a-7d21-4ca8-b17f-7613a8006ee6 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: 2e661217-fb1a-48ad-9f1b-47985a4074de] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:40:25.163548 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [req-85815f7d-5c46-4a28-9f73-ef00b161fd8c req-cb80f158-ccd6-4b26-9271-080a17f78310 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037752 Aug 24 11:40:25.164866 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 412/778] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Aug 24 11:40:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:40:25.168235 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-99193f2a-7d21-4ca8-b17f-7613a8006ee6 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:25.169213 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-99193f2a-7d21-4ca8-b17f-7613a8006ee6 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:25.174672 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-99193f2a-7d21-4ca8-b17f-7613a8006ee6 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:25.175813 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-99193f2a-7d21-4ca8-b17f-7613a8006ee6 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:25.176427 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-99193f2a-7d21-4ca8-b17f-7613a8006ee6 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:25.177135 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-99193f2a-7d21-4ca8-b17f-7613a8006ee6 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:25.264510 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-99193f2a-7d21-4ca8-b17f-7613a8006ee6 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:25.274266 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-99193f2a-7d21-4ca8-b17f-7613a8006ee6 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:25.276909 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-99193f2a-7d21-4ca8-b17f-7613a8006ee6 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:25.278116 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-99193f2a-7d21-4ca8-b17f-7613a8006ee6 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de" status: 200 len: 1658 microversion: 2.20 time: 0.122524 Aug 24 11:40:25.294824 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 367/779] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:40:25 2022] GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de => generated 1658 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 11:40:25.295767 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-16e43309-d3cd-4d26-83aa-403063eae88e tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:40:25.296468 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-16e43309-d3cd-4d26-83aa-403063eae88e tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:40:25.305434 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-16e43309-d3cd-4d26-83aa-403063eae88e tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:25.306416 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-16e43309-d3cd-4d26-83aa-403063eae88e tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:25.306416 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-16e43309-d3cd-4d26-83aa-403063eae88e tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:25.308949 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-16e43309-d3cd-4d26-83aa-403063eae88e tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:25.308949 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-16e43309-d3cd-4d26-83aa-403063eae88e tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:25.308949 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-16e43309-d3cd-4d26-83aa-403063eae88e tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:25.488154 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-16e43309-d3cd-4d26-83aa-403063eae88e tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2715cf2a5129439c83a5347bb963f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4159dc366f41bc9e4057a079f6fb5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:25.496057 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-16e43309-d3cd-4d26-83aa-403063eae88e tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "GET /compute/v2.1/servers/e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311" status: 200 len: 1681 microversion: 2.1 time: 0.204350 Aug 24 11:40:25.496649 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 413/780] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:40:25 2022] GET /compute/v2.1/servers/e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311 => generated 1681 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:40:26.307700 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-dbb244f8-9c3d-427b-a7cc-36c072e1261f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:40:26.308406 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-dbb244f8-9c3d-427b-a7cc-36c072e1261f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: 2e661217-fb1a-48ad-9f1b-47985a4074de] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:40:26.317108 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-dbb244f8-9c3d-427b-a7cc-36c072e1261f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:26.317872 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-dbb244f8-9c3d-427b-a7cc-36c072e1261f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:26.318580 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-dbb244f8-9c3d-427b-a7cc-36c072e1261f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:26.323198 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-dbb244f8-9c3d-427b-a7cc-36c072e1261f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:26.323995 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-dbb244f8-9c3d-427b-a7cc-36c072e1261f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:26.324714 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-dbb244f8-9c3d-427b-a7cc-36c072e1261f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:26.386952 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-dbb244f8-9c3d-427b-a7cc-36c072e1261f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:26.387846 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-dbb244f8-9c3d-427b-a7cc-36c072e1261f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:26.388578 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-dbb244f8-9c3d-427b-a7cc-36c072e1261f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:26.389376 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.objects.instance [None req-dbb244f8-9c3d-427b-a7cc-36c072e1261f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lazy-loading 'fault' on Instance uuid 2e661217-fb1a-48ad-9f1b-47985a4074de {{(pid=124770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:40:26.453735 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-dbb244f8-9c3d-427b-a7cc-36c072e1261f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:26.466684 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-dbb244f8-9c3d-427b-a7cc-36c072e1261f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:26.469044 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-dbb244f8-9c3d-427b-a7cc-36c072e1261f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:26.470503 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-dbb244f8-9c3d-427b-a7cc-36c072e1261f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de" status: 200 len: 1372 microversion: 2.20 time: 0.170248 Aug 24 11:40:26.471308 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 368/781] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:40:26 2022] GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de => generated 1372 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:40:26.528182 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-4885e4a0-5a01-49ba-b3a0-bba4b8a6b8fc tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:40:26.528952 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-4885e4a0-5a01-49ba-b3a0-bba4b8a6b8fc tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:40:26.535492 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-4885e4a0-5a01-49ba-b3a0-bba4b8a6b8fc tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:26.539776 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-4885e4a0-5a01-49ba-b3a0-bba4b8a6b8fc tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:26.539776 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-4885e4a0-5a01-49ba-b3a0-bba4b8a6b8fc tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:26.539776 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-4885e4a0-5a01-49ba-b3a0-bba4b8a6b8fc tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:26.539776 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-4885e4a0-5a01-49ba-b3a0-bba4b8a6b8fc tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:26.541008 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-4885e4a0-5a01-49ba-b3a0-bba4b8a6b8fc tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:26.581124 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-4885e4a0-5a01-49ba-b3a0-bba4b8a6b8fc tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:26.581673 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-4885e4a0-5a01-49ba-b3a0-bba4b8a6b8fc tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:26.582105 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-4885e4a0-5a01-49ba-b3a0-bba4b8a6b8fc tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:26.582537 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.objects.instance [None req-4885e4a0-5a01-49ba-b3a0-bba4b8a6b8fc tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lazy-loading 'fault' on Instance uuid e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311 {{(pid=124769) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:40:26.636035 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-4885e4a0-5a01-49ba-b3a0-bba4b8a6b8fc tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2715cf2a5129439c83a5347bb963f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4159dc366f41bc9e4057a079f6fb5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:26.644732 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-4885e4a0-5a01-49ba-b3a0-bba4b8a6b8fc tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "GET /compute/v2.1/servers/e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311" status: 200 len: 1332 microversion: 2.1 time: 0.120782 Aug 24 11:40:26.645542 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 414/782] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:40:26 2022] GET /compute/v2.1/servers/e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311 => generated 1332 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:40:27.189657 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [req-5880ba97-26a1-4144-a41b-64b962f6f369 req-96805e05-0e73-4eb3-b32f-1524017aad6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311", "name": "network-vif-deleted", "tag": "d810e173-346a-4d91-84f8-11fc2af8528a"}]} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:40:27.202985 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-5880ba97-26a1-4144-a41b-64b962f6f369 req-96805e05-0e73-4eb3-b32f-1524017aad6b service nova] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:27.203832 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-5880ba97-26a1-4144-a41b-64b962f6f369 req-96805e05-0e73-4eb3-b32f-1524017aad6b service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:27.204344 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-5880ba97-26a1-4144-a41b-64b962f6f369 req-96805e05-0e73-4eb3-b32f-1524017aad6b service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:27.223218 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.compute.server_external_events [req-5880ba97-26a1-4144-a41b-64b962f6f369 req-96805e05-0e73-4eb3-b32f-1524017aad6b service nova] Creating event network-vif-deleted:d810e173-346a-4d91-84f8-11fc2af8528a for instance e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311 on hv-cinder-85427 Aug 24 11:40:27.232233 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [req-5880ba97-26a1-4144-a41b-64b962f6f369 req-96805e05-0e73-4eb3-b32f-1524017aad6b service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049075 Aug 24 11:40:27.233216 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 369/783] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Aug 24 11:40:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:40:27.500055 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-98ec331a-5e3b-4d12-b154-1e163fc94426 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:40:27.500736 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-98ec331a-5e3b-4d12-b154-1e163fc94426 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: 2e661217-fb1a-48ad-9f1b-47985a4074de] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:40:27.507065 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-98ec331a-5e3b-4d12-b154-1e163fc94426 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:27.507548 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-98ec331a-5e3b-4d12-b154-1e163fc94426 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:27.507983 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-98ec331a-5e3b-4d12-b154-1e163fc94426 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:27.508668 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-98ec331a-5e3b-4d12-b154-1e163fc94426 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:27.509264 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-98ec331a-5e3b-4d12-b154-1e163fc94426 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:27.509710 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-98ec331a-5e3b-4d12-b154-1e163fc94426 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:27.524313 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.wsgi [None req-98ec331a-5e3b-4d12-b154-1e163fc94426 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] HTTP exception thrown: Instance 2e661217-fb1a-48ad-9f1b-47985a4074de could not be found. Aug 24 11:40:27.525992 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-98ec331a-5e3b-4d12-b154-1e163fc94426 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Request method failure captured: Aug 24 11:40:27.525992 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: request: GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de HTTP/1.1 Aug 24 11:40:27.525992 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Accept: application/json Aug 24 11:40:27.525992 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Accept-Encoding: identity Aug 24 11:40:27.525992 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Connection: close Aug 24 11:40:27.525992 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Content-Length: 0 Aug 24 11:40:27.525992 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Content-Type: application/json Aug 24 11:40:27.525992 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Host: 10.222.0.84 Aug 24 11:40:27.525992 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Openstack-System-Scope: None Aug 24 11:40:27.525992 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: User-Agent: python-urllib3/1.26.11 Aug 24 11:40:27.525992 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Auth-Token: gAAAAABjBgwjqMI9ytFP7VsVHRP_Ve7OKeTCX30XQiKKQRG2LSSGgytPnOci29Q2gHVmiSkSzv-ncMAbc9BWAtzjPMrEQ9DgQiqJHEsoVLsTI-7rEziZM2TxObMN3otskXoxjncEe9UfCmp-Knwv-1P3tr3F6dPE5AY_27hhfhxbUjks2TOg5-4 Aug 24 11:40:27.525992 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Domain-Id: None Aug 24 11:40:27.525992 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Domain-Name: None Aug 24 11:40:27.525992 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Identity-Status: Confirmed Aug 24 11:40:27.525992 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Is-Admin-Project: True Aug 24 11:40:27.525992 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 11:40:27.525992 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Project-Domain-Id: default Aug 24 11:40:27.525992 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Project-Domain-Name: Default Aug 24 11:40:27.525992 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Project-Id: 177e00cee82c44a196eaf5d0dc07b7f2 Aug 24 11:40:27.525992 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-585166699 Aug 24 11:40:27.525992 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Role: reader,member Aug 24 11:40:27.525992 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Roles: reader,member Aug 24 11:40:27.527850 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/volume/v3/177e00cee82c44a196eaf5d0dc07b7f2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/volume/v3/177e00cee82c44a196eaf5d0dc07b7f2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/compute/v2/177e00cee82c44a196eaf5d0dc07b7f2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84:8080/v1/AUTH_177e00cee82c44a196eaf5d0dc07b7f2", "adminURL": "http://10.222.0.84:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/placement"}]}] Aug 24 11:40:27.527850 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Tenant: tempest-AttachVolumeShelveTestJSON-585166699 Aug 24 11:40:27.527850 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Tenant-Id: 177e00cee82c44a196eaf5d0dc07b7f2 Aug 24 11:40:27.527850 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-585166699 Aug 24 11:40:27.527850 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-User: tempest-AttachVolumeShelveTestJSON-585166699-project Aug 24 11:40:27.527850 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-User-Domain-Id: default Aug 24 11:40:27.527850 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-User-Domain-Name: Default Aug 24 11:40:27.527850 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-User-Id: 4a80d0127ee349d69f0ed949bcb4c919 Aug 24 11:40:27.527850 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-User-Name: tempest-AttachVolumeShelveTestJSON-585166699-project Aug 24 11:40:27.527850 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: method: > Aug 24 11:40:27.527850 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: exception: Instance 2e661217-fb1a-48ad-9f1b-47985a4074de could not be found. Aug 24 11:40:27.527850 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: action_args: {'id': '2e661217-fb1a-48ad-9f1b-47985a4074de'} Aug 24 11:40:27.529286 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:40:27.529286 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:40:27.529286 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:40:27.529286 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:40:27.529286 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:40:27.529286 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:40:27.529286 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:40:27.529286 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:40:27.529286 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:40:27.529286 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:40:27.529286 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e661217-fb1a-48ad-9f1b-47985a4074de could not be found. Aug 24 11:40:27.529286 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Aug 24 11:40:27.529286 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:40:27.529286 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Aug 24 11:40:27.529286 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:40:27.529286 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:40:27.529286 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:40:27.529286 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:40:27.529286 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:40:27.529286 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:40:27.530496 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:40:27.530496 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:40:27.530496 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:40:27.530496 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:40:27.530496 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:40:27.530496 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:40:27.530496 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:40:27.530496 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e661217-fb1a-48ad-9f1b-47985a4074de could not be found. Aug 24 11:40:27.530496 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Aug 24 11:40:27.530496 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:40:27.530496 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Aug 24 11:40:27.530496 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:40:27.530496 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:40:27.530496 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:40:27.530496 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:40:27.530496 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:40:27.530496 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e661217-fb1a-48ad-9f1b-47985a4074de could not be found. Aug 24 11:40:27.530496 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Aug 24 11:40:27.532820 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-98ec331a-5e3b-4d12-b154-1e163fc94426 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Returning 404 to user: Instance 2e661217-fb1a-48ad-9f1b-47985a4074de could not be found. {{(pid=124769) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:40:27.532820 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-98ec331a-5e3b-4d12-b154-1e163fc94426 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de" status: 404 len: 111 microversion: 2.20 time: 0.031629 Aug 24 11:40:27.532820 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 415/784] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:40:27 2022] GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 11:40:27.538796 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-1d2b870e-a722-4ee8-bb5f-2e0417054c02 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '.version_select at 0x7f0e2ee189d0>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:40:27.636446 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-1d2b870e-a722-4ee8-bb5f-2e0417054c02 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1374868740" status: 204 len: 0 microversion: 2.20 time: 0.102343 Aug 24 11:40:27.637079 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 370/785] 10.222.0.84 () {60 vars in 1262 bytes} [Wed Aug 24 11:40:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1374868740 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 11:40:27.674139 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-2528f683-e46b-4781-b264-d72f9afac199 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:40:27.674844 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-2528f683-e46b-4781-b264-d72f9afac199 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:40:27.683888 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-2528f683-e46b-4781-b264-d72f9afac199 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:27.684559 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-2528f683-e46b-4781-b264-d72f9afac199 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:27.685029 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-2528f683-e46b-4781-b264-d72f9afac199 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:27.685836 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-2528f683-e46b-4781-b264-d72f9afac199 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:27.686288 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-2528f683-e46b-4781-b264-d72f9afac199 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:27.686703 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-2528f683-e46b-4781-b264-d72f9afac199 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:27.701320 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.wsgi [None req-2528f683-e46b-4781-b264-d72f9afac199 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] HTTP exception thrown: Instance e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311 could not be found. Aug 24 11:40:27.703509 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-2528f683-e46b-4781-b264-d72f9afac199 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Request method failure captured: Aug 24 11:40:27.703509 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: request: GET /compute/v2.1/servers/e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311 HTTP/1.1 Aug 24 11:40:27.703509 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Accept: application/json Aug 24 11:40:27.703509 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Accept-Encoding: identity Aug 24 11:40:27.703509 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Connection: close Aug 24 11:40:27.703509 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Content-Length: 0 Aug 24 11:40:27.703509 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Content-Type: application/json Aug 24 11:40:27.703509 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Host: 10.222.0.84 Aug 24 11:40:27.703509 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Openstack-System-Scope: None Aug 24 11:40:27.703509 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: User-Agent: python-urllib3/1.26.11 Aug 24 11:40:27.703509 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Auth-Token: gAAAAABjBgweR4cEvCTKaEtRPVxZbNsTt1me1RX2L8orBaoPmyfbKHmzEiPGrzhUPAZ-dVqobDImAozYNHZy-giT-StyTeTjwVyRR-kCHyxEj3vuiJ5-SAwaDdad7hiiarcqgu_OA8lN_aNGemV1KcSFFCiGn60rq1bxi6ViCi6rFYftaJqzRGY Aug 24 11:40:27.703509 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Domain-Id: None Aug 24 11:40:27.703509 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Domain-Name: None Aug 24 11:40:27.703509 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Identity-Status: Confirmed Aug 24 11:40:27.703509 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Is-Admin-Project: True Aug 24 11:40:27.703509 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Project-Domain-Id: default Aug 24 11:40:27.703509 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Project-Domain-Name: Default Aug 24 11:40:27.703509 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Project-Id: 4a4159dc366f41bc9e4057a079f6fb5a Aug 24 11:40:27.703509 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Project-Name: tempest-AttachVolumeNegativeTest-1758140935 Aug 24 11:40:27.703509 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Role: reader,member Aug 24 11:40:27.703509 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Roles: reader,member Aug 24 11:40:27.705103 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/volume/v3/4a4159dc366f41bc9e4057a079f6fb5a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/volume/v3/4a4159dc366f41bc9e4057a079f6fb5a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/compute/v2/4a4159dc366f41bc9e4057a079f6fb5a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84:8080/v1/AUTH_4a4159dc366f41bc9e4057a079f6fb5a", "adminURL": "http://10.222.0.84:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/placement"}]}] Aug 24 11:40:27.705103 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Tenant: tempest-AttachVolumeNegativeTest-1758140935 Aug 24 11:40:27.705103 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Tenant-Id: 4a4159dc366f41bc9e4057a079f6fb5a Aug 24 11:40:27.705103 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1758140935 Aug 24 11:40:27.705103 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-User: tempest-AttachVolumeNegativeTest-1758140935-project Aug 24 11:40:27.705103 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-User-Domain-Id: default Aug 24 11:40:27.705103 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-User-Domain-Name: Default Aug 24 11:40:27.705103 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-User-Id: 2715cf2a5129439c83a5347bb963f1a9 Aug 24 11:40:27.705103 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-User-Name: tempest-AttachVolumeNegativeTest-1758140935-project Aug 24 11:40:27.705103 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: method: > Aug 24 11:40:27.705103 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: exception: Instance e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311 could not be found. Aug 24 11:40:27.705103 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: action_args: {'id': 'e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311'} Aug 24 11:40:27.705843 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:40:27.705843 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:40:27.705843 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:40:27.705843 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:40:27.705843 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:40:27.705843 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:40:27.705843 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:40:27.705843 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:40:27.705843 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:40:27.705843 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:40:27.705843 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311 could not be found. Aug 24 11:40:27.705843 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Aug 24 11:40:27.705843 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:40:27.705843 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Aug 24 11:40:27.705843 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:40:27.705843 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:40:27.705843 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:40:27.705843 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:40:27.705843 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:40:27.705843 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:40:27.707014 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:40:27.707014 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:40:27.707014 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:40:27.707014 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:40:27.707014 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:40:27.707014 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:40:27.707014 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:40:27.707014 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311 could not be found. Aug 24 11:40:27.707014 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Aug 24 11:40:27.707014 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:40:27.707014 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Aug 24 11:40:27.707014 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:40:27.707014 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:40:27.707014 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:40:27.707014 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:40:27.707014 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:40:27.707014 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311 could not be found. Aug 24 11:40:27.707014 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Aug 24 11:40:27.708100 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-2528f683-e46b-4781-b264-d72f9afac199 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Returning 404 to user: Instance e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311 could not be found. {{(pid=124769) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:40:27.708100 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-2528f683-e46b-4781-b264-d72f9afac199 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "GET /compute/v2.1/servers/e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311" status: 404 len: 111 microversion: 2.1 time: 0.036018 Aug 24 11:40:27.708100 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 416/786] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:40:27 2022] GET /compute/v2.1/servers/e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 11:40:27.714247 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-763ce66f-6bb2-43bc-8f73-840b6b648f5c tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '.version_select at 0x7f0e2edd14c0>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:40:27.797753 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-763ce66f-6bb2-43bc-8f73-840b6b648f5c tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1268508440" status: 202 len: 0 microversion: 2.1 time: 0.086526 Aug 24 11:40:27.798259 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 371/787] 10.222.0.84 () {58 vars in 1221 bytes} [Wed Aug 24 11:40:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1268508440 => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:40:28.577253 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-2858b1dd-06a7-4320-9bab-deeec08b23d2 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Action: 'create', calling method: .version_select at 0x7f0e2a3695e0>, body: {"keypair": {"name": "tempest-keypair-1524553077", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO7gLgCQkLeBg1ArOO+msfJQ+h2lz69KzAixP8f2D7qbmeSYtJ1xuN8hlSkgm9MeUODDEc4yEeL22Dir133SXOqnffEiirB6g4VfSYpzbAuCIdN7ujM1rLpp9Hc9xpJ3tQ=="}} {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:40:28.597500 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.quota [None req-2858b1dd-06a7-4320-9bab-deeec08b23d2 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Getting quotas for project 177e00cee82c44a196eaf5d0dc07b7f2. Resources: {'key_pairs'} {{(pid=124769) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:40:28.601715 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.quota [None req-2858b1dd-06a7-4320-9bab-deeec08b23d2 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Getting quotas for user 4a80d0127ee349d69f0ed949bcb4c919 and project 177e00cee82c44a196eaf5d0dc07b7f2. Resources: {'key_pairs'} {{(pid=124769) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:40:28.736393 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-2858b1dd-06a7-4320-9bab-deeec08b23d2 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.164726 Aug 24 11:40:28.737329 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 417/788] 10.222.0.84 () {62 vars in 1200 bytes} [Wed Aug 24 11:40:28 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 167 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 24 11:40:28.771234 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-73576ed3-cab6-4673-9ff7-57ca46a68444 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Action: 'create', calling method: .version_select at 0x7f0e2ee223a0>, body: {"keypair": {"name": "tempest-keypair-1118927290", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA+8Ldf4/CaZyqtmFwORbq+Vs3ehEDfxLsesiQZacHA59r1aO4VHQ6WoOkKmVYaJLdRuHbR73kph3qP5/1flCulElUsDv+447jvp69AG8BXxRmQojWGUOC3VxEPncLQFvQ=="}} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:40:28.789832 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.quota [None req-73576ed3-cab6-4673-9ff7-57ca46a68444 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Getting quotas for project 4a4159dc366f41bc9e4057a079f6fb5a. Resources: {'key_pairs'} {{(pid=124770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:40:28.794663 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.quota [None req-73576ed3-cab6-4673-9ff7-57ca46a68444 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Getting quotas for user 2715cf2a5129439c83a5347bb963f1a9 and project 4a4159dc366f41bc9e4057a079f6fb5a. Resources: {'key_pairs'} {{(pid=124770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:40:28.872355 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-73576ed3-cab6-4673-9ff7-57ca46a68444 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.104784 Aug 24 11:40:28.880532 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 372/789] 10.222.0.84 () {60 vars in 1159 bytes} [Wed Aug 24 11:40:28 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:40:31.384859 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-68107815-60d4-4419-a144-4f3700e2a7e0 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1250505613", "imageRef": "028cad80-8f50-4139-b345-dfdca694dc6b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b03e9a32-741f-4714-819a-fcb9edc6218f"}], "security_groups": [{"name": "tempest-securitygroup--1563189238"}], "key_name": "tempest-keypair-1524553077", "user_data": "}} {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:40:31.510977 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.network.neutron [None req-68107815-60d4-4419-a144-4f3700e2a7e0 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] validate_networks() for [('b03e9a32-741f-4714-819a-fcb9edc6218f', None, None, None, None, None)] {{(pid=124769) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 11:40:31.700260 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-3d335b48-7da0-4170-a525-3736b65de795 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1591077267", "imageRef": "028cad80-8f50-4139-b345-dfdca694dc6b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1a520e2a-cec7-4c07-8304-e0a7f6eeb34e"}], "security_groups": [{"name": "tempest-securitygroup--635837937"}], "key_name": "tempest-keypair-1118927290", "user_data": "}} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:40:31.827868 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.network.neutron [None req-3d335b48-7da0-4170-a525-3736b65de795 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] validate_networks() for [('1a520e2a-cec7-4c07-8304-e0a7f6eeb34e', None, None, None, None, None)] {{(pid=124770) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 11:40:32.208364 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.virt.hardware [None req-68107815-60d4-4419-a144-4f3700e2a7e0 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Flavor limits 0:0:0 {{(pid=124769) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 11:40:32.208982 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.virt.hardware [None req-68107815-60d4-4419-a144-4f3700e2a7e0 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Image limits 0:0:0 {{(pid=124769) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 11:40:32.209465 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.virt.hardware [None req-68107815-60d4-4419-a144-4f3700e2a7e0 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Flavor pref 0:0:0 {{(pid=124769) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 11:40:32.209874 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.virt.hardware [None req-68107815-60d4-4419-a144-4f3700e2a7e0 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Image pref 0:0:0 {{(pid=124769) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 11:40:32.210287 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.virt.hardware [None req-68107815-60d4-4419-a144-4f3700e2a7e0 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124769) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 11:40:32.220671 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-68107815-60d4-4419-a144-4f3700e2a7e0 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:32.221232 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-68107815-60d4-4419-a144-4f3700e2a7e0 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:32.221671 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-68107815-60d4-4419-a144-4f3700e2a7e0 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:32.222401 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-68107815-60d4-4419-a144-4f3700e2a7e0 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:32.223272 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-68107815-60d4-4419-a144-4f3700e2a7e0 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:32.223704 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-68107815-60d4-4419-a144-4f3700e2a7e0 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:32.242617 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.quota [None req-68107815-60d4-4419-a144-4f3700e2a7e0 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Getting quotas for project 177e00cee82c44a196eaf5d0dc07b7f2. Resources: {'ram', 'cores', 'instances'} {{(pid=124769) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:40:32.247372 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.quota [None req-68107815-60d4-4419-a144-4f3700e2a7e0 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Getting quotas for user 4a80d0127ee349d69f0ed949bcb4c919 and project 177e00cee82c44a196eaf5d0dc07b7f2. Resources: {'ram', 'cores', 'instances'} {{(pid=124769) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:40:32.260788 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-68107815-60d4-4419-a144-4f3700e2a7e0 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Going to run 1 instances... {{(pid=124769) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 11:40:32.263140 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-68107815-60d4-4419-a144-4f3700e2a7e0 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: bf04b523-cedf-4e68-b77f-f6039d0de59c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='028cad80-8f50-4139-b345-dfdca694dc6b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124769) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 11:40:32.286574 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.virt.hardware [None req-3d335b48-7da0-4170-a525-3736b65de795 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Flavor limits 0:0:0 {{(pid=124770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 11:40:32.287004 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.virt.hardware [None req-3d335b48-7da0-4170-a525-3736b65de795 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Image limits 0:0:0 {{(pid=124770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 11:40:32.287488 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.virt.hardware [None req-3d335b48-7da0-4170-a525-3736b65de795 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Flavor pref 0:0:0 {{(pid=124770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 11:40:32.287896 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.virt.hardware [None req-3d335b48-7da0-4170-a525-3736b65de795 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Image pref 0:0:0 {{(pid=124770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 11:40:32.288308 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.virt.hardware [None req-3d335b48-7da0-4170-a525-3736b65de795 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 11:40:32.298361 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-3d335b48-7da0-4170-a525-3736b65de795 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:32.298894 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-3d335b48-7da0-4170-a525-3736b65de795 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:32.299343 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-3d335b48-7da0-4170-a525-3736b65de795 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:32.300066 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-3d335b48-7da0-4170-a525-3736b65de795 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:32.300520 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-3d335b48-7da0-4170-a525-3736b65de795 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:32.300978 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-3d335b48-7da0-4170-a525-3736b65de795 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:32.319077 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.quota [None req-3d335b48-7da0-4170-a525-3736b65de795 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Getting quotas for project 4a4159dc366f41bc9e4057a079f6fb5a. Resources: {'ram', 'cores', 'instances'} {{(pid=124770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:40:32.323334 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.quota [None req-3d335b48-7da0-4170-a525-3736b65de795 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Getting quotas for user 2715cf2a5129439c83a5347bb963f1a9 and project 4a4159dc366f41bc9e4057a079f6fb5a. Resources: {'ram', 'cores', 'instances'} {{(pid=124770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:40:32.335611 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-3d335b48-7da0-4170-a525-3736b65de795 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Going to run 1 instances... {{(pid=124770) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 11:40:32.338138 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-3d335b48-7da0-4170-a525-3736b65de795 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: 4b0af30d-b2e2-466a-bc9b-50ae86e6af28] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='028cad80-8f50-4139-b345-dfdca694dc6b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124770) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 11:40:32.363330 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-68107815-60d4-4419-a144-4f3700e2a7e0 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.983516 Aug 24 11:40:32.364060 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 418/790] 10.222.0.84 () {62 vars in 1188 bytes} [Wed Aug 24 11:40:31 2022] POST /compute/v2.1/servers => generated 402 bytes in 985 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 24 11:40:32.375041 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-dccc359c-efea-402c-bec2-779bae3428f6 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:40:32.375668 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-dccc359c-efea-402c-bec2-779bae3428f6 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: bf04b523-cedf-4e68-b77f-f6039d0de59c] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:40:32.435842 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-dccc359c-efea-402c-bec2-779bae3428f6 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:32.444550 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-dccc359c-efea-402c-bec2-779bae3428f6 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:32.446598 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-dccc359c-efea-402c-bec2-779bae3428f6 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:32.447789 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-dccc359c-efea-402c-bec2-779bae3428f6 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c" status: 200 len: 1282 microversion: 2.20 time: 0.076937 Aug 24 11:40:32.448294 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 419/791] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:40:32 2022] GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c => generated 1282 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 11:40:32.483770 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-3d335b48-7da0-4170-a525-3736b65de795 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.788699 Aug 24 11:40:32.489508 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 373/792] 10.222.0.84 () {60 vars in 1147 bytes} [Wed Aug 24 11:40:31 2022] POST /compute/v2.1/servers => generated 401 bytes in 790 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 11:40:32.500335 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-66ee4b37-0f07-48c1-be47-6000059891e6 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:40:32.501692 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-66ee4b37-0f07-48c1-be47-6000059891e6 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: 4b0af30d-b2e2-466a-bc9b-50ae86e6af28] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:40:32.580572 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-66ee4b37-0f07-48c1-be47-6000059891e6 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2715cf2a5129439c83a5347bb963f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4159dc366f41bc9e4057a079f6fb5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:32.588778 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-66ee4b37-0f07-48c1-be47-6000059891e6 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "GET /compute/v2.1/servers/4b0af30d-b2e2-466a-bc9b-50ae86e6af28" status: 200 len: 1242 microversion: 2.1 time: 0.096718 Aug 24 11:40:32.589368 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 420/793] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:40:32 2022] GET /compute/v2.1/servers/4b0af30d-b2e2-466a-bc9b-50ae86e6af28 => generated 1242 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:40:33.474890 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-7cfd9456-36fa-4cbc-96c8-99387b4fc9d6 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:40:33.475610 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-7cfd9456-36fa-4cbc-96c8-99387b4fc9d6 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: bf04b523-cedf-4e68-b77f-f6039d0de59c] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:40:33.481987 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-7cfd9456-36fa-4cbc-96c8-99387b4fc9d6 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:33.482471 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-7cfd9456-36fa-4cbc-96c8-99387b4fc9d6 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:33.482901 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-7cfd9456-36fa-4cbc-96c8-99387b4fc9d6 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:33.483588 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-7cfd9456-36fa-4cbc-96c8-99387b4fc9d6 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:33.484038 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-7cfd9456-36fa-4cbc-96c8-99387b4fc9d6 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:33.485028 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-7cfd9456-36fa-4cbc-96c8-99387b4fc9d6 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:33.501228 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:40:33.550425 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-7cfd9456-36fa-4cbc-96c8-99387b4fc9d6 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:33.561580 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-7cfd9456-36fa-4cbc-96c8-99387b4fc9d6 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:33.563209 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-7cfd9456-36fa-4cbc-96c8-99387b4fc9d6 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:33.564334 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-7cfd9456-36fa-4cbc-96c8-99387b4fc9d6 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c" status: 200 len: 1286 microversion: 2.20 time: 0.094115 Aug 24 11:40:33.564914 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 374/794] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:40:33 2022] GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c => generated 1286 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:40:33.611175 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-d6faa3d1-bd64-4a63-8538-4fa273abc445 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:40:33.611773 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-d6faa3d1-bd64-4a63-8538-4fa273abc445 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: 4b0af30d-b2e2-466a-bc9b-50ae86e6af28] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:40:33.619688 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-d6faa3d1-bd64-4a63-8538-4fa273abc445 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:33.620177 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-d6faa3d1-bd64-4a63-8538-4fa273abc445 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:33.620649 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-d6faa3d1-bd64-4a63-8538-4fa273abc445 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:33.621463 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-d6faa3d1-bd64-4a63-8538-4fa273abc445 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:33.621920 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-d6faa3d1-bd64-4a63-8538-4fa273abc445 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:33.622613 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-d6faa3d1-bd64-4a63-8538-4fa273abc445 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:33.627124 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG dbcounter [-] [124769] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:40:33.695420 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-d6faa3d1-bd64-4a63-8538-4fa273abc445 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2715cf2a5129439c83a5347bb963f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4159dc366f41bc9e4057a079f6fb5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:33.705638 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-d6faa3d1-bd64-4a63-8538-4fa273abc445 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "GET /compute/v2.1/servers/4b0af30d-b2e2-466a-bc9b-50ae86e6af28" status: 200 len: 1246 microversion: 2.1 time: 0.097068 Aug 24 11:40:33.705638 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 421/795] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:40:33 2022] GET /compute/v2.1/servers/4b0af30d-b2e2-466a-bc9b-50ae86e6af28 => generated 1246 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:40:34.588623 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-efa17cfe-bc56-4fd2-bd5f-210adae0bd67 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:40:34.589431 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-efa17cfe-bc56-4fd2-bd5f-210adae0bd67 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: bf04b523-cedf-4e68-b77f-f6039d0de59c] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:40:34.598126 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-efa17cfe-bc56-4fd2-bd5f-210adae0bd67 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:34.598606 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-efa17cfe-bc56-4fd2-bd5f-210adae0bd67 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:34.599037 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-efa17cfe-bc56-4fd2-bd5f-210adae0bd67 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:34.599740 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-efa17cfe-bc56-4fd2-bd5f-210adae0bd67 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:34.600231 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-efa17cfe-bc56-4fd2-bd5f-210adae0bd67 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:34.600642 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-efa17cfe-bc56-4fd2-bd5f-210adae0bd67 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:34.674548 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-efa17cfe-bc56-4fd2-bd5f-210adae0bd67 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:34.683241 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-efa17cfe-bc56-4fd2-bd5f-210adae0bd67 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:34.684745 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-efa17cfe-bc56-4fd2-bd5f-210adae0bd67 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:34.685896 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-efa17cfe-bc56-4fd2-bd5f-210adae0bd67 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c" status: 200 len: 1334 microversion: 2.20 time: 0.102756 Aug 24 11:40:34.686452 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 375/796] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:40:34 2022] GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c => generated 1334 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:40:34.732434 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-4a0ffe6e-6dee-4f70-9e4f-497ce932948b tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:40:34.733090 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-4a0ffe6e-6dee-4f70-9e4f-497ce932948b tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: 4b0af30d-b2e2-466a-bc9b-50ae86e6af28] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:40:34.740925 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-4a0ffe6e-6dee-4f70-9e4f-497ce932948b tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:34.741436 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-4a0ffe6e-6dee-4f70-9e4f-497ce932948b tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:34.741858 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-4a0ffe6e-6dee-4f70-9e4f-497ce932948b tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:34.742561 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-4a0ffe6e-6dee-4f70-9e4f-497ce932948b tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:34.743017 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-4a0ffe6e-6dee-4f70-9e4f-497ce932948b tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:34.743445 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-4a0ffe6e-6dee-4f70-9e4f-497ce932948b tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:34.821186 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-4a0ffe6e-6dee-4f70-9e4f-497ce932948b tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2715cf2a5129439c83a5347bb963f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4159dc366f41bc9e4057a079f6fb5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:34.830871 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-4a0ffe6e-6dee-4f70-9e4f-497ce932948b tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "GET /compute/v2.1/servers/4b0af30d-b2e2-466a-bc9b-50ae86e6af28" status: 200 len: 1294 microversion: 2.1 time: 0.102448 Aug 24 11:40:34.831603 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 422/797] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:40:34 2022] GET /compute/v2.1/servers/4b0af30d-b2e2-466a-bc9b-50ae86e6af28 => generated 1294 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:40:35.719938 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-06a4c014-30af-4278-85a3-ac68de1c0a44 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:40:35.719938 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-06a4c014-30af-4278-85a3-ac68de1c0a44 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: bf04b523-cedf-4e68-b77f-f6039d0de59c] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:40:35.719938 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-06a4c014-30af-4278-85a3-ac68de1c0a44 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:35.720973 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-06a4c014-30af-4278-85a3-ac68de1c0a44 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:35.721497 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-06a4c014-30af-4278-85a3-ac68de1c0a44 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:35.722174 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-06a4c014-30af-4278-85a3-ac68de1c0a44 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:35.722639 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-06a4c014-30af-4278-85a3-ac68de1c0a44 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:35.723062 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-06a4c014-30af-4278-85a3-ac68de1c0a44 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:35.832651 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-06a4c014-30af-4278-85a3-ac68de1c0a44 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:35.841338 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-06a4c014-30af-4278-85a3-ac68de1c0a44 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:35.842826 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-06a4c014-30af-4278-85a3-ac68de1c0a44 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:35.845717 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-06a4c014-30af-4278-85a3-ac68de1c0a44 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c" status: 200 len: 1342 microversion: 2.20 time: 0.138896 Aug 24 11:40:35.846680 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 376/798] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:40:35 2022] GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c => generated 1342 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:40:35.857265 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-88d14ece-9e83-4118-8321-b64bc6638bab tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:40:35.862557 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-88d14ece-9e83-4118-8321-b64bc6638bab tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: 4b0af30d-b2e2-466a-bc9b-50ae86e6af28] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:40:35.871543 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-88d14ece-9e83-4118-8321-b64bc6638bab tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:35.872558 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-88d14ece-9e83-4118-8321-b64bc6638bab tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:35.873347 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-88d14ece-9e83-4118-8321-b64bc6638bab tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:35.874518 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-88d14ece-9e83-4118-8321-b64bc6638bab tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:35.875833 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-88d14ece-9e83-4118-8321-b64bc6638bab tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:35.876531 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-88d14ece-9e83-4118-8321-b64bc6638bab tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:35.949296 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-88d14ece-9e83-4118-8321-b64bc6638bab tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2715cf2a5129439c83a5347bb963f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4159dc366f41bc9e4057a079f6fb5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:35.958277 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-88d14ece-9e83-4118-8321-b64bc6638bab tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "GET /compute/v2.1/servers/4b0af30d-b2e2-466a-bc9b-50ae86e6af28" status: 200 len: 1302 microversion: 2.1 time: 0.108201 Aug 24 11:40:35.958857 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 423/799] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:40:35 2022] GET /compute/v2.1/servers/4b0af30d-b2e2-466a-bc9b-50ae86e6af28 => generated 1302 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:40:36.871061 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-4ee957a9-6b3e-49fb-8a12-22bb1aea6438 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:40:36.871900 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-4ee957a9-6b3e-49fb-8a12-22bb1aea6438 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: bf04b523-cedf-4e68-b77f-f6039d0de59c] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:40:36.880748 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4ee957a9-6b3e-49fb-8a12-22bb1aea6438 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:36.881333 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4ee957a9-6b3e-49fb-8a12-22bb1aea6438 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:36.881767 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4ee957a9-6b3e-49fb-8a12-22bb1aea6438 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:36.882611 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4ee957a9-6b3e-49fb-8a12-22bb1aea6438 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:36.883079 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4ee957a9-6b3e-49fb-8a12-22bb1aea6438 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:36.883503 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4ee957a9-6b3e-49fb-8a12-22bb1aea6438 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:36.986340 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-e4807212-ca79-42cd-990f-09baa9c44cff tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:40:36.988148 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-e4807212-ca79-42cd-990f-09baa9c44cff tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: 4b0af30d-b2e2-466a-bc9b-50ae86e6af28] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:40:36.997522 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-e4807212-ca79-42cd-990f-09baa9c44cff tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:36.998010 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-e4807212-ca79-42cd-990f-09baa9c44cff tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:36.998704 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-e4807212-ca79-42cd-990f-09baa9c44cff tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:36.999508 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-e4807212-ca79-42cd-990f-09baa9c44cff tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:36.999960 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-e4807212-ca79-42cd-990f-09baa9c44cff tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:37.000520 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-e4807212-ca79-42cd-990f-09baa9c44cff tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:37.169190 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-4ee957a9-6b3e-49fb-8a12-22bb1aea6438 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:37.181768 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-4ee957a9-6b3e-49fb-8a12-22bb1aea6438 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:37.187460 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-4ee957a9-6b3e-49fb-8a12-22bb1aea6438 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:37.188870 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-4ee957a9-6b3e-49fb-8a12-22bb1aea6438 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c" status: 200 len: 1408 microversion: 2.20 time: 0.321936 Aug 24 11:40:37.189985 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 377/800] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:40:36 2022] GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c => generated 1408 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:40:37.240606 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-e4807212-ca79-42cd-990f-09baa9c44cff tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2715cf2a5129439c83a5347bb963f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4159dc366f41bc9e4057a079f6fb5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:37.254813 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-e4807212-ca79-42cd-990f-09baa9c44cff tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "GET /compute/v2.1/servers/4b0af30d-b2e2-466a-bc9b-50ae86e6af28" status: 200 len: 1367 microversion: 2.1 time: 0.274593 Aug 24 11:40:37.256275 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 424/801] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:40:36 2022] GET /compute/v2.1/servers/4b0af30d-b2e2-466a-bc9b-50ae86e6af28 => generated 1367 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:40:38.212193 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-c7e03b4b-b26c-4f63-82a0-b84ea46fa81b tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:40:38.214124 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-c7e03b4b-b26c-4f63-82a0-b84ea46fa81b tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: bf04b523-cedf-4e68-b77f-f6039d0de59c] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:40:38.222851 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c7e03b4b-b26c-4f63-82a0-b84ea46fa81b tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:38.223355 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c7e03b4b-b26c-4f63-82a0-b84ea46fa81b tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:38.223771 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c7e03b4b-b26c-4f63-82a0-b84ea46fa81b tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:38.224493 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c7e03b4b-b26c-4f63-82a0-b84ea46fa81b tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:38.224981 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c7e03b4b-b26c-4f63-82a0-b84ea46fa81b tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:38.225402 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c7e03b4b-b26c-4f63-82a0-b84ea46fa81b tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:38.279229 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-6d7e4d81-aa31-475a-bc42-c7e866764f93 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:40:38.279934 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-6d7e4d81-aa31-475a-bc42-c7e866764f93 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: 4b0af30d-b2e2-466a-bc9b-50ae86e6af28] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:40:38.288148 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-6d7e4d81-aa31-475a-bc42-c7e866764f93 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:38.288973 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-6d7e4d81-aa31-475a-bc42-c7e866764f93 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:38.289419 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-6d7e4d81-aa31-475a-bc42-c7e866764f93 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:38.290169 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-6d7e4d81-aa31-475a-bc42-c7e866764f93 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:38.290625 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-6d7e4d81-aa31-475a-bc42-c7e866764f93 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:38.291046 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-6d7e4d81-aa31-475a-bc42-c7e866764f93 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:38.532424 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-6d7e4d81-aa31-475a-bc42-c7e866764f93 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2715cf2a5129439c83a5347bb963f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4159dc366f41bc9e4057a079f6fb5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:38.540897 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-6d7e4d81-aa31-475a-bc42-c7e866764f93 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "GET /compute/v2.1/servers/4b0af30d-b2e2-466a-bc9b-50ae86e6af28" status: 200 len: 1367 microversion: 2.1 time: 0.267211 Aug 24 11:40:38.541620 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 425/802] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:40:38 2022] GET /compute/v2.1/servers/4b0af30d-b2e2-466a-bc9b-50ae86e6af28 => generated 1367 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:40:38.545874 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-c7e03b4b-b26c-4f63-82a0-b84ea46fa81b tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:38.556665 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-c7e03b4b-b26c-4f63-82a0-b84ea46fa81b tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:38.558247 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-c7e03b4b-b26c-4f63-82a0-b84ea46fa81b tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:38.559514 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-c7e03b4b-b26c-4f63-82a0-b84ea46fa81b tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c" status: 200 len: 1408 microversion: 2.20 time: 0.351506 Aug 24 11:40:38.560407 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 378/803] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:40:38 2022] GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c => generated 1408 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:40:38.701296 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [req-8ea63568-5784-4ee9-bfe1-0055924c21d3 req-7964ada7-b883-440c-af0a-c322ba3a77ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf04b523-cedf-4e68-b77f-f6039d0de59c", "tag": "c30f1b51-2afd-425d-956e-dbabf88edac3"}]} {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:40:38.715174 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [req-8ea63568-5784-4ee9-bfe1-0055924c21d3 req-7964ada7-b883-440c-af0a-c322ba3a77ed service nova] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:38.715672 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [req-8ea63568-5784-4ee9-bfe1-0055924c21d3 req-7964ada7-b883-440c-af0a-c322ba3a77ed service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:38.716521 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [req-8ea63568-5784-4ee9-bfe1-0055924c21d3 req-7964ada7-b883-440c-af0a-c322ba3a77ed service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:38.734218 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.compute.server_external_events [req-8ea63568-5784-4ee9-bfe1-0055924c21d3 req-7964ada7-b883-440c-af0a-c322ba3a77ed service nova] Creating event network-changed:c30f1b51-2afd-425d-956e-dbabf88edac3 for instance bf04b523-cedf-4e68-b77f-f6039d0de59c on hv-cinder-85427 Aug 24 11:40:38.741209 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [req-8ea63568-5784-4ee9-bfe1-0055924c21d3 req-7964ada7-b883-440c-af0a-c322ba3a77ed service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046485 Aug 24 11:40:38.742744 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 426/804] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Aug 24 11:40:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:40:39.561492 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-9788f87b-a90e-4f1d-9870-4ade88b3382d tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:40:39.562132 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-9788f87b-a90e-4f1d-9870-4ade88b3382d tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: 4b0af30d-b2e2-466a-bc9b-50ae86e6af28] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:40:39.569306 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9788f87b-a90e-4f1d-9870-4ade88b3382d tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:39.569805 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9788f87b-a90e-4f1d-9870-4ade88b3382d tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:39.570247 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9788f87b-a90e-4f1d-9870-4ade88b3382d tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:39.570955 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9788f87b-a90e-4f1d-9870-4ade88b3382d tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:39.571413 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9788f87b-a90e-4f1d-9870-4ade88b3382d tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:39.571890 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9788f87b-a90e-4f1d-9870-4ade88b3382d tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:39.583430 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-e035cb3a-981f-4164-b91e-5ef3b785b6d9 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:40:39.584135 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-e035cb3a-981f-4164-b91e-5ef3b785b6d9 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: bf04b523-cedf-4e68-b77f-f6039d0de59c] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:40:39.590668 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-e035cb3a-981f-4164-b91e-5ef3b785b6d9 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:39.591164 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-e035cb3a-981f-4164-b91e-5ef3b785b6d9 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:39.591813 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-e035cb3a-981f-4164-b91e-5ef3b785b6d9 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:39.592700 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-e035cb3a-981f-4164-b91e-5ef3b785b6d9 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:39.593217 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-e035cb3a-981f-4164-b91e-5ef3b785b6d9 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:39.594163 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-e035cb3a-981f-4164-b91e-5ef3b785b6d9 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:39.768388 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-e035cb3a-981f-4164-b91e-5ef3b785b6d9 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:39.774800 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-9788f87b-a90e-4f1d-9870-4ade88b3382d tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2715cf2a5129439c83a5347bb963f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4159dc366f41bc9e4057a079f6fb5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:39.777963 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-e035cb3a-981f-4164-b91e-5ef3b785b6d9 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:39.779752 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-e035cb3a-981f-4164-b91e-5ef3b785b6d9 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:39.780907 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-e035cb3a-981f-4164-b91e-5ef3b785b6d9 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c" status: 200 len: 1408 microversion: 2.20 time: 0.201855 Aug 24 11:40:39.781537 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 427/805] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:40:39 2022] GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c => generated 1408 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 11:40:39.790122 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-9788f87b-a90e-4f1d-9870-4ade88b3382d tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "GET /compute/v2.1/servers/4b0af30d-b2e2-466a-bc9b-50ae86e6af28" status: 200 len: 1367 microversion: 2.1 time: 0.232528 Aug 24 11:40:39.790741 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 379/806] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:40:39 2022] GET /compute/v2.1/servers/4b0af30d-b2e2-466a-bc9b-50ae86e6af28 => generated 1367 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:40:40.768004 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [req-d30a3c1b-33b5-4f2b-8dc6-1b2b24e47964 req-a4893a34-d852-4c81-b8ea-acced69886c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b0af30d-b2e2-466a-bc9b-50ae86e6af28", "tag": "78105eb8-f7d5-4afd-812f-3c338f397c22"}]} {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:40:40.777313 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [req-d30a3c1b-33b5-4f2b-8dc6-1b2b24e47964 req-a4893a34-d852-4c81-b8ea-acced69886c3 service nova] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:40.777790 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [req-d30a3c1b-33b5-4f2b-8dc6-1b2b24e47964 req-a4893a34-d852-4c81-b8ea-acced69886c3 service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:40.778224 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [req-d30a3c1b-33b5-4f2b-8dc6-1b2b24e47964 req-a4893a34-d852-4c81-b8ea-acced69886c3 service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:40.789890 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.compute.server_external_events [req-d30a3c1b-33b5-4f2b-8dc6-1b2b24e47964 req-a4893a34-d852-4c81-b8ea-acced69886c3 service nova] Creating event network-changed:78105eb8-f7d5-4afd-812f-3c338f397c22 for instance 4b0af30d-b2e2-466a-bc9b-50ae86e6af28 on hv-cinder-85427 Aug 24 11:40:40.794644 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [req-d30a3c1b-33b5-4f2b-8dc6-1b2b24e47964 req-a4893a34-d852-4c81-b8ea-acced69886c3 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034587 Aug 24 11:40:40.795237 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 428/807] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Aug 24 11:40:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:40:40.805996 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-9136a455-d53a-4b30-974c-8c5def885152 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:40:40.806877 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-9136a455-d53a-4b30-974c-8c5def885152 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: bf04b523-cedf-4e68-b77f-f6039d0de59c] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:40:40.811803 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-6d2b3629-bcf1-439f-a099-0e9a7f7952c6 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:40:40.812747 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-6d2b3629-bcf1-439f-a099-0e9a7f7952c6 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: 4b0af30d-b2e2-466a-bc9b-50ae86e6af28] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:40:40.813607 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9136a455-d53a-4b30-974c-8c5def885152 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:40.814263 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9136a455-d53a-4b30-974c-8c5def885152 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:40.814543 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9136a455-d53a-4b30-974c-8c5def885152 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:40.815254 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9136a455-d53a-4b30-974c-8c5def885152 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:40.815713 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9136a455-d53a-4b30-974c-8c5def885152 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:40.816136 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9136a455-d53a-4b30-974c-8c5def885152 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:40.819034 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-6d2b3629-bcf1-439f-a099-0e9a7f7952c6 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:40.819520 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-6d2b3629-bcf1-439f-a099-0e9a7f7952c6 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:40.819958 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-6d2b3629-bcf1-439f-a099-0e9a7f7952c6 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:40.820663 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-6d2b3629-bcf1-439f-a099-0e9a7f7952c6 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:40.821218 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-6d2b3629-bcf1-439f-a099-0e9a7f7952c6 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:40.821642 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-6d2b3629-bcf1-439f-a099-0e9a7f7952c6 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:40.960815 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-9136a455-d53a-4b30-974c-8c5def885152 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:40.968198 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-6d2b3629-bcf1-439f-a099-0e9a7f7952c6 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2715cf2a5129439c83a5347bb963f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4159dc366f41bc9e4057a079f6fb5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:40.971323 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-9136a455-d53a-4b30-974c-8c5def885152 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:40.972978 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-9136a455-d53a-4b30-974c-8c5def885152 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:40.974198 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-9136a455-d53a-4b30-974c-8c5def885152 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c" status: 200 len: 1408 microversion: 2.20 time: 0.174021 Aug 24 11:40:40.974858 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 380/808] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:40:40 2022] GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c => generated 1408 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:40:40.978324 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-6d2b3629-bcf1-439f-a099-0e9a7f7952c6 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "GET /compute/v2.1/servers/4b0af30d-b2e2-466a-bc9b-50ae86e6af28" status: 200 len: 1367 microversion: 2.1 time: 0.170247 Aug 24 11:40:40.979286 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 429/809] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:40:40 2022] GET /compute/v2.1/servers/4b0af30d-b2e2-466a-bc9b-50ae86e6af28 => generated 1367 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:40:41.997696 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-6791b0ef-c8ff-4e11-85ad-68b0e7da8321 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:40:41.998312 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-6791b0ef-c8ff-4e11-85ad-68b0e7da8321 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: bf04b523-cedf-4e68-b77f-f6039d0de59c] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:40:42.000598 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-9450107c-5b10-4022-a835-467bf424d836 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:40:42.001533 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-9450107c-5b10-4022-a835-467bf424d836 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: 4b0af30d-b2e2-466a-bc9b-50ae86e6af28] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:40:42.005457 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6791b0ef-c8ff-4e11-85ad-68b0e7da8321 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:42.005950 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6791b0ef-c8ff-4e11-85ad-68b0e7da8321 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:42.006389 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6791b0ef-c8ff-4e11-85ad-68b0e7da8321 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:42.007232 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6791b0ef-c8ff-4e11-85ad-68b0e7da8321 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:42.007715 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6791b0ef-c8ff-4e11-85ad-68b0e7da8321 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:42.007848 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-9450107c-5b10-4022-a835-467bf424d836 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:42.008200 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6791b0ef-c8ff-4e11-85ad-68b0e7da8321 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:42.008322 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-9450107c-5b10-4022-a835-467bf424d836 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:42.009122 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-9450107c-5b10-4022-a835-467bf424d836 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:42.009862 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-9450107c-5b10-4022-a835-467bf424d836 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:42.010322 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-9450107c-5b10-4022-a835-467bf424d836 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:42.010768 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-9450107c-5b10-4022-a835-467bf424d836 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:42.151414 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-9450107c-5b10-4022-a835-467bf424d836 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2715cf2a5129439c83a5347bb963f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4159dc366f41bc9e4057a079f6fb5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:42.151618 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-6791b0ef-c8ff-4e11-85ad-68b0e7da8321 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:42.161508 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-9450107c-5b10-4022-a835-467bf424d836 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "GET /compute/v2.1/servers/4b0af30d-b2e2-466a-bc9b-50ae86e6af28" status: 200 len: 1367 microversion: 2.1 time: 0.165591 Aug 24 11:40:42.162088 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 430/810] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:40:41 2022] GET /compute/v2.1/servers/4b0af30d-b2e2-466a-bc9b-50ae86e6af28 => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:40:42.162250 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-6791b0ef-c8ff-4e11-85ad-68b0e7da8321 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:42.163704 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-6791b0ef-c8ff-4e11-85ad-68b0e7da8321 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:42.164825 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-6791b0ef-c8ff-4e11-85ad-68b0e7da8321 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c" status: 200 len: 1408 microversion: 2.20 time: 0.171407 Aug 24 11:40:42.165380 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 381/811] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:40:41 2022] GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c => generated 1408 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:40:43.183504 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-5be9fb6c-8a91-46a9-aeb1-ed1cb2336d78 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:40:43.184190 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-5be9fb6c-8a91-46a9-aeb1-ed1cb2336d78 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: 4b0af30d-b2e2-466a-bc9b-50ae86e6af28] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:40:43.186985 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG dbcounter [-] [124769] Writing DB stats nova_cell0:SELECT=2 {{(pid=124769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:40:43.188135 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG dbcounter [-] [124769] Writing DB stats nova_cell0:SELECT=14 {{(pid=124769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:40:43.188266 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-cc689a55-ce2e-40b4-9eeb-bed6feedd7f8 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:40:43.188920 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-cc689a55-ce2e-40b4-9eeb-bed6feedd7f8 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: bf04b523-cedf-4e68-b77f-f6039d0de59c] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:40:43.190803 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_cell0:SELECT=2 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:40:43.191483 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_cell0:SELECT=10 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:40:43.197141 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-cc689a55-ce2e-40b4-9eeb-bed6feedd7f8 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:43.197307 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-5be9fb6c-8a91-46a9-aeb1-ed1cb2336d78 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:43.197628 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-cc689a55-ce2e-40b4-9eeb-bed6feedd7f8 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:43.197977 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-5be9fb6c-8a91-46a9-aeb1-ed1cb2336d78 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:43.198124 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-cc689a55-ce2e-40b4-9eeb-bed6feedd7f8 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:43.198695 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-5be9fb6c-8a91-46a9-aeb1-ed1cb2336d78 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:43.198805 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-cc689a55-ce2e-40b4-9eeb-bed6feedd7f8 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:43.199165 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-cc689a55-ce2e-40b4-9eeb-bed6feedd7f8 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:43.199583 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-cc689a55-ce2e-40b4-9eeb-bed6feedd7f8 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:43.199818 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-5be9fb6c-8a91-46a9-aeb1-ed1cb2336d78 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:43.200547 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-5be9fb6c-8a91-46a9-aeb1-ed1cb2336d78 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:43.201284 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-5be9fb6c-8a91-46a9-aeb1-ed1cb2336d78 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:43.345074 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-cc689a55-ce2e-40b4-9eeb-bed6feedd7f8 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:43.353655 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-cc689a55-ce2e-40b4-9eeb-bed6feedd7f8 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:43.355195 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-cc689a55-ce2e-40b4-9eeb-bed6feedd7f8 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:43.356315 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-cc689a55-ce2e-40b4-9eeb-bed6feedd7f8 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c" status: 200 len: 1408 microversion: 2.20 time: 0.172369 Aug 24 11:40:43.356924 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 382/812] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:40:43 2022] GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c => generated 1408 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:40:43.364593 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-5be9fb6c-8a91-46a9-aeb1-ed1cb2336d78 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2715cf2a5129439c83a5347bb963f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4159dc366f41bc9e4057a079f6fb5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:43.372881 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-5be9fb6c-8a91-46a9-aeb1-ed1cb2336d78 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "GET /compute/v2.1/servers/4b0af30d-b2e2-466a-bc9b-50ae86e6af28" status: 200 len: 1367 microversion: 2.1 time: 0.194002 Aug 24 11:40:43.373461 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 431/813] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:40:43 2022] GET /compute/v2.1/servers/4b0af30d-b2e2-466a-bc9b-50ae86e6af28 => generated 1367 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:40:44.381171 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-e7963378-f70b-4d85-95cc-44813931735c tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:40:44.382104 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-e7963378-f70b-4d85-95cc-44813931735c tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: bf04b523-cedf-4e68-b77f-f6039d0de59c] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:40:44.388894 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e7963378-f70b-4d85-95cc-44813931735c tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:44.389475 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e7963378-f70b-4d85-95cc-44813931735c tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:44.389831 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e7963378-f70b-4d85-95cc-44813931735c tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:44.390580 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e7963378-f70b-4d85-95cc-44813931735c tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:44.391585 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e7963378-f70b-4d85-95cc-44813931735c tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:44.392025 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e7963378-f70b-4d85-95cc-44813931735c tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:44.397142 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-20330bc3-c451-4ad8-a0ab-b5278ed0e41c tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:40:44.398044 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-20330bc3-c451-4ad8-a0ab-b5278ed0e41c tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: 4b0af30d-b2e2-466a-bc9b-50ae86e6af28] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:40:44.404517 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-20330bc3-c451-4ad8-a0ab-b5278ed0e41c tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:44.405029 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-20330bc3-c451-4ad8-a0ab-b5278ed0e41c tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:44.405464 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-20330bc3-c451-4ad8-a0ab-b5278ed0e41c tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:44.406151 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-20330bc3-c451-4ad8-a0ab-b5278ed0e41c tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:44.406764 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-20330bc3-c451-4ad8-a0ab-b5278ed0e41c tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:44.407579 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-20330bc3-c451-4ad8-a0ab-b5278ed0e41c tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:44.531521 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-e7963378-f70b-4d85-95cc-44813931735c tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:44.536828 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-e7963378-f70b-4d85-95cc-44813931735c tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:44.538334 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-e7963378-f70b-4d85-95cc-44813931735c tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:44.539448 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-e7963378-f70b-4d85-95cc-44813931735c tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c" status: 200 len: 1408 microversion: 2.20 time: 0.164989 Aug 24 11:40:44.540088 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 383/814] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:40:44 2022] GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c => generated 1408 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:40:44.544826 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-20330bc3-c451-4ad8-a0ab-b5278ed0e41c tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2715cf2a5129439c83a5347bb963f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4159dc366f41bc9e4057a079f6fb5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:44.554185 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-20330bc3-c451-4ad8-a0ab-b5278ed0e41c tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "GET /compute/v2.1/servers/4b0af30d-b2e2-466a-bc9b-50ae86e6af28" status: 200 len: 1367 microversion: 2.1 time: 0.161119 Aug 24 11:40:44.555076 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 432/815] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:40:44 2022] GET /compute/v2.1/servers/4b0af30d-b2e2-466a-bc9b-50ae86e6af28 => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:40:45.563759 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-f98228b3-6795-4c18-bd07-1a778516ac32 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:40:45.564722 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-f98228b3-6795-4c18-bd07-1a778516ac32 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: bf04b523-cedf-4e68-b77f-f6039d0de59c] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:40:45.571412 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-f98228b3-6795-4c18-bd07-1a778516ac32 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:45.571908 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-f98228b3-6795-4c18-bd07-1a778516ac32 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:45.572436 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-f98228b3-6795-4c18-bd07-1a778516ac32 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:45.573129 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-f98228b3-6795-4c18-bd07-1a778516ac32 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:45.573550 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-f98228b3-6795-4c18-bd07-1a778516ac32 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:45.574019 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-f98228b3-6795-4c18-bd07-1a778516ac32 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:45.577100 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-8e18f05c-939b-424f-ad77-035ec529ae65 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:40:45.577731 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-8e18f05c-939b-424f-ad77-035ec529ae65 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: 4b0af30d-b2e2-466a-bc9b-50ae86e6af28] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:40:45.584535 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-8e18f05c-939b-424f-ad77-035ec529ae65 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:45.585201 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-8e18f05c-939b-424f-ad77-035ec529ae65 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:45.585638 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-8e18f05c-939b-424f-ad77-035ec529ae65 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:45.586354 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-8e18f05c-939b-424f-ad77-035ec529ae65 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:45.586802 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-8e18f05c-939b-424f-ad77-035ec529ae65 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:45.587252 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-8e18f05c-939b-424f-ad77-035ec529ae65 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:45.746248 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-8e18f05c-939b-424f-ad77-035ec529ae65 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2715cf2a5129439c83a5347bb963f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4159dc366f41bc9e4057a079f6fb5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:45.752736 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-f98228b3-6795-4c18-bd07-1a778516ac32 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:45.754585 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-8e18f05c-939b-424f-ad77-035ec529ae65 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "GET /compute/v2.1/servers/4b0af30d-b2e2-466a-bc9b-50ae86e6af28" status: 200 len: 1367 microversion: 2.1 time: 0.181896 Aug 24 11:40:45.755198 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 433/816] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:40:45 2022] GET /compute/v2.1/servers/4b0af30d-b2e2-466a-bc9b-50ae86e6af28 => generated 1367 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:40:45.761407 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-f98228b3-6795-4c18-bd07-1a778516ac32 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:45.762887 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-f98228b3-6795-4c18-bd07-1a778516ac32 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:45.763985 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-f98228b3-6795-4c18-bd07-1a778516ac32 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c" status: 200 len: 1408 microversion: 2.20 time: 0.204365 Aug 24 11:40:45.764530 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 384/817] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:40:45 2022] GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c => generated 1408 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 11:40:46.688191 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-c839b007-a698-459d-8611-6537cc0a655f tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:40:46.690066 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-c839b007-a698-459d-8611-6537cc0a655f tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: a8ce5b7f-1b02-4746-9aa5-0d826615df18] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:40:46.696600 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-c839b007-a698-459d-8611-6537cc0a655f tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:46.697104 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-c839b007-a698-459d-8611-6537cc0a655f tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:46.697660 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-c839b007-a698-459d-8611-6537cc0a655f tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:46.698429 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-c839b007-a698-459d-8611-6537cc0a655f tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:46.698880 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-c839b007-a698-459d-8611-6537cc0a655f tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:46.699303 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-c839b007-a698-459d-8611-6537cc0a655f tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:46.776073 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-054e1cf0-d92b-480a-b639-db30de12797f tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:40:46.777556 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-054e1cf0-d92b-480a-b639-db30de12797f tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: 4b0af30d-b2e2-466a-bc9b-50ae86e6af28] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:40:46.779898 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=1,nova_api:DELETE=2,nova_api:INSERT=4 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:40:46.787753 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-054e1cf0-d92b-480a-b639-db30de12797f tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:46.788252 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-054e1cf0-d92b-480a-b639-db30de12797f tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:46.788693 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-054e1cf0-d92b-480a-b639-db30de12797f tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:46.789449 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-054e1cf0-d92b-480a-b639-db30de12797f tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:46.789911 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-054e1cf0-d92b-480a-b639-db30de12797f tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:46.790333 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-054e1cf0-d92b-480a-b639-db30de12797f tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:46.811764 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.objects.instance [None req-c839b007-a698-459d-8611-6537cc0a655f tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lazy-loading 'services' on Instance uuid a8ce5b7f-1b02-4746-9aa5-0d826615df18 {{(pid=124769) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:40:47.037708 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-054e1cf0-d92b-480a-b639-db30de12797f tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2715cf2a5129439c83a5347bb963f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4159dc366f41bc9e4057a079f6fb5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:47.045527 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-054e1cf0-d92b-480a-b639-db30de12797f tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "GET /compute/v2.1/servers/4b0af30d-b2e2-466a-bc9b-50ae86e6af28" status: 200 len: 1367 microversion: 2.1 time: 0.273640 Aug 24 11:40:47.046056 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 385/818] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:40:46 2022] GET /compute/v2.1/servers/4b0af30d-b2e2-466a-bc9b-50ae86e6af28 => generated 1367 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:40:47.050871 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-9f9c3b7a-3bf6-4830-832a-174b6c9ec8bd tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:40:47.051480 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-9f9c3b7a-3bf6-4830-832a-174b6c9ec8bd tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: bf04b523-cedf-4e68-b77f-f6039d0de59c] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:40:47.064926 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9f9c3b7a-3bf6-4830-832a-174b6c9ec8bd tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:47.064926 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9f9c3b7a-3bf6-4830-832a-174b6c9ec8bd tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:47.064926 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9f9c3b7a-3bf6-4830-832a-174b6c9ec8bd tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:47.064926 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9f9c3b7a-3bf6-4830-832a-174b6c9ec8bd tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:47.065548 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9f9c3b7a-3bf6-4830-832a-174b6c9ec8bd tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:47.065548 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9f9c3b7a-3bf6-4830-832a-174b6c9ec8bd tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:47.087242 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-c839b007-a698-459d-8611-6537cc0a655f tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "DELETE /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18/os-volume_attachments/6427e65b-6458-4f62-9b33-99bdc9a6a645" status: 202 len: 0 microversion: 2.1 time: 0.402974 Aug 24 11:40:47.097257 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 434/819] 10.222.0.84 () {58 vars in 1416 bytes} [Wed Aug 24 11:40:46 2022] DELETE /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18/os-volume_attachments/6427e65b-6458-4f62-9b33-99bdc9a6a645 => generated 0 bytes in 405 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:40:47.099434 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-3828dc5e-2d83-4476-a0ae-cb27e0edc8a6 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:40:47.102232 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-3828dc5e-2d83-4476-a0ae-cb27e0edc8a6 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: a8ce5b7f-1b02-4746-9aa5-0d826615df18] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:40:47.109075 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-3828dc5e-2d83-4476-a0ae-cb27e0edc8a6 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:47.109772 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-3828dc5e-2d83-4476-a0ae-cb27e0edc8a6 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:47.110498 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-3828dc5e-2d83-4476-a0ae-cb27e0edc8a6 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:47.111488 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-3828dc5e-2d83-4476-a0ae-cb27e0edc8a6 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:47.112036 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-3828dc5e-2d83-4476-a0ae-cb27e0edc8a6 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:47.112534 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-3828dc5e-2d83-4476-a0ae-cb27e0edc8a6 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:47.146317 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-3828dc5e-2d83-4476-a0ae-cb27e0edc8a6 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053099 Aug 24 11:40:47.151345 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 435/820] 10.222.0.84 () {58 vars in 1302 bytes} [Wed Aug 24 11:40:47 2022] GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:40:47.288576 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-9f9c3b7a-3bf6-4830-832a-174b6c9ec8bd tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:47.307089 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-9f9c3b7a-3bf6-4830-832a-174b6c9ec8bd tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:47.308689 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-9f9c3b7a-3bf6-4830-832a-174b6c9ec8bd tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:47.309933 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-9f9c3b7a-3bf6-4830-832a-174b6c9ec8bd tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c" status: 200 len: 1408 microversion: 2.20 time: 0.262944 Aug 24 11:40:47.326418 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 386/821] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:40:47 2022] GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c => generated 1408 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:40:47.615477 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [req-5b95970e-eb03-4c45-b220-173a92269934 req-992691cc-0b1b-49d9-a48c-bf2955c6ce6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b0af30d-b2e2-466a-bc9b-50ae86e6af28", "name": "network-vif-plugged", "status": "completed", "tag": "78105eb8-f7d5-4afd-812f-3c338f397c22"}]} {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:40:47.626297 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [req-5b95970e-eb03-4c45-b220-173a92269934 req-992691cc-0b1b-49d9-a48c-bf2955c6ce6a service nova] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:47.626833 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [req-5b95970e-eb03-4c45-b220-173a92269934 req-992691cc-0b1b-49d9-a48c-bf2955c6ce6a service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:47.627665 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [req-5b95970e-eb03-4c45-b220-173a92269934 req-992691cc-0b1b-49d9-a48c-bf2955c6ce6a service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:47.640845 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.compute.server_external_events [req-5b95970e-eb03-4c45-b220-173a92269934 req-992691cc-0b1b-49d9-a48c-bf2955c6ce6a service nova] Creating event network-vif-plugged:78105eb8-f7d5-4afd-812f-3c338f397c22 for instance 4b0af30d-b2e2-466a-bc9b-50ae86e6af28 on hv-cinder-85427 Aug 24 11:40:47.646062 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [req-5b95970e-eb03-4c45-b220-173a92269934 req-992691cc-0b1b-49d9-a48c-bf2955c6ce6a service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034692 Aug 24 11:40:47.646650 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 436/822] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Aug 24 11:40:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:40:48.068084 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-52b4d1bd-11c2-4576-9b34-d086d024f345 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:40:48.068885 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-52b4d1bd-11c2-4576-9b34-d086d024f345 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: 4b0af30d-b2e2-466a-bc9b-50ae86e6af28] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:40:48.076649 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-52b4d1bd-11c2-4576-9b34-d086d024f345 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:48.077189 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-52b4d1bd-11c2-4576-9b34-d086d024f345 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:48.077945 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-52b4d1bd-11c2-4576-9b34-d086d024f345 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:48.078706 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-52b4d1bd-11c2-4576-9b34-d086d024f345 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:48.080191 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-52b4d1bd-11c2-4576-9b34-d086d024f345 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:48.080738 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-52b4d1bd-11c2-4576-9b34-d086d024f345 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:48.161640 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-98e9e224-ac5d-4bae-aa44-46dd0a7a1e71 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:40:48.164736 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-98e9e224-ac5d-4bae-aa44-46dd0a7a1e71 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: a8ce5b7f-1b02-4746-9aa5-0d826615df18] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:40:48.168915 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG dbcounter [-] [124769] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=124769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:40:48.172776 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-98e9e224-ac5d-4bae-aa44-46dd0a7a1e71 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:48.173067 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-98e9e224-ac5d-4bae-aa44-46dd0a7a1e71 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:48.173504 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-98e9e224-ac5d-4bae-aa44-46dd0a7a1e71 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:48.174206 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-98e9e224-ac5d-4bae-aa44-46dd0a7a1e71 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:48.174662 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-98e9e224-ac5d-4bae-aa44-46dd0a7a1e71 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:48.175088 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-98e9e224-ac5d-4bae-aa44-46dd0a7a1e71 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:48.208549 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-98e9e224-ac5d-4bae-aa44-46dd0a7a1e71 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052870 Aug 24 11:40:48.209160 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 437/823] 10.222.0.84 () {58 vars in 1302 bytes} [Wed Aug 24 11:40:48 2022] GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:40:48.237026 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-52b4d1bd-11c2-4576-9b34-d086d024f345 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2715cf2a5129439c83a5347bb963f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4159dc366f41bc9e4057a079f6fb5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:48.245385 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-52b4d1bd-11c2-4576-9b34-d086d024f345 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "GET /compute/v2.1/servers/4b0af30d-b2e2-466a-bc9b-50ae86e6af28" status: 200 len: 1367 microversion: 2.1 time: 0.181881 Aug 24 11:40:48.245977 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 387/824] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:40:48 2022] GET /compute/v2.1/servers/4b0af30d-b2e2-466a-bc9b-50ae86e6af28 => generated 1367 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:40:48.337309 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-9aee39fb-1351-45f6-8551-287d34956e7b tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:40:48.338765 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-9aee39fb-1351-45f6-8551-287d34956e7b tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: bf04b523-cedf-4e68-b77f-f6039d0de59c] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:40:48.346080 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-9aee39fb-1351-45f6-8551-287d34956e7b tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:48.346597 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-9aee39fb-1351-45f6-8551-287d34956e7b tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:48.347025 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-9aee39fb-1351-45f6-8551-287d34956e7b tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:48.347726 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-9aee39fb-1351-45f6-8551-287d34956e7b tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:48.348172 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-9aee39fb-1351-45f6-8551-287d34956e7b tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:48.348589 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-9aee39fb-1351-45f6-8551-287d34956e7b tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:48.503466 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-9aee39fb-1351-45f6-8551-287d34956e7b tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:48.512976 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-9aee39fb-1351-45f6-8551-287d34956e7b tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:48.514468 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-9aee39fb-1351-45f6-8551-287d34956e7b tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:48.515584 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-9aee39fb-1351-45f6-8551-287d34956e7b tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c" status: 200 len: 1408 microversion: 2.20 time: 0.185373 Aug 24 11:40:48.516146 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 438/825] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:40:48 2022] GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c => generated 1408 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:40:49.223879 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-1152f99b-51cf-47ba-8bfb-9b2f0cd8605e tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:40:49.226116 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-1152f99b-51cf-47ba-8bfb-9b2f0cd8605e tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: a8ce5b7f-1b02-4746-9aa5-0d826615df18] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:40:49.233006 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1152f99b-51cf-47ba-8bfb-9b2f0cd8605e tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:49.233499 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1152f99b-51cf-47ba-8bfb-9b2f0cd8605e tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:49.233935 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1152f99b-51cf-47ba-8bfb-9b2f0cd8605e tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:49.234645 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1152f99b-51cf-47ba-8bfb-9b2f0cd8605e tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:49.235146 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1152f99b-51cf-47ba-8bfb-9b2f0cd8605e tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:49.236327 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1152f99b-51cf-47ba-8bfb-9b2f0cd8605e tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:49.267134 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-96a717df-ae6c-49e8-a87c-1aa6e7821540 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:40:49.267937 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-96a717df-ae6c-49e8-a87c-1aa6e7821540 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: 4b0af30d-b2e2-466a-bc9b-50ae86e6af28] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:40:49.269102 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-1152f99b-51cf-47ba-8bfb-9b2f0cd8605e tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051661 Aug 24 11:40:49.269874 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 388/826] 10.222.0.84 () {58 vars in 1302 bytes} [Wed Aug 24 11:40:49 2022] GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 24 11:40:49.275519 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-96a717df-ae6c-49e8-a87c-1aa6e7821540 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:49.276008 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-96a717df-ae6c-49e8-a87c-1aa6e7821540 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:49.276440 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-96a717df-ae6c-49e8-a87c-1aa6e7821540 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:49.277150 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-96a717df-ae6c-49e8-a87c-1aa6e7821540 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:49.277732 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-96a717df-ae6c-49e8-a87c-1aa6e7821540 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:49.278302 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-96a717df-ae6c-49e8-a87c-1aa6e7821540 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:49.282642 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG dbcounter [-] [124769] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:40:49.359176 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-fb592097-de83-444f-9341-bd8fbf7702de tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:40:49.359714 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-fb592097-de83-444f-9341-bd8fbf7702de tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: a8ce5b7f-1b02-4746-9aa5-0d826615df18] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:40:49.375445 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-fb592097-de83-444f-9341-bd8fbf7702de tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:49.376849 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-fb592097-de83-444f-9341-bd8fbf7702de tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:49.377326 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-fb592097-de83-444f-9341-bd8fbf7702de tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:49.378035 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-fb592097-de83-444f-9341-bd8fbf7702de tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:49.378553 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-fb592097-de83-444f-9341-bd8fbf7702de tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:49.378979 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-fb592097-de83-444f-9341-bd8fbf7702de tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:49.408863 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-fb592097-de83-444f-9341-bd8fbf7702de tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: a8ce5b7f-1b02-4746-9aa5-0d826615df18] Going to try to terminate instance {{(pid=124770) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 11:40:49.427272 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-96a717df-ae6c-49e8-a87c-1aa6e7821540 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2715cf2a5129439c83a5347bb963f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4159dc366f41bc9e4057a079f6fb5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:49.435413 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-96a717df-ae6c-49e8-a87c-1aa6e7821540 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "GET /compute/v2.1/servers/4b0af30d-b2e2-466a-bc9b-50ae86e6af28" status: 200 len: 1367 microversion: 2.1 time: 0.172653 Aug 24 11:40:49.439103 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 439/827] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:40:49 2022] GET /compute/v2.1/servers/4b0af30d-b2e2-466a-bc9b-50ae86e6af28 => generated 1367 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:40:49.539991 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-53a3bb5e-c511-465f-a7eb-d26338b8c8a0 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:40:49.540562 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-53a3bb5e-c511-465f-a7eb-d26338b8c8a0 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: bf04b523-cedf-4e68-b77f-f6039d0de59c] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:40:49.546443 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-53a3bb5e-c511-465f-a7eb-d26338b8c8a0 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:49.547313 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-53a3bb5e-c511-465f-a7eb-d26338b8c8a0 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:49.547313 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-53a3bb5e-c511-465f-a7eb-d26338b8c8a0 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:49.548605 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-53a3bb5e-c511-465f-a7eb-d26338b8c8a0 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:49.549087 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-53a3bb5e-c511-465f-a7eb-d26338b8c8a0 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:49.549501 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-53a3bb5e-c511-465f-a7eb-d26338b8c8a0 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:49.576869 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:40:49.693477 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-53a3bb5e-c511-465f-a7eb-d26338b8c8a0 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:49.702547 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-53a3bb5e-c511-465f-a7eb-d26338b8c8a0 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:49.704716 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-53a3bb5e-c511-465f-a7eb-d26338b8c8a0 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:49.708050 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-53a3bb5e-c511-465f-a7eb-d26338b8c8a0 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c" status: 200 len: 1408 microversion: 2.20 time: 0.170063 Aug 24 11:40:49.708050 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 440/828] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:40:49 2022] GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c => generated 1408 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:40:49.798382 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-fb592097-de83-444f-9341-bd8fbf7702de tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "DELETE /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18" status: 204 len: 0 microversion: 2.1 time: 0.440361 Aug 24 11:40:49.798382 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 389/829] 10.222.0.84 () {58 vars in 1239 bytes} [Wed Aug 24 11:40:49 2022] DELETE /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 11:40:49.806072 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-37757ffd-d114-48c3-a701-8330c0a848c2 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:40:49.806682 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-37757ffd-d114-48c3-a701-8330c0a848c2 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: a8ce5b7f-1b02-4746-9aa5-0d826615df18] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:40:49.812907 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-37757ffd-d114-48c3-a701-8330c0a848c2 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:49.813999 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-37757ffd-d114-48c3-a701-8330c0a848c2 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:49.814440 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-37757ffd-d114-48c3-a701-8330c0a848c2 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:49.815134 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-37757ffd-d114-48c3-a701-8330c0a848c2 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:49.815595 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-37757ffd-d114-48c3-a701-8330c0a848c2 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:49.816021 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-37757ffd-d114-48c3-a701-8330c0a848c2 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:49.982228 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-37757ffd-d114-48c3-a701-8330c0a848c2 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:49.995401 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-37757ffd-d114-48c3-a701-8330c0a848c2 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18" status: 200 len: 1689 microversion: 2.1 time: 0.193531 Aug 24 11:40:50.004540 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 441/830] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:40:49 2022] GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18 => generated 1689 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:40:50.067929 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [req-d90843ce-7ac0-4b46-99e1-5e068ae2bc24 req-08c40ca8-c9a9-47ed-b8ee-549d922691fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf04b523-cedf-4e68-b77f-f6039d0de59c", "name": "network-vif-plugged", "status": "completed", "tag": "c30f1b51-2afd-425d-956e-dbabf88edac3"}]} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:40:50.070767 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-d90843ce-7ac0-4b46-99e1-5e068ae2bc24 req-08c40ca8-c9a9-47ed-b8ee-549d922691fb service nova] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:50.071241 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-d90843ce-7ac0-4b46-99e1-5e068ae2bc24 req-08c40ca8-c9a9-47ed-b8ee-549d922691fb service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:50.071674 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-d90843ce-7ac0-4b46-99e1-5e068ae2bc24 req-08c40ca8-c9a9-47ed-b8ee-549d922691fb service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:50.084131 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.compute.server_external_events [req-d90843ce-7ac0-4b46-99e1-5e068ae2bc24 req-08c40ca8-c9a9-47ed-b8ee-549d922691fb service nova] Creating event network-vif-plugged:c30f1b51-2afd-425d-956e-dbabf88edac3 for instance bf04b523-cedf-4e68-b77f-f6039d0de59c on hv-cinder-85427 Aug 24 11:40:50.089320 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [req-d90843ce-7ac0-4b46-99e1-5e068ae2bc24 req-08c40ca8-c9a9-47ed-b8ee-549d922691fb service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035528 Aug 24 11:40:50.089942 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 390/831] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Aug 24 11:40:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:40:50.459607 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-1986c98e-0f53-443e-b08d-be433037d951 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:40:50.460159 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-1986c98e-0f53-443e-b08d-be433037d951 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: 4b0af30d-b2e2-466a-bc9b-50ae86e6af28] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:40:50.467679 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-1986c98e-0f53-443e-b08d-be433037d951 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:50.468202 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-1986c98e-0f53-443e-b08d-be433037d951 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:50.468649 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-1986c98e-0f53-443e-b08d-be433037d951 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:50.470014 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-1986c98e-0f53-443e-b08d-be433037d951 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:50.471242 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-1986c98e-0f53-443e-b08d-be433037d951 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:50.471677 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-1986c98e-0f53-443e-b08d-be433037d951 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:50.614738 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-1986c98e-0f53-443e-b08d-be433037d951 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2715cf2a5129439c83a5347bb963f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4159dc366f41bc9e4057a079f6fb5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:50.623863 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-1986c98e-0f53-443e-b08d-be433037d951 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "GET /compute/v2.1/servers/4b0af30d-b2e2-466a-bc9b-50ae86e6af28" status: 200 len: 1367 microversion: 2.1 time: 0.170395 Aug 24 11:40:50.624435 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 442/832] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:40:50 2022] GET /compute/v2.1/servers/4b0af30d-b2e2-466a-bc9b-50ae86e6af28 => generated 1367 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:40:50.729656 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-5097b147-dec8-4734-81db-1f996032744d tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:40:50.730265 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-5097b147-dec8-4734-81db-1f996032744d tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: bf04b523-cedf-4e68-b77f-f6039d0de59c] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:40:50.737610 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5097b147-dec8-4734-81db-1f996032744d tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:50.738097 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5097b147-dec8-4734-81db-1f996032744d tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:50.738534 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5097b147-dec8-4734-81db-1f996032744d tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:50.739251 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5097b147-dec8-4734-81db-1f996032744d tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:50.739691 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5097b147-dec8-4734-81db-1f996032744d tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:50.740149 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5097b147-dec8-4734-81db-1f996032744d tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:50.881399 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-5097b147-dec8-4734-81db-1f996032744d tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:50.890859 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-5097b147-dec8-4734-81db-1f996032744d tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:50.892659 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-5097b147-dec8-4734-81db-1f996032744d tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:50.893795 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-5097b147-dec8-4734-81db-1f996032744d tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c" status: 200 len: 1408 microversion: 2.20 time: 0.168545 Aug 24 11:40:50.894357 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 391/833] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:40:50 2022] GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c => generated 1408 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:40:51.019944 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-8f52424a-950d-4100-a100-181a9d2a05d0 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:40:51.020491 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-8f52424a-950d-4100-a100-181a9d2a05d0 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: a8ce5b7f-1b02-4746-9aa5-0d826615df18] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:40:51.026659 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-8f52424a-950d-4100-a100-181a9d2a05d0 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:51.027146 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-8f52424a-950d-4100-a100-181a9d2a05d0 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:51.027579 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-8f52424a-950d-4100-a100-181a9d2a05d0 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:51.028274 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-8f52424a-950d-4100-a100-181a9d2a05d0 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:51.028730 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-8f52424a-950d-4100-a100-181a9d2a05d0 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:51.029187 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-8f52424a-950d-4100-a100-181a9d2a05d0 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:51.171816 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-8f52424a-950d-4100-a100-181a9d2a05d0 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:51.181025 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-8f52424a-950d-4100-a100-181a9d2a05d0 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18" status: 200 len: 1689 microversion: 2.1 time: 0.164942 Aug 24 11:40:51.181695 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 443/834] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:40:51 2022] GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18 => generated 1689 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:40:51.645476 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-5aa83572-69a2-4c25-a775-707af8575bdc tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:40:51.646081 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-5aa83572-69a2-4c25-a775-707af8575bdc tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: 4b0af30d-b2e2-466a-bc9b-50ae86e6af28] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:40:51.653701 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5aa83572-69a2-4c25-a775-707af8575bdc tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:51.654189 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5aa83572-69a2-4c25-a775-707af8575bdc tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:51.654625 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5aa83572-69a2-4c25-a775-707af8575bdc tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:51.655503 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5aa83572-69a2-4c25-a775-707af8575bdc tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:51.655957 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5aa83572-69a2-4c25-a775-707af8575bdc tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:51.656377 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5aa83572-69a2-4c25-a775-707af8575bdc tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:51.798708 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-5aa83572-69a2-4c25-a775-707af8575bdc tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2715cf2a5129439c83a5347bb963f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4159dc366f41bc9e4057a079f6fb5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:51.806899 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-5aa83572-69a2-4c25-a775-707af8575bdc tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "GET /compute/v2.1/servers/4b0af30d-b2e2-466a-bc9b-50ae86e6af28" status: 200 len: 1367 microversion: 2.1 time: 0.165440 Aug 24 11:40:51.807556 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 392/835] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:40:51 2022] GET /compute/v2.1/servers/4b0af30d-b2e2-466a-bc9b-50ae86e6af28 => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:40:51.917297 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-c4dc8fe8-de92-4498-9030-472162dd7407 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:40:51.917905 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-c4dc8fe8-de92-4498-9030-472162dd7407 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: bf04b523-cedf-4e68-b77f-f6039d0de59c] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:40:51.925318 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-c4dc8fe8-de92-4498-9030-472162dd7407 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:51.925814 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-c4dc8fe8-de92-4498-9030-472162dd7407 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:51.926248 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-c4dc8fe8-de92-4498-9030-472162dd7407 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:51.926978 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-c4dc8fe8-de92-4498-9030-472162dd7407 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:51.927416 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-c4dc8fe8-de92-4498-9030-472162dd7407 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:51.928216 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-c4dc8fe8-de92-4498-9030-472162dd7407 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:52.078993 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-c4dc8fe8-de92-4498-9030-472162dd7407 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:52.091707 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-c4dc8fe8-de92-4498-9030-472162dd7407 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:52.094315 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-c4dc8fe8-de92-4498-9030-472162dd7407 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:52.095698 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-c4dc8fe8-de92-4498-9030-472162dd7407 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c" status: 200 len: 1408 microversion: 2.20 time: 0.182587 Aug 24 11:40:52.096262 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 444/836] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:40:51 2022] GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c => generated 1408 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 11:40:52.204044 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-9e922c38-19f8-4899-8f4d-af433ce9c5b2 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:40:52.204776 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-9e922c38-19f8-4899-8f4d-af433ce9c5b2 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: a8ce5b7f-1b02-4746-9aa5-0d826615df18] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:40:52.211443 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9e922c38-19f8-4899-8f4d-af433ce9c5b2 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:52.211934 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9e922c38-19f8-4899-8f4d-af433ce9c5b2 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:52.212372 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9e922c38-19f8-4899-8f4d-af433ce9c5b2 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:52.213189 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9e922c38-19f8-4899-8f4d-af433ce9c5b2 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:52.213647 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9e922c38-19f8-4899-8f4d-af433ce9c5b2 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:52.214072 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9e922c38-19f8-4899-8f4d-af433ce9c5b2 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:52.363777 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-9e922c38-19f8-4899-8f4d-af433ce9c5b2 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:52.380225 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-9e922c38-19f8-4899-8f4d-af433ce9c5b2 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18" status: 200 len: 1689 microversion: 2.1 time: 0.179879 Aug 24 11:40:52.381224 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 393/837] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:40:52 2022] GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18 => generated 1689 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:40:52.829030 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-2ea70b5c-db16-4ea9-a824-d4e15b46dc59 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:40:52.833994 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-2ea70b5c-db16-4ea9-a824-d4e15b46dc59 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: 4b0af30d-b2e2-466a-bc9b-50ae86e6af28] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:40:52.835775 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-2ea70b5c-db16-4ea9-a824-d4e15b46dc59 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:52.836251 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-2ea70b5c-db16-4ea9-a824-d4e15b46dc59 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:52.836684 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-2ea70b5c-db16-4ea9-a824-d4e15b46dc59 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:52.837403 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-2ea70b5c-db16-4ea9-a824-d4e15b46dc59 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:52.837854 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-2ea70b5c-db16-4ea9-a824-d4e15b46dc59 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:52.838339 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-2ea70b5c-db16-4ea9-a824-d4e15b46dc59 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:52.973780 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-2ea70b5c-db16-4ea9-a824-d4e15b46dc59 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2715cf2a5129439c83a5347bb963f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4159dc366f41bc9e4057a079f6fb5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:52.981705 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-2ea70b5c-db16-4ea9-a824-d4e15b46dc59 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "GET /compute/v2.1/servers/4b0af30d-b2e2-466a-bc9b-50ae86e6af28" status: 200 len: 1557 microversion: 2.1 time: 0.156816 Aug 24 11:40:52.982287 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 445/838] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:40:52 2022] GET /compute/v2.1/servers/4b0af30d-b2e2-466a-bc9b-50ae86e6af28 => generated 1557 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:40:53.003935 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-1cdca09b-d9a3-4102-9233-45c2c25eed40 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:40:53.004504 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-1cdca09b-d9a3-4102-9233-45c2c25eed40 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: 4b0af30d-b2e2-466a-bc9b-50ae86e6af28] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:40:53.011011 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1cdca09b-d9a3-4102-9233-45c2c25eed40 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:53.011500 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1cdca09b-d9a3-4102-9233-45c2c25eed40 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:53.011937 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1cdca09b-d9a3-4102-9233-45c2c25eed40 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:53.012640 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1cdca09b-d9a3-4102-9233-45c2c25eed40 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:53.013870 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1cdca09b-d9a3-4102-9233-45c2c25eed40 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:53.015524 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1cdca09b-d9a3-4102-9233-45c2c25eed40 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:53.103025 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-1cdca09b-d9a3-4102-9233-45c2c25eed40 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "GET /compute/v2.1/servers/4b0af30d-b2e2-466a-bc9b-50ae86e6af28/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.103773 Aug 24 11:40:53.103657 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 394/839] 10.222.0.84 () {58 vars in 1275 bytes} [Wed Aug 24 11:40:52 2022] GET /compute/v2.1/servers/4b0af30d-b2e2-466a-bc9b-50ae86e6af28/os-interface => generated 284 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:40:53.120710 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-583936db-3aa3-419c-a217-f0298e71e4a7 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:40:53.121391 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-583936db-3aa3-419c-a217-f0298e71e4a7 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: bf04b523-cedf-4e68-b77f-f6039d0de59c] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:40:53.130068 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-583936db-3aa3-419c-a217-f0298e71e4a7 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:53.130565 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-583936db-3aa3-419c-a217-f0298e71e4a7 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:53.131009 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-583936db-3aa3-419c-a217-f0298e71e4a7 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:53.131713 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-583936db-3aa3-419c-a217-f0298e71e4a7 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:53.132180 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-583936db-3aa3-419c-a217-f0298e71e4a7 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:53.132615 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-583936db-3aa3-419c-a217-f0298e71e4a7 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:53.315750 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-583936db-3aa3-419c-a217-f0298e71e4a7 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:53.324926 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-583936db-3aa3-419c-a217-f0298e71e4a7 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:53.327146 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-583936db-3aa3-419c-a217-f0298e71e4a7 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:53.328372 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-583936db-3aa3-419c-a217-f0298e71e4a7 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c" status: 200 len: 1408 microversion: 2.20 time: 0.213880 Aug 24 11:40:53.328953 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 446/840] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:40:53 2022] GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c => generated 1408 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:40:53.404929 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-417c496b-d04a-4662-a8ae-db4303964caa tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:40:53.406198 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-417c496b-d04a-4662-a8ae-db4303964caa tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: a8ce5b7f-1b02-4746-9aa5-0d826615df18] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:40:53.415307 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-417c496b-d04a-4662-a8ae-db4303964caa tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:53.415892 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-417c496b-d04a-4662-a8ae-db4303964caa tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:53.416342 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-417c496b-d04a-4662-a8ae-db4303964caa tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:53.417083 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-417c496b-d04a-4662-a8ae-db4303964caa tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:53.417551 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-417c496b-d04a-4662-a8ae-db4303964caa tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:53.418210 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-417c496b-d04a-4662-a8ae-db4303964caa tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:54.184819 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-417c496b-d04a-4662-a8ae-db4303964caa tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:54.193183 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-417c496b-d04a-4662-a8ae-db4303964caa tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18" status: 200 len: 1689 microversion: 2.1 time: 0.793771 Aug 24 11:40:54.193768 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 395/841] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:40:53 2022] GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18 => generated 1689 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:40:54.353928 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-b3ca4266-c2da-40ba-b346-5c5b698fcc37 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:40:54.354548 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-b3ca4266-c2da-40ba-b346-5c5b698fcc37 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: bf04b523-cedf-4e68-b77f-f6039d0de59c] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:40:54.361872 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-b3ca4266-c2da-40ba-b346-5c5b698fcc37 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:54.362382 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-b3ca4266-c2da-40ba-b346-5c5b698fcc37 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:54.362810 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-b3ca4266-c2da-40ba-b346-5c5b698fcc37 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:54.363633 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-b3ca4266-c2da-40ba-b346-5c5b698fcc37 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:54.364104 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-b3ca4266-c2da-40ba-b346-5c5b698fcc37 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:54.364535 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-b3ca4266-c2da-40ba-b346-5c5b698fcc37 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:54.507690 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-b3ca4266-c2da-40ba-b346-5c5b698fcc37 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:54.517309 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-b3ca4266-c2da-40ba-b346-5c5b698fcc37 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:54.519690 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-b3ca4266-c2da-40ba-b346-5c5b698fcc37 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:54.519987 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-b3ca4266-c2da-40ba-b346-5c5b698fcc37 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c" status: 200 len: 1408 microversion: 2.20 time: 0.170458 Aug 24 11:40:54.532824 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 447/842] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:40:54 2022] GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c => generated 1408 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:40:55.207223 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [req-9f611b51-bfaa-42f5-b2dd-1c2baf0441fb req-da548362-a28c-4ed5-82b7-1f72e69589f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b0af30d-b2e2-466a-bc9b-50ae86e6af28", "tag": "78105eb8-f7d5-4afd-812f-3c338f397c22"}]} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:40:55.217165 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-3103c5a0-89b9-41d2-a36d-65995757d8df tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:40:55.217792 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-3103c5a0-89b9-41d2-a36d-65995757d8df tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: a8ce5b7f-1b02-4746-9aa5-0d826615df18] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:40:55.231494 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-9f611b51-bfaa-42f5-b2dd-1c2baf0441fb req-da548362-a28c-4ed5-82b7-1f72e69589f5 service nova] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:55.232644 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-3103c5a0-89b9-41d2-a36d-65995757d8df tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:55.233311 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-3103c5a0-89b9-41d2-a36d-65995757d8df tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:55.233790 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-3103c5a0-89b9-41d2-a36d-65995757d8df tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:55.234185 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-9f611b51-bfaa-42f5-b2dd-1c2baf0441fb req-da548362-a28c-4ed5-82b7-1f72e69589f5 service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:55.234649 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-3103c5a0-89b9-41d2-a36d-65995757d8df tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:55.235172 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-9f611b51-bfaa-42f5-b2dd-1c2baf0441fb req-da548362-a28c-4ed5-82b7-1f72e69589f5 service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:55.235758 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-3103c5a0-89b9-41d2-a36d-65995757d8df tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:55.236198 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-3103c5a0-89b9-41d2-a36d-65995757d8df tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:55.254325 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.compute.server_external_events [req-9f611b51-bfaa-42f5-b2dd-1c2baf0441fb req-da548362-a28c-4ed5-82b7-1f72e69589f5 service nova] Creating event network-changed:78105eb8-f7d5-4afd-812f-3c338f397c22 for instance 4b0af30d-b2e2-466a-bc9b-50ae86e6af28 on hv-cinder-85427 Aug 24 11:40:55.261467 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [req-9f611b51-bfaa-42f5-b2dd-1c2baf0441fb req-da548362-a28c-4ed5-82b7-1f72e69589f5 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059274 Aug 24 11:40:55.263155 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 396/843] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Aug 24 11:40:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:40:55.317192 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-3103c5a0-89b9-41d2-a36d-65995757d8df tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:55.327830 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-3103c5a0-89b9-41d2-a36d-65995757d8df tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18" status: 200 len: 1621 microversion: 2.1 time: 0.114982 Aug 24 11:40:55.329402 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 448/844] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:40:55 2022] GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18 => generated 1621 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:40:55.545330 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-58a3fb68-634a-4e25-b680-3a8dc57e69a1 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:40:55.546295 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-58a3fb68-634a-4e25-b680-3a8dc57e69a1 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: bf04b523-cedf-4e68-b77f-f6039d0de59c] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:40:55.554824 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-58a3fb68-634a-4e25-b680-3a8dc57e69a1 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:55.555533 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-58a3fb68-634a-4e25-b680-3a8dc57e69a1 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:55.556153 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-58a3fb68-634a-4e25-b680-3a8dc57e69a1 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:55.557868 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-58a3fb68-634a-4e25-b680-3a8dc57e69a1 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:55.560012 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-58a3fb68-634a-4e25-b680-3a8dc57e69a1 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:55.561263 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-58a3fb68-634a-4e25-b680-3a8dc57e69a1 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:55.845972 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-58a3fb68-634a-4e25-b680-3a8dc57e69a1 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:55.856016 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-58a3fb68-634a-4e25-b680-3a8dc57e69a1 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:55.857929 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-58a3fb68-634a-4e25-b680-3a8dc57e69a1 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:55.859360 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-58a3fb68-634a-4e25-b680-3a8dc57e69a1 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c" status: 200 len: 1408 microversion: 2.20 time: 0.318850 Aug 24 11:40:55.860969 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 397/845] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:40:55 2022] GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c => generated 1408 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:40:56.350453 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-db5cd778-8eb7-4a0a-b29a-7da2233e8177 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:40:56.351793 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-db5cd778-8eb7-4a0a-b29a-7da2233e8177 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: a8ce5b7f-1b02-4746-9aa5-0d826615df18] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:40:56.359517 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-db5cd778-8eb7-4a0a-b29a-7da2233e8177 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:56.360635 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-db5cd778-8eb7-4a0a-b29a-7da2233e8177 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:56.361307 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-db5cd778-8eb7-4a0a-b29a-7da2233e8177 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:56.362061 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-db5cd778-8eb7-4a0a-b29a-7da2233e8177 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:56.362517 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-db5cd778-8eb7-4a0a-b29a-7da2233e8177 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:56.362944 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-db5cd778-8eb7-4a0a-b29a-7da2233e8177 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:56.411410 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-db5cd778-8eb7-4a0a-b29a-7da2233e8177 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:56.411910 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-db5cd778-8eb7-4a0a-b29a-7da2233e8177 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:56.412356 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-db5cd778-8eb7-4a0a-b29a-7da2233e8177 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:56.412859 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.objects.instance [None req-db5cd778-8eb7-4a0a-b29a-7da2233e8177 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lazy-loading 'fault' on Instance uuid a8ce5b7f-1b02-4746-9aa5-0d826615df18 {{(pid=124769) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:40:56.462514 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-db5cd778-8eb7-4a0a-b29a-7da2233e8177 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:56.472057 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-db5cd778-8eb7-4a0a-b29a-7da2233e8177 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18" status: 200 len: 1335 microversion: 2.1 time: 0.126022 Aug 24 11:40:56.472653 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 449/846] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:40:56 2022] GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18 => generated 1335 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:40:56.884445 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-21e2af92-f96d-45a3-9656-24553e4824a1 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:40:56.885771 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-21e2af92-f96d-45a3-9656-24553e4824a1 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: bf04b523-cedf-4e68-b77f-f6039d0de59c] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:40:56.893729 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-21e2af92-f96d-45a3-9656-24553e4824a1 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:56.894190 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-21e2af92-f96d-45a3-9656-24553e4824a1 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:56.894625 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-21e2af92-f96d-45a3-9656-24553e4824a1 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:56.895324 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-21e2af92-f96d-45a3-9656-24553e4824a1 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:56.895771 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-21e2af92-f96d-45a3-9656-24553e4824a1 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:56.896265 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-21e2af92-f96d-45a3-9656-24553e4824a1 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:57.049867 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-21e2af92-f96d-45a3-9656-24553e4824a1 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:57.059770 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-21e2af92-f96d-45a3-9656-24553e4824a1 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:57.061430 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-21e2af92-f96d-45a3-9656-24553e4824a1 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:57.062739 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-21e2af92-f96d-45a3-9656-24553e4824a1 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c" status: 200 len: 1601 microversion: 2.20 time: 0.182375 Aug 24 11:40:57.063995 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 398/847] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:40:56 2022] GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c => generated 1601 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:40:57.089612 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-a832b2ea-c0c8-41d5-8bda-c4f230c8b74c tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:40:57.090309 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-a832b2ea-c0c8-41d5-8bda-c4f230c8b74c tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: bf04b523-cedf-4e68-b77f-f6039d0de59c] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:40:57.097532 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-a832b2ea-c0c8-41d5-8bda-c4f230c8b74c tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:57.098020 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-a832b2ea-c0c8-41d5-8bda-c4f230c8b74c tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:57.098455 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-a832b2ea-c0c8-41d5-8bda-c4f230c8b74c tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:57.099160 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-a832b2ea-c0c8-41d5-8bda-c4f230c8b74c tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:57.099697 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-a832b2ea-c0c8-41d5-8bda-c4f230c8b74c tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:57.100828 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-a832b2ea-c0c8-41d5-8bda-c4f230c8b74c tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:57.222667 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-a832b2ea-c0c8-41d5-8bda-c4f230c8b74c tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.137061 Aug 24 11:40:57.223389 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 450/848] 10.222.0.84 () {60 vars in 1316 bytes} [Wed Aug 24 11:40:57 2022] GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c/os-interface => generated 285 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 11:40:57.294352 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [req-1165bc86-8517-44ae-b5df-10658b7eef54 req-89634375-fa80-48bc-ad42-4b7b22589ab3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8ce5b7f-1b02-4746-9aa5-0d826615df18", "name": "network-vif-deleted", "tag": "808cd754-982d-460a-8dbd-1ce9354861d7"}]} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:40:57.305631 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-1165bc86-8517-44ae-b5df-10658b7eef54 req-89634375-fa80-48bc-ad42-4b7b22589ab3 service nova] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:57.306206 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-1165bc86-8517-44ae-b5df-10658b7eef54 req-89634375-fa80-48bc-ad42-4b7b22589ab3 service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:57.306734 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-1165bc86-8517-44ae-b5df-10658b7eef54 req-89634375-fa80-48bc-ad42-4b7b22589ab3 service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:57.327811 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.compute.server_external_events [req-1165bc86-8517-44ae-b5df-10658b7eef54 req-89634375-fa80-48bc-ad42-4b7b22589ab3 service nova] Creating event network-vif-deleted:808cd754-982d-460a-8dbd-1ce9354861d7 for instance a8ce5b7f-1b02-4746-9aa5-0d826615df18 on hv-cinder-85427 Aug 24 11:40:57.335417 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [req-1165bc86-8517-44ae-b5df-10658b7eef54 req-89634375-fa80-48bc-ad42-4b7b22589ab3 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044342 Aug 24 11:40:57.336376 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 399/849] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Aug 24 11:40:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:40:57.498965 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-be1696af-66e5-4de9-9d51-70b7e7444363 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:40:57.513824 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-be1696af-66e5-4de9-9d51-70b7e7444363 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: a8ce5b7f-1b02-4746-9aa5-0d826615df18] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:40:57.513824 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-be1696af-66e5-4de9-9d51-70b7e7444363 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:57.513824 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-be1696af-66e5-4de9-9d51-70b7e7444363 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:57.513824 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-be1696af-66e5-4de9-9d51-70b7e7444363 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:57.514875 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-be1696af-66e5-4de9-9d51-70b7e7444363 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:57.515046 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-be1696af-66e5-4de9-9d51-70b7e7444363 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:57.515628 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-be1696af-66e5-4de9-9d51-70b7e7444363 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:57.561302 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-be1696af-66e5-4de9-9d51-70b7e7444363 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:57.561786 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-be1696af-66e5-4de9-9d51-70b7e7444363 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:57.562223 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-be1696af-66e5-4de9-9d51-70b7e7444363 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:57.562681 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.objects.instance [None req-be1696af-66e5-4de9-9d51-70b7e7444363 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lazy-loading 'fault' on Instance uuid a8ce5b7f-1b02-4746-9aa5-0d826615df18 {{(pid=124769) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:40:57.619459 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-be1696af-66e5-4de9-9d51-70b7e7444363 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:57.634943 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-be1696af-66e5-4de9-9d51-70b7e7444363 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18" status: 200 len: 1335 microversion: 2.1 time: 0.140248 Aug 24 11:40:57.636135 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 451/850] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:40:57 2022] GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18 => generated 1335 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:40:58.481271 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [req-b09e5cff-5eb0-4677-9a85-f564004d911b req-80f76c7c-c18a-40e2-92b1-fef44f61fb5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf04b523-cedf-4e68-b77f-f6039d0de59c", "tag": "c30f1b51-2afd-425d-956e-dbabf88edac3"}]} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:40:58.494206 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-b09e5cff-5eb0-4677-9a85-f564004d911b req-80f76c7c-c18a-40e2-92b1-fef44f61fb5c service nova] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:58.494825 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-b09e5cff-5eb0-4677-9a85-f564004d911b req-80f76c7c-c18a-40e2-92b1-fef44f61fb5c service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:58.506265 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-b09e5cff-5eb0-4677-9a85-f564004d911b req-80f76c7c-c18a-40e2-92b1-fef44f61fb5c service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:58.508333 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.compute.server_external_events [req-b09e5cff-5eb0-4677-9a85-f564004d911b req-80f76c7c-c18a-40e2-92b1-fef44f61fb5c service nova] Creating event network-changed:c30f1b51-2afd-425d-956e-dbabf88edac3 for instance bf04b523-cedf-4e68-b77f-f6039d0de59c on hv-cinder-85427 Aug 24 11:40:58.515532 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [req-b09e5cff-5eb0-4677-9a85-f564004d911b req-80f76c7c-c18a-40e2-92b1-fef44f61fb5c service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039224 Aug 24 11:40:58.517481 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 400/851] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Aug 24 11:40:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:40:58.664163 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-4d819f21-68df-4828-8b03-fa8d30d284aa tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:40:58.665042 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-4d819f21-68df-4828-8b03-fa8d30d284aa tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: a8ce5b7f-1b02-4746-9aa5-0d826615df18] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:40:58.672113 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-4d819f21-68df-4828-8b03-fa8d30d284aa tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:58.673025 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-4d819f21-68df-4828-8b03-fa8d30d284aa tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:58.673687 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-4d819f21-68df-4828-8b03-fa8d30d284aa tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:58.674719 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-4d819f21-68df-4828-8b03-fa8d30d284aa tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:58.675369 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-4d819f21-68df-4828-8b03-fa8d30d284aa tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:58.675866 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-4d819f21-68df-4828-8b03-fa8d30d284aa tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:58.690446 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.wsgi [None req-4d819f21-68df-4828-8b03-fa8d30d284aa tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] HTTP exception thrown: Instance a8ce5b7f-1b02-4746-9aa5-0d826615df18 could not be found. Aug 24 11:40:58.692216 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-4d819f21-68df-4828-8b03-fa8d30d284aa tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Request method failure captured: Aug 24 11:40:58.692216 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: request: GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18 HTTP/1.1 Aug 24 11:40:58.692216 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Accept: application/json Aug 24 11:40:58.692216 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Accept-Encoding: identity Aug 24 11:40:58.692216 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Connection: close Aug 24 11:40:58.692216 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Content-Length: 0 Aug 24 11:40:58.692216 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Content-Type: application/json Aug 24 11:40:58.692216 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Host: 10.222.0.84 Aug 24 11:40:58.692216 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Openstack-System-Scope: None Aug 24 11:40:58.692216 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: User-Agent: python-urllib3/1.26.11 Aug 24 11:40:58.692216 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Auth-Token: gAAAAABjBgwcqa0CYUPhW6H0Ka_8PQo6WuRnVZxjJiGxVsP8OjBajZzTfRi-wT8euSPFOEzkWOlYPU2oyt3p2sSsquSlSFvb_OOqjFi6GL1r-duvQ_e_lEwQ5SQEw1PDuzr4YOYFBd4Fp8LuJKTid5FAIFqTau26udI57bZEjikHTi6akUiQBpI Aug 24 11:40:58.692216 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Domain-Id: None Aug 24 11:40:58.692216 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Domain-Name: None Aug 24 11:40:58.692216 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Identity-Status: Confirmed Aug 24 11:40:58.692216 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Is-Admin-Project: True Aug 24 11:40:58.692216 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Project-Domain-Id: default Aug 24 11:40:58.692216 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Project-Domain-Name: Default Aug 24 11:40:58.692216 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Project-Id: 048c7f026f304084960d77bf46f367d8 Aug 24 11:40:58.692216 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-309471798 Aug 24 11:40:58.692216 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Role: reader,member Aug 24 11:40:58.692216 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Roles: reader,member Aug 24 11:40:58.694086 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/volume/v3/048c7f026f304084960d77bf46f367d8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/volume/v3/048c7f026f304084960d77bf46f367d8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/compute/v2/048c7f026f304084960d77bf46f367d8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84:8080/v1/AUTH_048c7f026f304084960d77bf46f367d8", "adminURL": "http://10.222.0.84:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/placement"}]}] Aug 24 11:40:58.694086 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Tenant: tempest-ServerRescueNegativeTestJSON-309471798 Aug 24 11:40:58.694086 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Tenant-Id: 048c7f026f304084960d77bf46f367d8 Aug 24 11:40:58.694086 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-309471798 Aug 24 11:40:58.694086 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-User: tempest-ServerRescueNegativeTestJSON-309471798-project Aug 24 11:40:58.694086 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-User-Domain-Id: default Aug 24 11:40:58.694086 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-User-Domain-Name: Default Aug 24 11:40:58.694086 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-User-Id: 2d5bfffc316f481183093e386a326946 Aug 24 11:40:58.694086 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-User-Name: tempest-ServerRescueNegativeTestJSON-309471798-project Aug 24 11:40:58.694086 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: method: > Aug 24 11:40:58.694086 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: exception: Instance a8ce5b7f-1b02-4746-9aa5-0d826615df18 could not be found. Aug 24 11:40:58.694086 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: action_args: {'id': 'a8ce5b7f-1b02-4746-9aa5-0d826615df18'} Aug 24 11:40:58.695036 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:40:58.695036 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:40:58.695036 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:40:58.695036 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:40:58.695036 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:40:58.695036 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:40:58.695036 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:40:58.695036 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:40:58.695036 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:40:58.695036 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:40:58.695036 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8ce5b7f-1b02-4746-9aa5-0d826615df18 could not be found. Aug 24 11:40:58.695036 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Aug 24 11:40:58.695036 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:40:58.695036 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Aug 24 11:40:58.695036 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:40:58.695036 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:40:58.695036 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:40:58.695036 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:40:58.695036 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:40:58.695036 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:40:58.699378 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:40:58.699378 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:40:58.699378 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:40:58.699378 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:40:58.699378 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:40:58.699378 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:40:58.699378 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:40:58.699378 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8ce5b7f-1b02-4746-9aa5-0d826615df18 could not be found. Aug 24 11:40:58.699378 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Aug 24 11:40:58.699378 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:40:58.699378 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Aug 24 11:40:58.699378 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:40:58.699378 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:40:58.699378 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:40:58.699378 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:40:58.699378 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:40:58.699378 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8ce5b7f-1b02-4746-9aa5-0d826615df18 could not be found. Aug 24 11:40:58.699378 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Aug 24 11:40:58.700510 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-4d819f21-68df-4828-8b03-fa8d30d284aa tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Returning 404 to user: Instance a8ce5b7f-1b02-4746-9aa5-0d826615df18 could not be found. {{(pid=124769) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:40:58.700510 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-4d819f21-68df-4828-8b03-fa8d30d284aa tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18" status: 404 len: 111 microversion: 2.1 time: 0.034328 Aug 24 11:40:58.700510 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 452/852] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:40:58 2022] GET /compute/v2.1/servers/a8ce5b7f-1b02-4746-9aa5-0d826615df18 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:40:58.706608 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-c519e538-71f5-489c-b19b-9afbb0cc46be tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '.version_select at 0x7f0e2a4883a0>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:40:58.853416 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-c519e538-71f5-489c-b19b-9afbb0cc46be tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-816624209" status: 202 len: 0 microversion: 2.1 time: 0.152105 Aug 24 11:40:58.858035 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 401/853] 10.222.0.84 () {58 vars in 1218 bytes} [Wed Aug 24 11:40:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-816624209 => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:41:02.365244 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-391a0e37-d7de-46a5-a2ea-546d9e01cb57 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:41:02.365788 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-391a0e37-d7de-46a5-a2ea-546d9e01cb57 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: 2d4527c9-c18c-4028-a452-d23423d9c4ee] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:41:02.372538 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-391a0e37-d7de-46a5-a2ea-546d9e01cb57 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:02.373046 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-391a0e37-d7de-46a5-a2ea-546d9e01cb57 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:02.373488 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-391a0e37-d7de-46a5-a2ea-546d9e01cb57 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:02.374172 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-391a0e37-d7de-46a5-a2ea-546d9e01cb57 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:02.374627 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-391a0e37-d7de-46a5-a2ea-546d9e01cb57 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:02.375693 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-391a0e37-d7de-46a5-a2ea-546d9e01cb57 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:02.401940 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-391a0e37-d7de-46a5-a2ea-546d9e01cb57 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: 2d4527c9-c18c-4028-a452-d23423d9c4ee] Going to try to terminate instance {{(pid=124769) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 11:41:02.778536 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-391a0e37-d7de-46a5-a2ea-546d9e01cb57 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "DELETE /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee" status: 204 len: 0 microversion: 2.1 time: 0.416566 Aug 24 11:41:02.779211 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 453/854] 10.222.0.84 () {58 vars in 1239 bytes} [Wed Aug 24 11:41:02 2022] DELETE /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee => generated 0 bytes in 419 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 11:41:02.788269 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-9df1cffd-0478-4499-9d99-c9bc4404617a tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:41:02.789162 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-9df1cffd-0478-4499-9d99-c9bc4404617a tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: 2d4527c9-c18c-4028-a452-d23423d9c4ee] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:41:02.796281 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9df1cffd-0478-4499-9d99-c9bc4404617a tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:02.796767 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9df1cffd-0478-4499-9d99-c9bc4404617a tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:02.797621 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9df1cffd-0478-4499-9d99-c9bc4404617a tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:02.798484 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9df1cffd-0478-4499-9d99-c9bc4404617a tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:02.798939 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9df1cffd-0478-4499-9d99-c9bc4404617a tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:02.799370 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9df1cffd-0478-4499-9d99-c9bc4404617a tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:02.957461 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-9df1cffd-0478-4499-9d99-c9bc4404617a tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:41:02.965827 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-9df1cffd-0478-4499-9d99-c9bc4404617a tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee" status: 200 len: 1507 microversion: 2.1 time: 0.181980 Aug 24 11:41:02.966408 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 402/855] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:41:02 2022] GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee => generated 1507 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:41:03.989301 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-199a2228-5ca8-43a2-b5bb-2701f8c8339b tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:41:03.990096 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-199a2228-5ca8-43a2-b5bb-2701f8c8339b tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: 2d4527c9-c18c-4028-a452-d23423d9c4ee] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:41:03.997712 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-199a2228-5ca8-43a2-b5bb-2701f8c8339b tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:03.998197 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-199a2228-5ca8-43a2-b5bb-2701f8c8339b tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:03.998777 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-199a2228-5ca8-43a2-b5bb-2701f8c8339b tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:03.999476 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-199a2228-5ca8-43a2-b5bb-2701f8c8339b tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:03.999938 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-199a2228-5ca8-43a2-b5bb-2701f8c8339b tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:04.000358 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-199a2228-5ca8-43a2-b5bb-2701f8c8339b tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:04.022768 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG dbcounter [-] [124769] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:41:04.157153 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-199a2228-5ca8-43a2-b5bb-2701f8c8339b tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:41:04.166575 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-199a2228-5ca8-43a2-b5bb-2701f8c8339b tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee" status: 200 len: 1507 microversion: 2.1 time: 0.182188 Aug 24 11:41:04.167154 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 454/856] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:41:03 2022] GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee => generated 1507 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:41:04.733402 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [req-e6004a39-ed03-425f-afea-6c52140728a1 req-65191de6-19df-4bb6-9ee0-d50080b3def1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d4527c9-c18c-4028-a452-d23423d9c4ee", "name": "network-vif-deleted", "tag": "e12ef962-191c-4cfc-8320-f430d725d0bb"}]} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:41:04.743966 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-e6004a39-ed03-425f-afea-6c52140728a1 req-65191de6-19df-4bb6-9ee0-d50080b3def1 service nova] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:04.744509 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-e6004a39-ed03-425f-afea-6c52140728a1 req-65191de6-19df-4bb6-9ee0-d50080b3def1 service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:04.744893 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-e6004a39-ed03-425f-afea-6c52140728a1 req-65191de6-19df-4bb6-9ee0-d50080b3def1 service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:04.758194 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.compute.server_external_events [req-e6004a39-ed03-425f-afea-6c52140728a1 req-65191de6-19df-4bb6-9ee0-d50080b3def1 service nova] Creating event network-vif-deleted:e12ef962-191c-4cfc-8320-f430d725d0bb for instance 2d4527c9-c18c-4028-a452-d23423d9c4ee on hv-cinder-85427 Aug 24 11:41:04.763416 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [req-e6004a39-ed03-425f-afea-6c52140728a1 req-65191de6-19df-4bb6-9ee0-d50080b3def1 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036302 Aug 24 11:41:04.764053 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 403/857] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Aug 24 11:41:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:41:05.191342 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-b06ddddf-16ab-47ef-9d73-108d27d4fbea tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:41:05.191938 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-b06ddddf-16ab-47ef-9d73-108d27d4fbea tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: 2d4527c9-c18c-4028-a452-d23423d9c4ee] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:41:05.199228 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-b06ddddf-16ab-47ef-9d73-108d27d4fbea tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:05.207385 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-b06ddddf-16ab-47ef-9d73-108d27d4fbea tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:05.207385 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-b06ddddf-16ab-47ef-9d73-108d27d4fbea tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:05.207385 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-b06ddddf-16ab-47ef-9d73-108d27d4fbea tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:05.207385 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-b06ddddf-16ab-47ef-9d73-108d27d4fbea tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:05.207825 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-b06ddddf-16ab-47ef-9d73-108d27d4fbea tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:05.237337 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-b06ddddf-16ab-47ef-9d73-108d27d4fbea tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:05.237819 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-b06ddddf-16ab-47ef-9d73-108d27d4fbea tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:05.238252 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-b06ddddf-16ab-47ef-9d73-108d27d4fbea tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:05.238696 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.objects.instance [None req-b06ddddf-16ab-47ef-9d73-108d27d4fbea tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lazy-loading 'fault' on Instance uuid 2d4527c9-c18c-4028-a452-d23423d9c4ee {{(pid=124769) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:41:05.288548 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-b06ddddf-16ab-47ef-9d73-108d27d4fbea tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:41:05.297751 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-b06ddddf-16ab-47ef-9d73-108d27d4fbea tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee" status: 200 len: 1312 microversion: 2.1 time: 0.112768 Aug 24 11:41:05.298331 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 455/858] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:41:05 2022] GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee => generated 1312 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:41:06.323989 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-5ab3aac4-e758-4d62-9e1c-3897a951a6f0 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:41:06.324673 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-5ab3aac4-e758-4d62-9e1c-3897a951a6f0 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: 2d4527c9-c18c-4028-a452-d23423d9c4ee] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:41:06.332237 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5ab3aac4-e758-4d62-9e1c-3897a951a6f0 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:06.332720 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5ab3aac4-e758-4d62-9e1c-3897a951a6f0 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:06.333190 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5ab3aac4-e758-4d62-9e1c-3897a951a6f0 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:06.333883 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5ab3aac4-e758-4d62-9e1c-3897a951a6f0 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:06.334359 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5ab3aac4-e758-4d62-9e1c-3897a951a6f0 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:06.334781 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5ab3aac4-e758-4d62-9e1c-3897a951a6f0 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:06.349340 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.wsgi [None req-5ab3aac4-e758-4d62-9e1c-3897a951a6f0 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] HTTP exception thrown: Instance 2d4527c9-c18c-4028-a452-d23423d9c4ee could not be found. Aug 24 11:41:06.350983 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-5ab3aac4-e758-4d62-9e1c-3897a951a6f0 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Request method failure captured: Aug 24 11:41:06.350983 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: request: GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee HTTP/1.1 Aug 24 11:41:06.350983 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Accept: application/json Aug 24 11:41:06.350983 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Accept-Encoding: identity Aug 24 11:41:06.350983 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Connection: close Aug 24 11:41:06.350983 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Content-Length: 0 Aug 24 11:41:06.350983 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Content-Type: application/json Aug 24 11:41:06.350983 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Host: 10.222.0.84 Aug 24 11:41:06.350983 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Openstack-System-Scope: None Aug 24 11:41:06.350983 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: User-Agent: python-urllib3/1.26.11 Aug 24 11:41:06.350983 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Auth-Token: gAAAAABjBgwcqa0CYUPhW6H0Ka_8PQo6WuRnVZxjJiGxVsP8OjBajZzTfRi-wT8euSPFOEzkWOlYPU2oyt3p2sSsquSlSFvb_OOqjFi6GL1r-duvQ_e_lEwQ5SQEw1PDuzr4YOYFBd4Fp8LuJKTid5FAIFqTau26udI57bZEjikHTi6akUiQBpI Aug 24 11:41:06.350983 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Domain-Id: None Aug 24 11:41:06.350983 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Domain-Name: None Aug 24 11:41:06.350983 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Identity-Status: Confirmed Aug 24 11:41:06.350983 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Is-Admin-Project: True Aug 24 11:41:06.350983 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Project-Domain-Id: default Aug 24 11:41:06.350983 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Project-Domain-Name: Default Aug 24 11:41:06.350983 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Project-Id: 048c7f026f304084960d77bf46f367d8 Aug 24 11:41:06.350983 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-309471798 Aug 24 11:41:06.350983 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Role: reader,member Aug 24 11:41:06.350983 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Roles: reader,member Aug 24 11:41:06.352748 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/volume/v3/048c7f026f304084960d77bf46f367d8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/volume/v3/048c7f026f304084960d77bf46f367d8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/compute/v2/048c7f026f304084960d77bf46f367d8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84:8080/v1/AUTH_048c7f026f304084960d77bf46f367d8", "adminURL": "http://10.222.0.84:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/placement"}]}] Aug 24 11:41:06.352748 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Tenant: tempest-ServerRescueNegativeTestJSON-309471798 Aug 24 11:41:06.352748 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Tenant-Id: 048c7f026f304084960d77bf46f367d8 Aug 24 11:41:06.352748 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-309471798 Aug 24 11:41:06.352748 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User: tempest-ServerRescueNegativeTestJSON-309471798-project Aug 24 11:41:06.352748 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User-Domain-Id: default Aug 24 11:41:06.352748 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User-Domain-Name: Default Aug 24 11:41:06.352748 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User-Id: 2d5bfffc316f481183093e386a326946 Aug 24 11:41:06.352748 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User-Name: tempest-ServerRescueNegativeTestJSON-309471798-project Aug 24 11:41:06.352748 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: method: > Aug 24 11:41:06.352748 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: exception: Instance 2d4527c9-c18c-4028-a452-d23423d9c4ee could not be found. Aug 24 11:41:06.352748 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: action_args: {'id': '2d4527c9-c18c-4028-a452-d23423d9c4ee'} Aug 24 11:41:06.353672 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:41:06.353672 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:41:06.353672 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:41:06.353672 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:41:06.353672 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:41:06.353672 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:41:06.353672 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:41:06.353672 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:41:06.353672 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:41:06.353672 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:41:06.353672 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d4527c9-c18c-4028-a452-d23423d9c4ee could not be found. Aug 24 11:41:06.353672 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:41:06.353672 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:41:06.353672 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:41:06.353672 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:41:06.353672 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:41:06.353672 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:41:06.353672 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:41:06.353672 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:41:06.353672 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:41:06.355322 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:41:06.355322 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:41:06.355322 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:41:06.355322 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:41:06.355322 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:41:06.355322 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:41:06.355322 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:41:06.355322 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d4527c9-c18c-4028-a452-d23423d9c4ee could not be found. Aug 24 11:41:06.355322 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:41:06.355322 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:41:06.355322 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:41:06.355322 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:41:06.355322 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:41:06.355322 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:41:06.355322 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:41:06.355322 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:41:06.355322 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d4527c9-c18c-4028-a452-d23423d9c4ee could not be found. Aug 24 11:41:06.355322 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:41:06.356749 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-5ab3aac4-e758-4d62-9e1c-3897a951a6f0 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Returning 404 to user: Instance 2d4527c9-c18c-4028-a452-d23423d9c4ee could not be found. {{(pid=124770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:41:06.356749 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-5ab3aac4-e758-4d62-9e1c-3897a951a6f0 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee" status: 404 len: 111 microversion: 2.1 time: 0.033285 Aug 24 11:41:06.356749 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 404/859] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:41:06 2022] GET /compute/v2.1/servers/2d4527c9-c18c-4028-a452-d23423d9c4ee => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:41:06.362629 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-fbe302d5-b9aa-49b6-b419-e819b2cbb7de tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:41:06.362629 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-fbe302d5-b9aa-49b6-b419-e819b2cbb7de tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: 3a7e223c-57dd-4ecc-a81f-9f4802472f4f] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:41:06.369150 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-fbe302d5-b9aa-49b6-b419-e819b2cbb7de tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:06.369673 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-fbe302d5-b9aa-49b6-b419-e819b2cbb7de tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:06.370108 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-fbe302d5-b9aa-49b6-b419-e819b2cbb7de tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:06.370809 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-fbe302d5-b9aa-49b6-b419-e819b2cbb7de tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:06.371257 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-fbe302d5-b9aa-49b6-b419-e819b2cbb7de tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:06.371682 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-fbe302d5-b9aa-49b6-b419-e819b2cbb7de tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:06.399652 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-fbe302d5-b9aa-49b6-b419-e819b2cbb7de tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: 3a7e223c-57dd-4ecc-a81f-9f4802472f4f] Going to try to terminate instance {{(pid=124769) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 11:41:06.669580 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-fbe302d5-b9aa-49b6-b419-e819b2cbb7de tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "DELETE /compute/v2.1/servers/3a7e223c-57dd-4ecc-a81f-9f4802472f4f" status: 204 len: 0 microversion: 2.1 time: 0.311580 Aug 24 11:41:06.670160 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 456/860] 10.222.0.84 () {58 vars in 1239 bytes} [Wed Aug 24 11:41:06 2022] DELETE /compute/v2.1/servers/3a7e223c-57dd-4ecc-a81f-9f4802472f4f => generated 0 bytes in 313 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 11:41:06.681988 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-1e7c2a61-40ba-499e-a7c7-fd32b61f6169 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:41:06.682786 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-1e7c2a61-40ba-499e-a7c7-fd32b61f6169 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: 3a7e223c-57dd-4ecc-a81f-9f4802472f4f] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:41:06.689942 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1e7c2a61-40ba-499e-a7c7-fd32b61f6169 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:06.690415 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1e7c2a61-40ba-499e-a7c7-fd32b61f6169 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:06.690852 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1e7c2a61-40ba-499e-a7c7-fd32b61f6169 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:06.691568 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1e7c2a61-40ba-499e-a7c7-fd32b61f6169 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:06.692022 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1e7c2a61-40ba-499e-a7c7-fd32b61f6169 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:06.692497 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1e7c2a61-40ba-499e-a7c7-fd32b61f6169 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:06.857373 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-1e7c2a61-40ba-499e-a7c7-fd32b61f6169 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:41:06.866238 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-1e7c2a61-40ba-499e-a7c7-fd32b61f6169 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/3a7e223c-57dd-4ecc-a81f-9f4802472f4f" status: 200 len: 1522 microversion: 2.1 time: 0.190547 Aug 24 11:41:06.866829 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 405/861] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:41:06 2022] GET /compute/v2.1/servers/3a7e223c-57dd-4ecc-a81f-9f4802472f4f => generated 1522 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:41:07.888394 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-5ba1c301-4b0e-4140-8a70-429bfcf98c7d tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:41:07.889289 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-5ba1c301-4b0e-4140-8a70-429bfcf98c7d tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: 3a7e223c-57dd-4ecc-a81f-9f4802472f4f] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:41:07.895780 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-5ba1c301-4b0e-4140-8a70-429bfcf98c7d tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:07.896327 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-5ba1c301-4b0e-4140-8a70-429bfcf98c7d tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:07.896771 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-5ba1c301-4b0e-4140-8a70-429bfcf98c7d tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:07.897602 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-5ba1c301-4b0e-4140-8a70-429bfcf98c7d tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:07.898062 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-5ba1c301-4b0e-4140-8a70-429bfcf98c7d tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:07.898488 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-5ba1c301-4b0e-4140-8a70-429bfcf98c7d tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:08.056345 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-5ba1c301-4b0e-4140-8a70-429bfcf98c7d tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:41:08.066202 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-5ba1c301-4b0e-4140-8a70-429bfcf98c7d tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/3a7e223c-57dd-4ecc-a81f-9f4802472f4f" status: 200 len: 1522 microversion: 2.1 time: 0.182241 Aug 24 11:41:08.067104 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 457/862] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:41:07 2022] GET /compute/v2.1/servers/3a7e223c-57dd-4ecc-a81f-9f4802472f4f => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:41:08.282193 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [req-043d7034-4227-42b0-9365-4e1e20bea8e9 req-058a0ec4-9885-41b9-9cd2-4047d7495ba1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a7e223c-57dd-4ecc-a81f-9f4802472f4f", "name": "network-vif-deleted", "tag": "ec53573c-c069-4fd3-ba2f-e0ddb8ebc30f"}]} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:41:08.293729 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-043d7034-4227-42b0-9365-4e1e20bea8e9 req-058a0ec4-9885-41b9-9cd2-4047d7495ba1 service nova] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:08.307267 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-043d7034-4227-42b0-9365-4e1e20bea8e9 req-058a0ec4-9885-41b9-9cd2-4047d7495ba1 service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:08.307267 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-043d7034-4227-42b0-9365-4e1e20bea8e9 req-058a0ec4-9885-41b9-9cd2-4047d7495ba1 service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:08.307669 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.compute.server_external_events [req-043d7034-4227-42b0-9365-4e1e20bea8e9 req-058a0ec4-9885-41b9-9cd2-4047d7495ba1 service nova] Creating event network-vif-deleted:ec53573c-c069-4fd3-ba2f-e0ddb8ebc30f for instance 3a7e223c-57dd-4ecc-a81f-9f4802472f4f on hv-cinder-85427 Aug 24 11:41:08.312696 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [req-043d7034-4227-42b0-9365-4e1e20bea8e9 req-058a0ec4-9885-41b9-9cd2-4047d7495ba1 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034712 Aug 24 11:41:08.313335 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 406/863] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Aug 24 11:41:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:41:09.048376 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-45b0dff9-d1c4-4ad5-92b6-5a72a57e2fe8 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:41:09.049035 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-45b0dff9-d1c4-4ad5-92b6-5a72a57e2fe8 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] [instance: be34b51d-aa45-4540-959d-a0f61d775992] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:41:09.055054 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-45b0dff9-d1c4-4ad5-92b6-5a72a57e2fe8 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:09.055547 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-45b0dff9-d1c4-4ad5-92b6-5a72a57e2fe8 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:09.055990 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-45b0dff9-d1c4-4ad5-92b6-5a72a57e2fe8 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:09.056702 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-45b0dff9-d1c4-4ad5-92b6-5a72a57e2fe8 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:09.057188 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-45b0dff9-d1c4-4ad5-92b6-5a72a57e2fe8 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:09.057612 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-45b0dff9-d1c4-4ad5-92b6-5a72a57e2fe8 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:09.085527 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-45b0dff9-d1c4-4ad5-92b6-5a72a57e2fe8 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] [instance: be34b51d-aa45-4540-959d-a0f61d775992] Going to try to terminate instance {{(pid=124769) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 11:41:09.090822 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-6d63fa30-cf43-4d62-8f6a-b516faa8e2af tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:41:09.091535 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-6d63fa30-cf43-4d62-8f6a-b516faa8e2af tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: 3a7e223c-57dd-4ecc-a81f-9f4802472f4f] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:41:09.098121 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6d63fa30-cf43-4d62-8f6a-b516faa8e2af tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:09.098603 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6d63fa30-cf43-4d62-8f6a-b516faa8e2af tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:09.099039 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6d63fa30-cf43-4d62-8f6a-b516faa8e2af tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:09.099741 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6d63fa30-cf43-4d62-8f6a-b516faa8e2af tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:09.100194 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6d63fa30-cf43-4d62-8f6a-b516faa8e2af tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:09.101960 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6d63fa30-cf43-4d62-8f6a-b516faa8e2af tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:09.138983 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6d63fa30-cf43-4d62-8f6a-b516faa8e2af tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:09.139466 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6d63fa30-cf43-4d62-8f6a-b516faa8e2af tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:09.139902 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6d63fa30-cf43-4d62-8f6a-b516faa8e2af tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:09.140346 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.objects.instance [None req-6d63fa30-cf43-4d62-8f6a-b516faa8e2af tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lazy-loading 'fault' on Instance uuid 3a7e223c-57dd-4ecc-a81f-9f4802472f4f {{(pid=124770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:41:09.191482 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-6d63fa30-cf43-4d62-8f6a-b516faa8e2af tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:41:09.199809 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-6d63fa30-cf43-4d62-8f6a-b516faa8e2af tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/3a7e223c-57dd-4ecc-a81f-9f4802472f4f" status: 200 len: 1312 microversion: 2.1 time: 0.113510 Aug 24 11:41:09.200423 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 407/864] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:41:09 2022] GET /compute/v2.1/servers/3a7e223c-57dd-4ecc-a81f-9f4802472f4f => generated 1312 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:41:09.505555 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-45b0dff9-d1c4-4ad5-92b6-5a72a57e2fe8 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] 10.222.0.84 "DELETE /compute/v2.1/servers/be34b51d-aa45-4540-959d-a0f61d775992" status: 204 len: 0 microversion: 2.1 time: 0.460607 Aug 24 11:41:09.506611 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 458/865] 10.222.0.84 () {58 vars in 1239 bytes} [Wed Aug 24 11:41:09 2022] DELETE /compute/v2.1/servers/be34b51d-aa45-4540-959d-a0f61d775992 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 11:41:09.515442 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-d54e96d7-bb37-472f-b01b-16a68c08d018 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:41:09.516037 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-d54e96d7-bb37-472f-b01b-16a68c08d018 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] [instance: be34b51d-aa45-4540-959d-a0f61d775992] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:41:09.522902 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d54e96d7-bb37-472f-b01b-16a68c08d018 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:09.523403 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d54e96d7-bb37-472f-b01b-16a68c08d018 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:09.523893 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d54e96d7-bb37-472f-b01b-16a68c08d018 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:09.524598 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d54e96d7-bb37-472f-b01b-16a68c08d018 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:09.525090 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d54e96d7-bb37-472f-b01b-16a68c08d018 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:09.525516 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d54e96d7-bb37-472f-b01b-16a68c08d018 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:09.676586 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-d54e96d7-bb37-472f-b01b-16a68c08d018 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b82b6f568bd41fa9d6b44facb766e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ef3fc15a0147e39228729d2b5b2631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:41:09.684869 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-d54e96d7-bb37-472f-b01b-16a68c08d018 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] 10.222.0.84 "GET /compute/v2.1/servers/be34b51d-aa45-4540-959d-a0f61d775992" status: 200 len: 1577 microversion: 2.1 time: 0.173653 Aug 24 11:41:09.685456 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 408/866] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:41:09 2022] GET /compute/v2.1/servers/be34b51d-aa45-4540-959d-a0f61d775992 => generated 1577 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:41:10.222276 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-af830219-b1c4-4744-b73f-6a2868cd6433 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:41:10.223000 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-af830219-b1c4-4744-b73f-6a2868cd6433 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: 3a7e223c-57dd-4ecc-a81f-9f4802472f4f] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:41:10.229961 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-af830219-b1c4-4744-b73f-6a2868cd6433 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:10.230456 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-af830219-b1c4-4744-b73f-6a2868cd6433 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:10.230896 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-af830219-b1c4-4744-b73f-6a2868cd6433 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:10.231603 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-af830219-b1c4-4744-b73f-6a2868cd6433 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:10.232073 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-af830219-b1c4-4744-b73f-6a2868cd6433 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:10.232499 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-af830219-b1c4-4744-b73f-6a2868cd6433 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:10.270560 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-af830219-b1c4-4744-b73f-6a2868cd6433 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:10.271042 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-af830219-b1c4-4744-b73f-6a2868cd6433 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:10.271478 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-af830219-b1c4-4744-b73f-6a2868cd6433 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:10.271933 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.objects.instance [None req-af830219-b1c4-4744-b73f-6a2868cd6433 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lazy-loading 'fault' on Instance uuid 3a7e223c-57dd-4ecc-a81f-9f4802472f4f {{(pid=124769) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:41:10.316737 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-af830219-b1c4-4744-b73f-6a2868cd6433 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5bfffc316f481183093e386a326946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c7f026f304084960d77bf46f367d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:41:10.328890 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-af830219-b1c4-4744-b73f-6a2868cd6433 tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/3a7e223c-57dd-4ecc-a81f-9f4802472f4f" status: 200 len: 1312 microversion: 2.1 time: 0.111135 Aug 24 11:41:10.329562 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 459/867] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:41:10 2022] GET /compute/v2.1/servers/3a7e223c-57dd-4ecc-a81f-9f4802472f4f => generated 1312 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:41:10.758060 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-24c55f5f-907f-48a1-8a1a-6bc5ebf70792 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:41:10.758060 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-24c55f5f-907f-48a1-8a1a-6bc5ebf70792 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] [instance: be34b51d-aa45-4540-959d-a0f61d775992] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:41:10.758060 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-24c55f5f-907f-48a1-8a1a-6bc5ebf70792 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:10.758060 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-24c55f5f-907f-48a1-8a1a-6bc5ebf70792 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:10.759354 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-24c55f5f-907f-48a1-8a1a-6bc5ebf70792 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:10.759354 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-24c55f5f-907f-48a1-8a1a-6bc5ebf70792 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:10.759354 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-24c55f5f-907f-48a1-8a1a-6bc5ebf70792 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:10.759354 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-24c55f5f-907f-48a1-8a1a-6bc5ebf70792 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:10.873516 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-24c55f5f-907f-48a1-8a1a-6bc5ebf70792 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b82b6f568bd41fa9d6b44facb766e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ef3fc15a0147e39228729d2b5b2631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:41:10.883039 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-24c55f5f-907f-48a1-8a1a-6bc5ebf70792 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] 10.222.0.84 "GET /compute/v2.1/servers/be34b51d-aa45-4540-959d-a0f61d775992" status: 200 len: 1577 microversion: 2.1 time: 0.179277 Aug 24 11:41:10.883388 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 409/868] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:41:10 2022] GET /compute/v2.1/servers/be34b51d-aa45-4540-959d-a0f61d775992 => generated 1577 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:41:11.353611 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-e2025ba7-827c-4994-b75e-1f760974494a tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:41:11.354581 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-e2025ba7-827c-4994-b75e-1f760974494a tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] [instance: 3a7e223c-57dd-4ecc-a81f-9f4802472f4f] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:41:11.361919 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-e2025ba7-827c-4994-b75e-1f760974494a tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:11.362407 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-e2025ba7-827c-4994-b75e-1f760974494a tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:11.362836 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-e2025ba7-827c-4994-b75e-1f760974494a tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:11.363535 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-e2025ba7-827c-4994-b75e-1f760974494a tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:11.363987 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-e2025ba7-827c-4994-b75e-1f760974494a tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:11.364432 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-e2025ba7-827c-4994-b75e-1f760974494a tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:11.380773 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.wsgi [None req-e2025ba7-827c-4994-b75e-1f760974494a tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] HTTP exception thrown: Instance 3a7e223c-57dd-4ecc-a81f-9f4802472f4f could not be found. Aug 24 11:41:11.382488 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-e2025ba7-827c-4994-b75e-1f760974494a tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Request method failure captured: Aug 24 11:41:11.382488 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: request: GET /compute/v2.1/servers/3a7e223c-57dd-4ecc-a81f-9f4802472f4f HTTP/1.1 Aug 24 11:41:11.382488 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Accept: application/json Aug 24 11:41:11.382488 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Accept-Encoding: identity Aug 24 11:41:11.382488 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Connection: close Aug 24 11:41:11.382488 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Content-Length: 0 Aug 24 11:41:11.382488 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Content-Type: application/json Aug 24 11:41:11.382488 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Host: 10.222.0.84 Aug 24 11:41:11.382488 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Openstack-System-Scope: None Aug 24 11:41:11.382488 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: User-Agent: python-urllib3/1.26.11 Aug 24 11:41:11.382488 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Auth-Token: gAAAAABjBgwcqa0CYUPhW6H0Ka_8PQo6WuRnVZxjJiGxVsP8OjBajZzTfRi-wT8euSPFOEzkWOlYPU2oyt3p2sSsquSlSFvb_OOqjFi6GL1r-duvQ_e_lEwQ5SQEw1PDuzr4YOYFBd4Fp8LuJKTid5FAIFqTau26udI57bZEjikHTi6akUiQBpI Aug 24 11:41:11.382488 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Domain-Id: None Aug 24 11:41:11.382488 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Domain-Name: None Aug 24 11:41:11.382488 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Identity-Status: Confirmed Aug 24 11:41:11.382488 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Is-Admin-Project: True Aug 24 11:41:11.382488 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Project-Domain-Id: default Aug 24 11:41:11.382488 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Project-Domain-Name: Default Aug 24 11:41:11.382488 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Project-Id: 048c7f026f304084960d77bf46f367d8 Aug 24 11:41:11.382488 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-309471798 Aug 24 11:41:11.382488 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Role: reader,member Aug 24 11:41:11.382488 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Roles: reader,member Aug 24 11:41:11.385482 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/volume/v3/048c7f026f304084960d77bf46f367d8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/volume/v3/048c7f026f304084960d77bf46f367d8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/compute/v2/048c7f026f304084960d77bf46f367d8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84:8080/v1/AUTH_048c7f026f304084960d77bf46f367d8", "adminURL": "http://10.222.0.84:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/placement"}]}] Aug 24 11:41:11.385482 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Tenant: tempest-ServerRescueNegativeTestJSON-309471798 Aug 24 11:41:11.385482 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Tenant-Id: 048c7f026f304084960d77bf46f367d8 Aug 24 11:41:11.385482 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-309471798 Aug 24 11:41:11.385482 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-User: tempest-ServerRescueNegativeTestJSON-309471798-project Aug 24 11:41:11.385482 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-User-Domain-Id: default Aug 24 11:41:11.385482 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-User-Domain-Name: Default Aug 24 11:41:11.385482 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-User-Id: 2d5bfffc316f481183093e386a326946 Aug 24 11:41:11.385482 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-User-Name: tempest-ServerRescueNegativeTestJSON-309471798-project Aug 24 11:41:11.385482 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: method: > Aug 24 11:41:11.385482 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: exception: Instance 3a7e223c-57dd-4ecc-a81f-9f4802472f4f could not be found. Aug 24 11:41:11.385482 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: action_args: {'id': '3a7e223c-57dd-4ecc-a81f-9f4802472f4f'} Aug 24 11:41:11.387163 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:41:11.387163 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:41:11.387163 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:41:11.387163 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:41:11.387163 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:41:11.387163 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:41:11.387163 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:41:11.387163 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:41:11.387163 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:41:11.387163 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:41:11.387163 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a7e223c-57dd-4ecc-a81f-9f4802472f4f could not be found. Aug 24 11:41:11.387163 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Aug 24 11:41:11.387163 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:41:11.387163 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Aug 24 11:41:11.387163 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:41:11.387163 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:41:11.387163 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:41:11.387163 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:41:11.387163 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:41:11.387163 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:41:11.390247 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:41:11.390247 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:41:11.390247 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:41:11.390247 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:41:11.390247 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:41:11.390247 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:41:11.390247 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:41:11.390247 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a7e223c-57dd-4ecc-a81f-9f4802472f4f could not be found. Aug 24 11:41:11.390247 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Aug 24 11:41:11.390247 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:41:11.390247 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Aug 24 11:41:11.390247 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:41:11.390247 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:41:11.390247 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:41:11.390247 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:41:11.390247 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:41:11.390247 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a7e223c-57dd-4ecc-a81f-9f4802472f4f could not be found. Aug 24 11:41:11.390247 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Aug 24 11:41:11.394286 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-e2025ba7-827c-4994-b75e-1f760974494a tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] Returning 404 to user: Instance 3a7e223c-57dd-4ecc-a81f-9f4802472f4f could not be found. {{(pid=124769) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:41:11.394286 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-e2025ba7-827c-4994-b75e-1f760974494a tempest-ServerRescueNegativeTestJSON-309471798 tempest-ServerRescueNegativeTestJSON-309471798-project] 10.222.0.84 "GET /compute/v2.1/servers/3a7e223c-57dd-4ecc-a81f-9f4802472f4f" status: 404 len: 111 microversion: 2.1 time: 0.036219 Aug 24 11:41:11.394286 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 460/869] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:41:11 2022] GET /compute/v2.1/servers/3a7e223c-57dd-4ecc-a81f-9f4802472f4f => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:41:11.905136 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-dcd27b8b-f270-40a6-9116-873ac7d8bff7 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:41:11.905762 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-dcd27b8b-f270-40a6-9116-873ac7d8bff7 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] [instance: be34b51d-aa45-4540-959d-a0f61d775992] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:41:11.914068 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-dcd27b8b-f270-40a6-9116-873ac7d8bff7 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:11.914876 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-dcd27b8b-f270-40a6-9116-873ac7d8bff7 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:11.915467 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-dcd27b8b-f270-40a6-9116-873ac7d8bff7 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:11.916042 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-dcd27b8b-f270-40a6-9116-873ac7d8bff7 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:11.916500 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-dcd27b8b-f270-40a6-9116-873ac7d8bff7 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:11.916947 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-dcd27b8b-f270-40a6-9116-873ac7d8bff7 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:12.350388 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-dcd27b8b-f270-40a6-9116-873ac7d8bff7 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b82b6f568bd41fa9d6b44facb766e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ef3fc15a0147e39228729d2b5b2631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:41:12.360180 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-dcd27b8b-f270-40a6-9116-873ac7d8bff7 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] 10.222.0.84 "GET /compute/v2.1/servers/be34b51d-aa45-4540-959d-a0f61d775992" status: 200 len: 1577 microversion: 2.1 time: 0.458936 Aug 24 11:41:12.363472 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 410/870] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:41:11 2022] GET /compute/v2.1/servers/be34b51d-aa45-4540-959d-a0f61d775992 => generated 1577 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:41:13.308386 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [req-a221f5f5-3d04-44b0-b454-66f602ffb8f4 req-67188e32-8712-4ff8-bf5e-5ecf7fa285a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be34b51d-aa45-4540-959d-a0f61d775992", "name": "network-vif-deleted", "tag": "bc48e073-4e3e-414c-bc63-e35b79ac195d"}]} {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:41:13.322178 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [req-a221f5f5-3d04-44b0-b454-66f602ffb8f4 req-67188e32-8712-4ff8-bf5e-5ecf7fa285a2 service nova] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:13.322999 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [req-a221f5f5-3d04-44b0-b454-66f602ffb8f4 req-67188e32-8712-4ff8-bf5e-5ecf7fa285a2 service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:13.325041 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [req-a221f5f5-3d04-44b0-b454-66f602ffb8f4 req-67188e32-8712-4ff8-bf5e-5ecf7fa285a2 service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:13.342709 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.compute.server_external_events [req-a221f5f5-3d04-44b0-b454-66f602ffb8f4 req-67188e32-8712-4ff8-bf5e-5ecf7fa285a2 service nova] Creating event network-vif-deleted:bc48e073-4e3e-414c-bc63-e35b79ac195d for instance be34b51d-aa45-4540-959d-a0f61d775992 on hv-cinder-85427 Aug 24 11:41:13.349851 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [req-a221f5f5-3d04-44b0-b454-66f602ffb8f4 req-67188e32-8712-4ff8-bf5e-5ecf7fa285a2 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048786 Aug 24 11:41:13.350743 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 461/871] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Aug 24 11:41:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:41:13.383392 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-3a3f6772-34f6-4777-bb43-6225c4503863 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:41:13.384216 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-3a3f6772-34f6-4777-bb43-6225c4503863 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] [instance: be34b51d-aa45-4540-959d-a0f61d775992] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:41:13.397522 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-3a3f6772-34f6-4777-bb43-6225c4503863 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:13.397522 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-3a3f6772-34f6-4777-bb43-6225c4503863 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:13.397522 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-3a3f6772-34f6-4777-bb43-6225c4503863 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:13.397522 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-3a3f6772-34f6-4777-bb43-6225c4503863 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:13.397944 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-3a3f6772-34f6-4777-bb43-6225c4503863 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:13.397944 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-3a3f6772-34f6-4777-bb43-6225c4503863 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:13.510501 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-3a3f6772-34f6-4777-bb43-6225c4503863 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b82b6f568bd41fa9d6b44facb766e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ef3fc15a0147e39228729d2b5b2631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:41:13.513082 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:41:13.527105 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-3a3f6772-34f6-4777-bb43-6225c4503863 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] 10.222.0.84 "GET /compute/v2.1/servers/be34b51d-aa45-4540-959d-a0f61d775992" status: 200 len: 1509 microversion: 2.1 time: 0.142121 Aug 24 11:41:13.535797 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 411/872] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:41:13 2022] GET /compute/v2.1/servers/be34b51d-aa45-4540-959d-a0f61d775992 => generated 1509 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:41:14.547280 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-d68ddbd6-1bce-4415-95b0-ca980a8bc55f tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:41:14.550926 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-d68ddbd6-1bce-4415-95b0-ca980a8bc55f tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] [instance: be34b51d-aa45-4540-959d-a0f61d775992] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:41:14.556164 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-d68ddbd6-1bce-4415-95b0-ca980a8bc55f tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:14.556990 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-d68ddbd6-1bce-4415-95b0-ca980a8bc55f tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:14.557425 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-d68ddbd6-1bce-4415-95b0-ca980a8bc55f tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:14.558226 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-d68ddbd6-1bce-4415-95b0-ca980a8bc55f tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:14.558679 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-d68ddbd6-1bce-4415-95b0-ca980a8bc55f tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:14.559312 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-d68ddbd6-1bce-4415-95b0-ca980a8bc55f tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:14.609248 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-d68ddbd6-1bce-4415-95b0-ca980a8bc55f tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:14.609248 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-d68ddbd6-1bce-4415-95b0-ca980a8bc55f tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:14.609248 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-d68ddbd6-1bce-4415-95b0-ca980a8bc55f tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:14.609248 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.objects.instance [None req-d68ddbd6-1bce-4415-95b0-ca980a8bc55f tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lazy-loading 'fault' on Instance uuid be34b51d-aa45-4540-959d-a0f61d775992 {{(pid=124769) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:41:14.778567 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-d68ddbd6-1bce-4415-95b0-ca980a8bc55f tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b82b6f568bd41fa9d6b44facb766e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ef3fc15a0147e39228729d2b5b2631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:41:14.787647 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-d68ddbd6-1bce-4415-95b0-ca980a8bc55f tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] 10.222.0.84 "GET /compute/v2.1/servers/be34b51d-aa45-4540-959d-a0f61d775992" status: 200 len: 1231 microversion: 2.1 time: 0.247295 Aug 24 11:41:14.788385 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 462/873] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:41:14 2022] GET /compute/v2.1/servers/be34b51d-aa45-4540-959d-a0f61d775992 => generated 1231 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:41:15.822558 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-fabfa831-e4cf-4363-a5e2-9f2419063efa tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:41:15.823356 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-fabfa831-e4cf-4363-a5e2-9f2419063efa tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] [instance: be34b51d-aa45-4540-959d-a0f61d775992] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:41:15.831320 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-fabfa831-e4cf-4363-a5e2-9f2419063efa tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:15.831897 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-fabfa831-e4cf-4363-a5e2-9f2419063efa tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:15.832461 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-fabfa831-e4cf-4363-a5e2-9f2419063efa tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:15.833248 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-fabfa831-e4cf-4363-a5e2-9f2419063efa tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:15.833710 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-fabfa831-e4cf-4363-a5e2-9f2419063efa tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:15.834135 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-fabfa831-e4cf-4363-a5e2-9f2419063efa tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:15.850320 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.wsgi [None req-fabfa831-e4cf-4363-a5e2-9f2419063efa tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] HTTP exception thrown: Instance be34b51d-aa45-4540-959d-a0f61d775992 could not be found. Aug 24 11:41:15.852088 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-fabfa831-e4cf-4363-a5e2-9f2419063efa tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Request method failure captured: Aug 24 11:41:15.852088 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: request: GET /compute/v2.1/servers/be34b51d-aa45-4540-959d-a0f61d775992 HTTP/1.1 Aug 24 11:41:15.852088 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Accept: application/json Aug 24 11:41:15.852088 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Accept-Encoding: identity Aug 24 11:41:15.852088 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Connection: close Aug 24 11:41:15.852088 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Content-Length: 0 Aug 24 11:41:15.852088 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Content-Type: application/json Aug 24 11:41:15.852088 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Host: 10.222.0.84 Aug 24 11:41:15.852088 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Openstack-System-Scope: None Aug 24 11:41:15.852088 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: User-Agent: python-urllib3/1.26.11 Aug 24 11:41:15.852088 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Auth-Token: gAAAAABjBg1BVDXXSs0s1p7mJJhsA-_dbfynZ8c-TDDDTvCbvPZxi5WW99T-jVhomvZ5jKdpwnQP32urIDCvYy1U3dTqN0EZ6FBpM94YOAVlxo_9OG_S8JWmQ7mh1AiLbYSVWkQ0NSDd8h_h8ondHXl5Z-LLBPbAzV0MxHq-RgCt4nVlgHKNvLw Aug 24 11:41:15.852088 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Domain-Id: None Aug 24 11:41:15.852088 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Domain-Name: None Aug 24 11:41:15.852088 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Identity-Status: Confirmed Aug 24 11:41:15.852088 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Is-Admin-Project: True Aug 24 11:41:15.852088 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Project-Domain-Id: default Aug 24 11:41:15.852088 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Project-Domain-Name: Default Aug 24 11:41:15.852088 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Project-Id: c4ef3fc15a0147e39228729d2b5b2631 Aug 24 11:41:15.852088 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Project-Name: tempest-TestVolumeBootPattern-334422239 Aug 24 11:41:15.852088 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Role: reader,member Aug 24 11:41:15.852088 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Roles: reader,member Aug 24 11:41:15.853757 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/volume/v3/c4ef3fc15a0147e39228729d2b5b2631"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/volume/v3/c4ef3fc15a0147e39228729d2b5b2631"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/compute/v2/c4ef3fc15a0147e39228729d2b5b2631"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84:8080/v1/AUTH_c4ef3fc15a0147e39228729d2b5b2631", "adminURL": "http://10.222.0.84:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/placement"}]}] Aug 24 11:41:15.853757 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Tenant: tempest-TestVolumeBootPattern-334422239 Aug 24 11:41:15.853757 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Tenant-Id: c4ef3fc15a0147e39228729d2b5b2631 Aug 24 11:41:15.853757 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Tenant-Name: tempest-TestVolumeBootPattern-334422239 Aug 24 11:41:15.853757 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User: tempest-TestVolumeBootPattern-334422239-project Aug 24 11:41:15.853757 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User-Domain-Id: default Aug 24 11:41:15.853757 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User-Domain-Name: Default Aug 24 11:41:15.853757 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User-Id: 0b82b6f568bd41fa9d6b44facb766e0b Aug 24 11:41:15.853757 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User-Name: tempest-TestVolumeBootPattern-334422239-project Aug 24 11:41:15.853757 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: method: > Aug 24 11:41:15.853757 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: exception: Instance be34b51d-aa45-4540-959d-a0f61d775992 could not be found. Aug 24 11:41:15.853757 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: action_args: {'id': 'be34b51d-aa45-4540-959d-a0f61d775992'} Aug 24 11:41:15.855154 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:41:15.855154 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:41:15.855154 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:41:15.855154 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:41:15.855154 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:41:15.855154 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:41:15.855154 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:41:15.855154 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:41:15.855154 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:41:15.855154 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:41:15.855154 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be34b51d-aa45-4540-959d-a0f61d775992 could not be found. Aug 24 11:41:15.855154 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:41:15.855154 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:41:15.855154 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:41:15.855154 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:41:15.855154 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:41:15.855154 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:41:15.855154 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:41:15.855154 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:41:15.855154 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:41:15.856648 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:41:15.856648 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:41:15.856648 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:41:15.856648 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:41:15.856648 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:41:15.856648 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:41:15.856648 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:41:15.856648 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be34b51d-aa45-4540-959d-a0f61d775992 could not be found. Aug 24 11:41:15.856648 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:41:15.856648 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:41:15.856648 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:41:15.856648 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:41:15.856648 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:41:15.856648 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:41:15.856648 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:41:15.856648 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:41:15.856648 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be34b51d-aa45-4540-959d-a0f61d775992 could not be found. Aug 24 11:41:15.856648 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:41:15.858081 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-fabfa831-e4cf-4363-a5e2-9f2419063efa tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Returning 404 to user: Instance be34b51d-aa45-4540-959d-a0f61d775992 could not be found. {{(pid=124770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:41:15.858081 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-fabfa831-e4cf-4363-a5e2-9f2419063efa tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] 10.222.0.84 "GET /compute/v2.1/servers/be34b51d-aa45-4540-959d-a0f61d775992" status: 404 len: 111 microversion: 2.1 time: 0.035350 Aug 24 11:41:15.858081 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 412/874] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:41:15 2022] GET /compute/v2.1/servers/be34b51d-aa45-4540-959d-a0f61d775992 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 11:41:16.004462 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-b0434388-43d0-4d1f-9f3e-88670a2f646f tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-545453454", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1852951757", "security_groups": [{"name": "tempest-secgroup-smoke-1129237839"}], "block_device_mapping_v2": [{"uuid": "a69aaab5-7f01-4074-a271-f7d3e439795b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "2124b453-c0e5-4e4a-8217-6cdc2b930758"}]}} {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:41:16.131829 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.network.neutron [None req-b0434388-43d0-4d1f-9f3e-88670a2f646f tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] validate_networks() for [('2124b453-c0e5-4e4a-8217-6cdc2b930758', None, None, None, None, None)] {{(pid=124769) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 11:41:16.757449 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.virt.hardware [None req-b0434388-43d0-4d1f-9f3e-88670a2f646f tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Flavor limits 0:0:0 {{(pid=124769) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 11:41:16.757876 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.virt.hardware [None req-b0434388-43d0-4d1f-9f3e-88670a2f646f tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Image limits 0:0:0 {{(pid=124769) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 11:41:16.758388 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.virt.hardware [None req-b0434388-43d0-4d1f-9f3e-88670a2f646f tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Flavor pref 0:0:0 {{(pid=124769) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 11:41:16.759094 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.virt.hardware [None req-b0434388-43d0-4d1f-9f3e-88670a2f646f tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Image pref 0:0:0 {{(pid=124769) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 11:41:16.759556 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.virt.hardware [None req-b0434388-43d0-4d1f-9f3e-88670a2f646f tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124769) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 11:41:16.769962 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-b0434388-43d0-4d1f-9f3e-88670a2f646f tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:16.770447 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-b0434388-43d0-4d1f-9f3e-88670a2f646f tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:16.771078 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-b0434388-43d0-4d1f-9f3e-88670a2f646f tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:16.771807 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-b0434388-43d0-4d1f-9f3e-88670a2f646f tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:16.772266 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-b0434388-43d0-4d1f-9f3e-88670a2f646f tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:16.772691 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-b0434388-43d0-4d1f-9f3e-88670a2f646f tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:16.792921 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.quota [None req-b0434388-43d0-4d1f-9f3e-88670a2f646f tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Getting quotas for project c4ef3fc15a0147e39228729d2b5b2631. Resources: {'ram', 'cores', 'instances'} {{(pid=124769) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:41:16.797606 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.quota [None req-b0434388-43d0-4d1f-9f3e-88670a2f646f tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Getting quotas for user 0b82b6f568bd41fa9d6b44facb766e0b and project c4ef3fc15a0147e39228729d2b5b2631. Resources: {'ram', 'cores', 'instances'} {{(pid=124769) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:41:16.868816 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-b0434388-43d0-4d1f-9f3e-88670a2f646f tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Going to run 1 instances... {{(pid=124769) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 11:41:16.870937 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-b0434388-43d0-4d1f-9f3e-88670a2f646f tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] [instance: fef25575-f211-4db2-8c1f-e1cd8e73e69d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a69aaab5-7f01-4074-a271-f7d3e439795b',volume_size=None,volume_type=None)] {{(pid=124769) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 11:41:17.375279 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-b0434388-43d0-4d1f-9f3e-88670a2f646f tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] 10.222.0.84 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.375350 Aug 24 11:41:17.382467 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 463/875] 10.222.0.84 () {60 vars in 1147 bytes} [Wed Aug 24 11:41:15 2022] POST /compute/v2.1/servers => generated 406 bytes in 1377 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 11:41:17.388423 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-f4b2f092-ac8e-4c7a-a751-c023677e1a4e tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:41:17.389075 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-f4b2f092-ac8e-4c7a-a751-c023677e1a4e tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] [instance: fef25575-f211-4db2-8c1f-e1cd8e73e69d] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:41:17.392467 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:41:17.469609 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-f4b2f092-ac8e-4c7a-a751-c023677e1a4e tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b82b6f568bd41fa9d6b44facb766e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ef3fc15a0147e39228729d2b5b2631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:41:17.482386 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-f4b2f092-ac8e-4c7a-a751-c023677e1a4e tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] 10.222.0.84 "GET /compute/v2.1/servers/fef25575-f211-4db2-8c1f-e1cd8e73e69d" status: 200 len: 1094 microversion: 2.1 time: 0.098274 Aug 24 11:41:17.496391 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 413/876] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:41:17 2022] GET /compute/v2.1/servers/fef25575-f211-4db2-8c1f-e1cd8e73e69d => generated 1094 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:41:18.507595 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-ca146b43-60d1-4d4e-bd12-01048567cb87 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:41:18.508239 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-ca146b43-60d1-4d4e-bd12-01048567cb87 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] [instance: fef25575-f211-4db2-8c1f-e1cd8e73e69d] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:41:18.515158 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-ca146b43-60d1-4d4e-bd12-01048567cb87 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:18.515646 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-ca146b43-60d1-4d4e-bd12-01048567cb87 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:18.516103 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-ca146b43-60d1-4d4e-bd12-01048567cb87 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:18.516784 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-ca146b43-60d1-4d4e-bd12-01048567cb87 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:18.517531 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-ca146b43-60d1-4d4e-bd12-01048567cb87 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:18.517963 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-ca146b43-60d1-4d4e-bd12-01048567cb87 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:18.591808 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-ca146b43-60d1-4d4e-bd12-01048567cb87 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b82b6f568bd41fa9d6b44facb766e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ef3fc15a0147e39228729d2b5b2631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:41:18.605321 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-ca146b43-60d1-4d4e-bd12-01048567cb87 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] 10.222.0.84 "GET /compute/v2.1/servers/fef25575-f211-4db2-8c1f-e1cd8e73e69d" status: 200 len: 1144 microversion: 2.1 time: 0.104288 Aug 24 11:41:18.606163 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 464/877] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:41:18 2022] GET /compute/v2.1/servers/fef25575-f211-4db2-8c1f-e1cd8e73e69d => generated 1144 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:41:18.707843 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-389bdc34-350d-4651-91de-12216f17f69d tempest-VolumesSnapshotsTestJSON-1946888255 tempest-VolumesSnapshotsTestJSON-1946888255-project] Action: 'create', calling method: .version_select at 0x7f0e2eda6430>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-253918304"}} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:41:19.461839 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-389bdc34-350d-4651-91de-12216f17f69d tempest-VolumesSnapshotsTestJSON-1946888255 tempest-VolumesSnapshotsTestJSON-1946888255-project] 10.222.0.84 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.949329 Aug 24 11:41:19.461839 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 414/878] 10.222.0.84 () {60 vars in 1155 bytes} [Wed Aug 24 11:41:18 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 951 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Aug 24 11:41:19.472698 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-23773f10-1aa8-4f24-86c0-cb9661b7d460 tempest-VolumesSnapshotsTestJSON-1946888255 tempest-VolumesSnapshotsTestJSON-1946888255-project] Calling method '.version_select at 0x7f0e2a481c10>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:41:19.536586 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-23773f10-1aa8-4f24-86c0-cb9661b7d460 tempest-VolumesSnapshotsTestJSON-1946888255 tempest-VolumesSnapshotsTestJSON-1946888255-project] 10.222.0.84 "GET /compute/v2.1/os-volumes/921179c6-51fd-4835-a3e8-6a6361cf8ca0" status: 200 len: 344 microversion: 2.1 time: 0.068145 Aug 24 11:41:19.537594 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 465/879] 10.222.0.84 () {58 vars in 1245 bytes} [Wed Aug 24 11:41:19 2022] GET /compute/v2.1/os-volumes/921179c6-51fd-4835-a3e8-6a6361cf8ca0 => generated 344 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:41:19.629837 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-8f50ee83-ef56-4f9a-a507-79c1642023dc tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:41:19.630348 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-8f50ee83-ef56-4f9a-a507-79c1642023dc tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] [instance: fef25575-f211-4db2-8c1f-e1cd8e73e69d] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:41:19.636692 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8f50ee83-ef56-4f9a-a507-79c1642023dc tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:19.637382 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8f50ee83-ef56-4f9a-a507-79c1642023dc tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:19.637835 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8f50ee83-ef56-4f9a-a507-79c1642023dc tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:19.638541 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8f50ee83-ef56-4f9a-a507-79c1642023dc tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:19.639030 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8f50ee83-ef56-4f9a-a507-79c1642023dc tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:19.639492 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8f50ee83-ef56-4f9a-a507-79c1642023dc tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:19.725397 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-8f50ee83-ef56-4f9a-a507-79c1642023dc tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b82b6f568bd41fa9d6b44facb766e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ef3fc15a0147e39228729d2b5b2631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:41:19.733484 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-8f50ee83-ef56-4f9a-a507-79c1642023dc tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] 10.222.0.84 "GET /compute/v2.1/servers/fef25575-f211-4db2-8c1f-e1cd8e73e69d" status: 200 len: 1192 microversion: 2.1 time: 0.109135 Aug 24 11:41:19.736429 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 415/880] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:41:19 2022] GET /compute/v2.1/servers/fef25575-f211-4db2-8c1f-e1cd8e73e69d => generated 1192 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:41:20.559852 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-884bb9b0-800f-44a9-9d7c-1f0d7ced942e tempest-VolumesSnapshotsTestJSON-1946888255 tempest-VolumesSnapshotsTestJSON-1946888255-project] Calling method '.version_select at 0x7f0e2a4edca0>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:41:20.613980 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-884bb9b0-800f-44a9-9d7c-1f0d7ced942e tempest-VolumesSnapshotsTestJSON-1946888255 tempest-VolumesSnapshotsTestJSON-1946888255-project] 10.222.0.84 "GET /compute/v2.1/os-volumes/921179c6-51fd-4835-a3e8-6a6361cf8ca0" status: 200 len: 344 microversion: 2.1 time: 0.058768 Aug 24 11:41:20.614532 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 466/881] 10.222.0.84 () {58 vars in 1245 bytes} [Wed Aug 24 11:41:20 2022] GET /compute/v2.1/os-volumes/921179c6-51fd-4835-a3e8-6a6361cf8ca0 => generated 344 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:41:20.756608 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-776d4fc7-a456-4651-ad27-ca2b555507d8 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:41:20.757291 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-776d4fc7-a456-4651-ad27-ca2b555507d8 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] [instance: fef25575-f211-4db2-8c1f-e1cd8e73e69d] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:41:20.764490 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-776d4fc7-a456-4651-ad27-ca2b555507d8 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:20.765011 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-776d4fc7-a456-4651-ad27-ca2b555507d8 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:20.765450 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-776d4fc7-a456-4651-ad27-ca2b555507d8 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:20.766163 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-776d4fc7-a456-4651-ad27-ca2b555507d8 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:20.766639 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-776d4fc7-a456-4651-ad27-ca2b555507d8 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:20.767159 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-776d4fc7-a456-4651-ad27-ca2b555507d8 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:21.015304 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-776d4fc7-a456-4651-ad27-ca2b555507d8 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b82b6f568bd41fa9d6b44facb766e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ef3fc15a0147e39228729d2b5b2631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:41:21.025343 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-776d4fc7-a456-4651-ad27-ca2b555507d8 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] 10.222.0.84 "GET /compute/v2.1/servers/fef25575-f211-4db2-8c1f-e1cd8e73e69d" status: 200 len: 1278 microversion: 2.1 time: 0.272810 Aug 24 11:41:21.025996 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 416/882] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:41:20 2022] GET /compute/v2.1/servers/fef25575-f211-4db2-8c1f-e1cd8e73e69d => generated 1278 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:41:21.629310 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-07ea4ad7-ad99-4d54-8c5f-617e7d06d3b6 tempest-VolumesSnapshotsTestJSON-1946888255 tempest-VolumesSnapshotsTestJSON-1946888255-project] Calling method '.version_select at 0x7f0e2a54c0d0>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:41:21.695923 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-07ea4ad7-ad99-4d54-8c5f-617e7d06d3b6 tempest-VolumesSnapshotsTestJSON-1946888255 tempest-VolumesSnapshotsTestJSON-1946888255-project] 10.222.0.84 "GET /compute/v2.1/os-volumes/921179c6-51fd-4835-a3e8-6a6361cf8ca0" status: 200 len: 345 microversion: 2.1 time: 0.071549 Aug 24 11:41:21.696495 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 467/883] 10.222.0.84 () {58 vars in 1245 bytes} [Wed Aug 24 11:41:21 2022] GET /compute/v2.1/os-volumes/921179c6-51fd-4835-a3e8-6a6361cf8ca0 => generated 345 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:41:21.712145 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-ca99e431-2d8c-4de5-9638-16562bda442b tempest-VolumesSnapshotsTestJSON-1946888255 tempest-VolumesSnapshotsTestJSON-1946888255-project] Action: 'create', calling method: .version_select at 0x7f0e2ed89d30>, body: {"snapshot": {"volume_id": "921179c6-51fd-4835-a3e8-6a6361cf8ca0", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-909089170"}} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:41:22.048931 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-54a0f9b5-cd1a-47d0-9835-9a659e561581 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:41:22.049436 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-54a0f9b5-cd1a-47d0-9835-9a659e561581 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] [instance: fef25575-f211-4db2-8c1f-e1cd8e73e69d] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:41:22.051635 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG dbcounter [-] [124769] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=124769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:41:22.056755 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-54a0f9b5-cd1a-47d0-9835-9a659e561581 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:22.057283 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-54a0f9b5-cd1a-47d0-9835-9a659e561581 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:22.057715 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-54a0f9b5-cd1a-47d0-9835-9a659e561581 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:22.058422 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-54a0f9b5-cd1a-47d0-9835-9a659e561581 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:22.058872 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-54a0f9b5-cd1a-47d0-9835-9a659e561581 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:22.059303 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-54a0f9b5-cd1a-47d0-9835-9a659e561581 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:22.226304 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-54a0f9b5-cd1a-47d0-9835-9a659e561581 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b82b6f568bd41fa9d6b44facb766e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ef3fc15a0147e39228729d2b5b2631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:41:22.236766 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-54a0f9b5-cd1a-47d0-9835-9a659e561581 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] 10.222.0.84 "GET /compute/v2.1/servers/fef25575-f211-4db2-8c1f-e1cd8e73e69d" status: 200 len: 1278 microversion: 2.1 time: 0.192009 Aug 24 11:41:22.237370 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 468/884] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:41:22 2022] GET /compute/v2.1/servers/fef25575-f211-4db2-8c1f-e1cd8e73e69d => generated 1278 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:41:22.255594 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [req-499731fe-38c7-40d1-8165-e47f03a42218 req-66ce984f-bf68-453b-95bb-26893479abc4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fef25575-f211-4db2-8c1f-e1cd8e73e69d", "tag": "f074715e-37e5-4ad1-955b-cb3c250052f0"}]} {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:41:22.270438 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [req-499731fe-38c7-40d1-8165-e47f03a42218 req-66ce984f-bf68-453b-95bb-26893479abc4 service nova] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:22.270913 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [req-499731fe-38c7-40d1-8165-e47f03a42218 req-66ce984f-bf68-453b-95bb-26893479abc4 service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:22.271550 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [req-499731fe-38c7-40d1-8165-e47f03a42218 req-66ce984f-bf68-453b-95bb-26893479abc4 service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:22.284917 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.compute.server_external_events [req-499731fe-38c7-40d1-8165-e47f03a42218 req-66ce984f-bf68-453b-95bb-26893479abc4 service nova] Creating event network-changed:f074715e-37e5-4ad1-955b-cb3c250052f0 for instance fef25575-f211-4db2-8c1f-e1cd8e73e69d on hv-cinder-85427 Aug 24 11:41:22.290079 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [req-499731fe-38c7-40d1-8165-e47f03a42218 req-66ce984f-bf68-453b-95bb-26893479abc4 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041016 Aug 24 11:41:22.290741 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 469/885] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Aug 24 11:41:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:41:22.461618 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-ca99e431-2d8c-4de5-9638-16562bda442b tempest-VolumesSnapshotsTestJSON-1946888255 tempest-VolumesSnapshotsTestJSON-1946888255-project] 10.222.0.84 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.754607 Aug 24 11:41:22.462709 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 417/886] 10.222.0.84 () {60 vars in 1162 bytes} [Wed Aug 24 11:41:21 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:41:22.483583 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-4b151742-03e1-4444-9f77-149651fb3e4d tempest-VolumesSnapshotsTestJSON-1946888255 tempest-VolumesSnapshotsTestJSON-1946888255-project] Calling method '.version_select at 0x7f0e2a4818b0>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:41:22.534632 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-4b151742-03e1-4444-9f77-149651fb3e4d tempest-VolumesSnapshotsTestJSON-1946888255 tempest-VolumesSnapshotsTestJSON-1946888255-project] 10.222.0.84 "GET /compute/v2.1/os-snapshots/4a66a9c9-724c-4423-8873-77db869acf2f" status: 200 len: 286 microversion: 2.1 time: 0.060251 Aug 24 11:41:22.535261 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 470/887] 10.222.0.84 () {58 vars in 1251 bytes} [Wed Aug 24 11:41:22 2022] GET /compute/v2.1/os-snapshots/4a66a9c9-724c-4423-8873-77db869acf2f => generated 286 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:41:22.546578 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-13d73cdf-7e9d-4d33-985c-cd913e79b87a tempest-VolumesSnapshotsTestJSON-1946888255 tempest-VolumesSnapshotsTestJSON-1946888255-project] Calling method '.version_select at 0x7f0e2ede7d30>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:41:22.594191 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-13d73cdf-7e9d-4d33-985c-cd913e79b87a tempest-VolumesSnapshotsTestJSON-1946888255 tempest-VolumesSnapshotsTestJSON-1946888255-project] 10.222.0.84 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.051394 Aug 24 11:41:22.598781 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 418/888] 10.222.0.84 () {58 vars in 1140 bytes} [Wed Aug 24 11:41:22 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:41:22.609348 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-007f27b6-fb8a-4e1b-8274-13130fe751fc tempest-VolumesSnapshotsTestJSON-1946888255 tempest-VolumesSnapshotsTestJSON-1946888255-project] Calling method '.version_select at 0x7f0e2ee21820>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:41:22.658170 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-007f27b6-fb8a-4e1b-8274-13130fe751fc tempest-VolumesSnapshotsTestJSON-1946888255 tempest-VolumesSnapshotsTestJSON-1946888255-project] 10.222.0.84 "GET /compute/v2.1/os-snapshots/4a66a9c9-724c-4423-8873-77db869acf2f" status: 200 len: 286 microversion: 2.1 time: 0.052314 Aug 24 11:41:22.659296 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 471/889] 10.222.0.84 () {58 vars in 1251 bytes} [Wed Aug 24 11:41:22 2022] GET /compute/v2.1/os-snapshots/4a66a9c9-724c-4423-8873-77db869acf2f => generated 286 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:41:23.259142 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-98baadbb-c3df-4408-978a-157c9af728f1 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:41:23.259741 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-98baadbb-c3df-4408-978a-157c9af728f1 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] [instance: fef25575-f211-4db2-8c1f-e1cd8e73e69d] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:41:23.266380 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-98baadbb-c3df-4408-978a-157c9af728f1 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:23.267498 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-98baadbb-c3df-4408-978a-157c9af728f1 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:23.268151 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-98baadbb-c3df-4408-978a-157c9af728f1 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:23.268878 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-98baadbb-c3df-4408-978a-157c9af728f1 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:23.269341 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-98baadbb-c3df-4408-978a-157c9af728f1 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:23.269820 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-98baadbb-c3df-4408-978a-157c9af728f1 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:23.412495 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-98baadbb-c3df-4408-978a-157c9af728f1 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b82b6f568bd41fa9d6b44facb766e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ef3fc15a0147e39228729d2b5b2631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:41:23.423836 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-98baadbb-c3df-4408-978a-157c9af728f1 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] 10.222.0.84 "GET /compute/v2.1/servers/fef25575-f211-4db2-8c1f-e1cd8e73e69d" status: 200 len: 1266 microversion: 2.1 time: 0.168952 Aug 24 11:41:23.424501 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 419/890] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:41:23 2022] GET /compute/v2.1/servers/fef25575-f211-4db2-8c1f-e1cd8e73e69d => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:41:23.671312 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-32f8378a-bafb-4933-af83-afd857aa4ba9 tempest-VolumesSnapshotsTestJSON-1946888255 tempest-VolumesSnapshotsTestJSON-1946888255-project] Calling method '.version_select at 0x7f0e2a54c280>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:41:23.702884 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-32f8378a-bafb-4933-af83-afd857aa4ba9 tempest-VolumesSnapshotsTestJSON-1946888255 tempest-VolumesSnapshotsTestJSON-1946888255-project] 10.222.0.84 "GET /compute/v2.1/os-snapshots/4a66a9c9-724c-4423-8873-77db869acf2f" status: 200 len: 286 microversion: 2.1 time: 0.035865 Aug 24 11:41:23.703443 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 472/891] 10.222.0.84 () {58 vars in 1251 bytes} [Wed Aug 24 11:41:23 2022] GET /compute/v2.1/os-snapshots/4a66a9c9-724c-4423-8873-77db869acf2f => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:41:24.444638 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-731affe0-cce0-4ea6-93cc-1c80b0668ceb tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:41:24.445273 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-731affe0-cce0-4ea6-93cc-1c80b0668ceb tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] [instance: fef25575-f211-4db2-8c1f-e1cd8e73e69d] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:41:24.451702 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-731affe0-cce0-4ea6-93cc-1c80b0668ceb tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:24.452188 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-731affe0-cce0-4ea6-93cc-1c80b0668ceb tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:24.452622 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-731affe0-cce0-4ea6-93cc-1c80b0668ceb tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:24.453368 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-731affe0-cce0-4ea6-93cc-1c80b0668ceb tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:24.453820 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-731affe0-cce0-4ea6-93cc-1c80b0668ceb tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:24.454854 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-731affe0-cce0-4ea6-93cc-1c80b0668ceb tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:24.586902 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-731affe0-cce0-4ea6-93cc-1c80b0668ceb tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b82b6f568bd41fa9d6b44facb766e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ef3fc15a0147e39228729d2b5b2631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:41:24.594696 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-731affe0-cce0-4ea6-93cc-1c80b0668ceb tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] 10.222.0.84 "GET /compute/v2.1/servers/fef25575-f211-4db2-8c1f-e1cd8e73e69d" status: 200 len: 1266 microversion: 2.1 time: 0.153951 Aug 24 11:41:24.595262 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 420/892] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:41:24 2022] GET /compute/v2.1/servers/fef25575-f211-4db2-8c1f-e1cd8e73e69d => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:41:24.716351 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-cd4141dd-507b-4739-809a-4b125b33d4c0 tempest-VolumesSnapshotsTestJSON-1946888255 tempest-VolumesSnapshotsTestJSON-1946888255-project] Calling method '.version_select at 0x7f0e2a481310>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:41:24.744962 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-cd4141dd-507b-4739-809a-4b125b33d4c0 tempest-VolumesSnapshotsTestJSON-1946888255 tempest-VolumesSnapshotsTestJSON-1946888255-project] 10.222.0.84 "GET /compute/v2.1/os-snapshots/4a66a9c9-724c-4423-8873-77db869acf2f" status: 200 len: 286 microversion: 2.1 time: 0.033050 Aug 24 11:41:24.745515 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 473/893] 10.222.0.84 () {58 vars in 1251 bytes} [Wed Aug 24 11:41:24 2022] GET /compute/v2.1/os-snapshots/4a66a9c9-724c-4423-8873-77db869acf2f => generated 286 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:41:25.615991 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-150dc87e-3dd5-4f22-89f9-688548aca72d tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:41:25.616600 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-150dc87e-3dd5-4f22-89f9-688548aca72d tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] [instance: fef25575-f211-4db2-8c1f-e1cd8e73e69d] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:41:25.623450 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-150dc87e-3dd5-4f22-89f9-688548aca72d tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:25.623941 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-150dc87e-3dd5-4f22-89f9-688548aca72d tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:25.624381 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-150dc87e-3dd5-4f22-89f9-688548aca72d tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:25.625107 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-150dc87e-3dd5-4f22-89f9-688548aca72d tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:25.625570 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-150dc87e-3dd5-4f22-89f9-688548aca72d tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:25.626621 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-150dc87e-3dd5-4f22-89f9-688548aca72d tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:25.759184 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-12af987a-72fa-44c6-ac9b-adfb26f949d6 tempest-VolumesSnapshotsTestJSON-1946888255 tempest-VolumesSnapshotsTestJSON-1946888255-project] Calling method '.version_select at 0x7f0e2ee21b80>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:41:25.762244 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-150dc87e-3dd5-4f22-89f9-688548aca72d tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b82b6f568bd41fa9d6b44facb766e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ef3fc15a0147e39228729d2b5b2631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:41:25.770834 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-150dc87e-3dd5-4f22-89f9-688548aca72d tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] 10.222.0.84 "GET /compute/v2.1/servers/fef25575-f211-4db2-8c1f-e1cd8e73e69d" status: 200 len: 1266 microversion: 2.1 time: 0.158661 Aug 24 11:41:25.771575 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 421/894] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:41:25 2022] GET /compute/v2.1/servers/fef25575-f211-4db2-8c1f-e1cd8e73e69d => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:41:25.790751 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-12af987a-72fa-44c6-ac9b-adfb26f949d6 tempest-VolumesSnapshotsTestJSON-1946888255 tempest-VolumesSnapshotsTestJSON-1946888255-project] 10.222.0.84 "GET /compute/v2.1/os-snapshots/4a66a9c9-724c-4423-8873-77db869acf2f" status: 200 len: 286 microversion: 2.1 time: 0.036209 Aug 24 11:41:25.791316 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 474/895] 10.222.0.84 () {58 vars in 1251 bytes} [Wed Aug 24 11:41:25 2022] GET /compute/v2.1/os-snapshots/4a66a9c9-724c-4423-8873-77db869acf2f => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:41:26.791854 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-3ead72e2-4527-4d70-b04c-377d322bd70f tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:41:26.792442 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-3ead72e2-4527-4d70-b04c-377d322bd70f tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] [instance: fef25575-f211-4db2-8c1f-e1cd8e73e69d] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:41:26.799526 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-3ead72e2-4527-4d70-b04c-377d322bd70f tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:26.800010 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-3ead72e2-4527-4d70-b04c-377d322bd70f tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:26.800450 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-3ead72e2-4527-4d70-b04c-377d322bd70f tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:26.801169 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-3ead72e2-4527-4d70-b04c-377d322bd70f tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:26.801291 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG dbcounter [-] [124769] Writing DB stats nova_cell0:SELECT=2 {{(pid=124769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:41:26.801695 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-3ead72e2-4527-4d70-b04c-377d322bd70f tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:26.802031 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-3ead72e2-4527-4d70-b04c-377d322bd70f tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:26.806206 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-9ca1ac51-7af8-40d9-882e-7c861e3f0cfe tempest-VolumesSnapshotsTestJSON-1946888255 tempest-VolumesSnapshotsTestJSON-1946888255-project] Calling method '.version_select at 0x7f0e2a4e7c10>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:41:26.812691 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG dbcounter [-] [124769] Writing DB stats nova_cell0:SELECT=6 {{(pid=124769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:41:26.838029 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-9ca1ac51-7af8-40d9-882e-7c861e3f0cfe tempest-VolumesSnapshotsTestJSON-1946888255 tempest-VolumesSnapshotsTestJSON-1946888255-project] 10.222.0.84 "GET /compute/v2.1/os-snapshots/4a66a9c9-724c-4423-8873-77db869acf2f" status: 200 len: 286 microversion: 2.1 time: 0.038102 Aug 24 11:41:26.838599 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 475/896] 10.222.0.84 () {58 vars in 1251 bytes} [Wed Aug 24 11:41:26 2022] GET /compute/v2.1/os-snapshots/4a66a9c9-724c-4423-8873-77db869acf2f => generated 286 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:41:26.933845 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-3ead72e2-4527-4d70-b04c-377d322bd70f tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b82b6f568bd41fa9d6b44facb766e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ef3fc15a0147e39228729d2b5b2631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:41:26.941525 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-3ead72e2-4527-4d70-b04c-377d322bd70f tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] 10.222.0.84 "GET /compute/v2.1/servers/fef25575-f211-4db2-8c1f-e1cd8e73e69d" status: 200 len: 1266 microversion: 2.1 time: 0.153591 Aug 24 11:41:26.942084 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 422/897] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:41:26 2022] GET /compute/v2.1/servers/fef25575-f211-4db2-8c1f-e1cd8e73e69d => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:41:27.851336 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-9cf92fde-1eb1-4e4d-9329-204dab139ac0 tempest-VolumesSnapshotsTestJSON-1946888255 tempest-VolumesSnapshotsTestJSON-1946888255-project] Calling method '.version_select at 0x7f0e2a4810d0>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:41:27.883000 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-9cf92fde-1eb1-4e4d-9329-204dab139ac0 tempest-VolumesSnapshotsTestJSON-1946888255 tempest-VolumesSnapshotsTestJSON-1946888255-project] 10.222.0.84 "GET /compute/v2.1/os-snapshots/4a66a9c9-724c-4423-8873-77db869acf2f" status: 200 len: 287 microversion: 2.1 time: 0.036175 Aug 24 11:41:27.883571 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 476/898] 10.222.0.84 () {58 vars in 1251 bytes} [Wed Aug 24 11:41:27 2022] GET /compute/v2.1/os-snapshots/4a66a9c9-724c-4423-8873-77db869acf2f => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:41:27.895843 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-6edb821b-3f1d-4c16-8082-6922df698d7e tempest-VolumesSnapshotsTestJSON-1946888255 tempest-VolumesSnapshotsTestJSON-1946888255-project] Calling method '.version_select at 0x7f0e2ee18e50>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:41:27.902429 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_cell0:SELECT=2 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:41:27.963965 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-0f6e2a46-edae-437f-91c3-919d842f53fe tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:41:27.965309 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-0f6e2a46-edae-437f-91c3-919d842f53fe tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] [instance: fef25575-f211-4db2-8c1f-e1cd8e73e69d] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:41:27.975705 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-0f6e2a46-edae-437f-91c3-919d842f53fe tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:27.976358 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-0f6e2a46-edae-437f-91c3-919d842f53fe tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:27.976651 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-0f6e2a46-edae-437f-91c3-919d842f53fe tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:27.977389 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-0f6e2a46-edae-437f-91c3-919d842f53fe tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:27.977850 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-0f6e2a46-edae-437f-91c3-919d842f53fe tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:27.978280 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-0f6e2a46-edae-437f-91c3-919d842f53fe tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:28.070677 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-6edb821b-3f1d-4c16-8082-6922df698d7e tempest-VolumesSnapshotsTestJSON-1946888255 tempest-VolumesSnapshotsTestJSON-1946888255-project] 10.222.0.84 "DELETE /compute/v2.1/os-snapshots/4a66a9c9-724c-4423-8873-77db869acf2f" status: 202 len: 0 microversion: 2.1 time: 0.179394 Aug 24 11:41:28.071277 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 423/899] 10.222.0.84 () {58 vars in 1254 bytes} [Wed Aug 24 11:41:27 2022] DELETE /compute/v2.1/os-snapshots/4a66a9c9-724c-4423-8873-77db869acf2f => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 11:41:28.079920 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-0df43794-b010-4b1e-9464-efea87d7a6b9 tempest-VolumesSnapshotsTestJSON-1946888255 tempest-VolumesSnapshotsTestJSON-1946888255-project] Calling method '.version_select at 0x7f0e2ed89ee0>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:41:28.128835 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-0df43794-b010-4b1e-9464-efea87d7a6b9 tempest-VolumesSnapshotsTestJSON-1946888255 tempest-VolumesSnapshotsTestJSON-1946888255-project] 10.222.0.84 "GET /compute/v2.1/os-snapshots/4a66a9c9-724c-4423-8873-77db869acf2f" status: 200 len: 286 microversion: 2.1 time: 0.052880 Aug 24 11:41:28.129409 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 424/900] 10.222.0.84 () {58 vars in 1251 bytes} [Wed Aug 24 11:41:28 2022] GET /compute/v2.1/os-snapshots/4a66a9c9-724c-4423-8873-77db869acf2f => generated 286 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:41:28.132396 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-0f6e2a46-edae-437f-91c3-919d842f53fe tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b82b6f568bd41fa9d6b44facb766e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ef3fc15a0147e39228729d2b5b2631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:41:28.141746 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-0f6e2a46-edae-437f-91c3-919d842f53fe tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] 10.222.0.84 "GET /compute/v2.1/servers/fef25575-f211-4db2-8c1f-e1cd8e73e69d" status: 200 len: 1266 microversion: 2.1 time: 0.182545 Aug 24 11:41:28.142170 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 477/901] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:41:27 2022] GET /compute/v2.1/servers/fef25575-f211-4db2-8c1f-e1cd8e73e69d => generated 1266 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:41:28.636225 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-a4b204fc-c312-457c-b5af-5f86a2293757 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:41:28.638569 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-a4b204fc-c312-457c-b5af-5f86a2293757 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] [instance: 15d4a46e-9504-4897-918d-39aafc20d22a] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:41:28.645727 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a4b204fc-c312-457c-b5af-5f86a2293757 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:28.648022 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a4b204fc-c312-457c-b5af-5f86a2293757 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:28.648022 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a4b204fc-c312-457c-b5af-5f86a2293757 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:28.648022 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a4b204fc-c312-457c-b5af-5f86a2293757 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:28.648022 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a4b204fc-c312-457c-b5af-5f86a2293757 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:28.648348 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a4b204fc-c312-457c-b5af-5f86a2293757 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:28.682295 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-a4b204fc-c312-457c-b5af-5f86a2293757 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] 10.222.0.84 "GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049977 Aug 24 11:41:28.682992 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 425/902] 10.222.0.84 () {58 vars in 1302 bytes} [Wed Aug 24 11:41:28 2022] GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 11:41:28.756209 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-ba86da5e-7c40-4805-b970-e2fa5a2eca45 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:41:28.756713 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-ba86da5e-7c40-4805-b970-e2fa5a2eca45 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] [instance: 15d4a46e-9504-4897-918d-39aafc20d22a] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:41:28.762959 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-ba86da5e-7c40-4805-b970-e2fa5a2eca45 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:28.763555 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-ba86da5e-7c40-4805-b970-e2fa5a2eca45 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:28.763953 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-ba86da5e-7c40-4805-b970-e2fa5a2eca45 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:28.764652 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-ba86da5e-7c40-4805-b970-e2fa5a2eca45 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:28.765256 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-ba86da5e-7c40-4805-b970-e2fa5a2eca45 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:28.765709 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-ba86da5e-7c40-4805-b970-e2fa5a2eca45 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:28.795651 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-ba86da5e-7c40-4805-b970-e2fa5a2eca45 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] [instance: 15d4a46e-9504-4897-918d-39aafc20d22a] Going to try to terminate instance {{(pid=124769) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 11:41:28.824325 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG dbcounter [-] [124769] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:41:29.143432 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-5756e73d-eac5-4f47-92da-c6d2051b4f80 tempest-VolumesSnapshotsTestJSON-1946888255 tempest-VolumesSnapshotsTestJSON-1946888255-project] Calling method '.version_select at 0x7f0e2ed891f0>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:41:29.170489 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.wsgi [None req-5756e73d-eac5-4f47-92da-c6d2051b4f80 tempest-VolumesSnapshotsTestJSON-1946888255 tempest-VolumesSnapshotsTestJSON-1946888255-project] HTTP exception thrown: Snapshot 4a66a9c9-724c-4423-8873-77db869acf2f could not be found. Aug 24 11:41:29.173223 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-5756e73d-eac5-4f47-92da-c6d2051b4f80 tempest-VolumesSnapshotsTestJSON-1946888255 tempest-VolumesSnapshotsTestJSON-1946888255-project] Request method failure captured: Aug 24 11:41:29.173223 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: request: GET /compute/v2.1/os-snapshots/4a66a9c9-724c-4423-8873-77db869acf2f HTTP/1.1 Aug 24 11:41:29.173223 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Accept: application/json Aug 24 11:41:29.173223 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Accept-Encoding: identity Aug 24 11:41:29.173223 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Connection: close Aug 24 11:41:29.173223 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Content-Length: 0 Aug 24 11:41:29.173223 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Content-Type: application/json Aug 24 11:41:29.173223 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Host: 10.222.0.84 Aug 24 11:41:29.173223 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Openstack-System-Scope: None Aug 24 11:41:29.173223 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: User-Agent: python-urllib3/1.26.11 Aug 24 11:41:29.173223 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Auth-Token: gAAAAABjBg5ee6-kNBQgoc6R4F_WOrXQZvXQe8VCpQtoVEIWDw3Ed5E30duyeb90eDNoH9eLaJsrSflWn4_DR83qEBy135I0ajnvXOQHlOK0_eBdeAMvi5eDQqNRhSalZ84SDdRehoECwplNgHoHyxNLk1icvyqUwdroxgrCNsiCiCRFWwm7ocE Aug 24 11:41:29.173223 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Domain-Id: None Aug 24 11:41:29.173223 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Domain-Name: None Aug 24 11:41:29.173223 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Identity-Status: Confirmed Aug 24 11:41:29.173223 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Is-Admin-Project: True Aug 24 11:41:29.173223 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Project-Domain-Id: default Aug 24 11:41:29.173223 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Project-Domain-Name: Default Aug 24 11:41:29.173223 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Project-Id: 94ddc47b253841f6911e0368833b7d52 Aug 24 11:41:29.173223 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1946888255 Aug 24 11:41:29.173223 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Role: reader,member Aug 24 11:41:29.173223 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Roles: reader,member Aug 24 11:41:29.175228 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/volume/v3/94ddc47b253841f6911e0368833b7d52"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/volume/v3/94ddc47b253841f6911e0368833b7d52"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/compute/v2/94ddc47b253841f6911e0368833b7d52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84:8080/v1/AUTH_94ddc47b253841f6911e0368833b7d52", "adminURL": "http://10.222.0.84:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/placement"}]}] Aug 24 11:41:29.175228 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1946888255 Aug 24 11:41:29.175228 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Tenant-Id: 94ddc47b253841f6911e0368833b7d52 Aug 24 11:41:29.175228 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1946888255 Aug 24 11:41:29.175228 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User: tempest-VolumesSnapshotsTestJSON-1946888255-project Aug 24 11:41:29.175228 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User-Domain-Id: default Aug 24 11:41:29.175228 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User-Domain-Name: Default Aug 24 11:41:29.175228 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User-Id: 49baa99380cf4acba2240bbd9486b0ab Aug 24 11:41:29.175228 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1946888255-project Aug 24 11:41:29.175228 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: method: Aug 24 11:41:29.175228 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: exception: Snapshot 4a66a9c9-724c-4423-8873-77db869acf2f could not be found. Aug 24 11:41:29.175228 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: action_args: {'id': '4a66a9c9-724c-4423-8873-77db869acf2f'} Aug 24 11:41:29.175228 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:41:29.179687 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:41:29.179687 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 24 11:41:29.179687 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 24 11:41:29.179687 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 24 11:41:29.179687 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 24 11:41:29.179687 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 24 11:41:29.179687 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 24 11:41:29.179687 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 11:41:29.179687 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 11:41:29.179687 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 11:41:29.179687 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 11:41:29.179687 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 11:41:29.179687 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 11:41:29.179687 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 11:41:29.179687 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 11:41:29.179687 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 4a66a9c9-724c-4423-8873-77db869acf2f could not be found. (HTTP 404) (Request-ID: req-800be1db-4692-41b4-b0da-caaef0fd8d77) Aug 24 11:41:29.179687 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:41:29.179687 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:41:29.181259 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:41:29.181259 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:41:29.181259 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 24 11:41:29.181259 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 24 11:41:29.181259 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 11:41:29.181259 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 11:41:29.181259 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 24 11:41:29.181259 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 24 11:41:29.181259 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 11:41:29.181259 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 11:41:29.181259 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 24 11:41:29.181259 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 24 11:41:29.181259 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 24 11:41:29.181259 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 24 11:41:29.181259 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 24 11:41:29.181259 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 24 11:41:29.181259 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 11:41:29.181259 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 11:41:29.181259 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 11:41:29.183013 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 11:41:29.183013 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 11:41:29.183013 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 11:41:29.183013 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 11:41:29.183013 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 11:41:29.183013 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 4a66a9c9-724c-4423-8873-77db869acf2f could not be found. Aug 24 11:41:29.183013 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:41:29.183013 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:41:29.183013 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:41:29.183013 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:41:29.183013 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:41:29.183013 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:41:29.183013 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:41:29.183013 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:41:29.183013 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 11:41:29.183013 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 11:41:29.183013 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:41:29.183013 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:41:29.183013 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 24 11:41:29.183013 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:41:29.184418 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 4a66a9c9-724c-4423-8873-77db869acf2f could not be found. Aug 24 11:41:29.184418 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:41:29.184418 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:41:29.184418 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:41:29.184418 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:41:29.184418 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:41:29.184418 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:41:29.184418 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:41:29.184418 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:41:29.184418 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 4a66a9c9-724c-4423-8873-77db869acf2f could not be found. Aug 24 11:41:29.184418 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:41:29.184418 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-5756e73d-eac5-4f47-92da-c6d2051b4f80 tempest-VolumesSnapshotsTestJSON-1946888255 tempest-VolumesSnapshotsTestJSON-1946888255-project] Returning 404 to user: Snapshot 4a66a9c9-724c-4423-8873-77db869acf2f could not be found. {{(pid=124770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:41:29.184418 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-5756e73d-eac5-4f47-92da-c6d2051b4f80 tempest-VolumesSnapshotsTestJSON-1946888255 tempest-VolumesSnapshotsTestJSON-1946888255-project] 10.222.0.84 "GET /compute/v2.1/os-snapshots/4a66a9c9-724c-4423-8873-77db869acf2f" status: 404 len: 111 microversion: 2.1 time: 0.036505 Aug 24 11:41:29.185464 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 426/903] 10.222.0.84 () {58 vars in 1251 bytes} [Wed Aug 24 11:41:29 2022] GET /compute/v2.1/os-snapshots/4a66a9c9-724c-4423-8873-77db869acf2f => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 11:41:29.185464 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-a55f045d-c283-4f6a-8af7-1fc09730fab0 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:41:29.185464 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-a55f045d-c283-4f6a-8af7-1fc09730fab0 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] [instance: fef25575-f211-4db2-8c1f-e1cd8e73e69d] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:41:29.187961 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a55f045d-c283-4f6a-8af7-1fc09730fab0 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:29.189028 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a55f045d-c283-4f6a-8af7-1fc09730fab0 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:29.189462 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a55f045d-c283-4f6a-8af7-1fc09730fab0 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:29.190253 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a55f045d-c283-4f6a-8af7-1fc09730fab0 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:29.190705 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a55f045d-c283-4f6a-8af7-1fc09730fab0 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:29.191128 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a55f045d-c283-4f6a-8af7-1fc09730fab0 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:29.229707 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-ba86da5e-7c40-4805-b970-e2fa5a2eca45 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] 10.222.0.84 "DELETE /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a" status: 204 len: 0 microversion: 2.1 time: 0.476913 Aug 24 11:41:29.232107 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 478/904] 10.222.0.84 () {58 vars in 1239 bytes} [Wed Aug 24 11:41:28 2022] DELETE /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a => generated 0 bytes in 479 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 11:41:29.236100 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-67d7ee52-ea3f-45fd-84e6-44f1905b378c tempest-VolumesSnapshotsTestJSON-1946888255 tempest-VolumesSnapshotsTestJSON-1946888255-project] Calling method '.version_select at 0x7f0e2a481820>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:41:29.341205 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-a55f045d-c283-4f6a-8af7-1fc09730fab0 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b82b6f568bd41fa9d6b44facb766e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ef3fc15a0147e39228729d2b5b2631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:41:29.350168 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-a55f045d-c283-4f6a-8af7-1fc09730fab0 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] 10.222.0.84 "GET /compute/v2.1/servers/fef25575-f211-4db2-8c1f-e1cd8e73e69d" status: 200 len: 1266 microversion: 2.1 time: 0.173393 Aug 24 11:41:29.350752 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 427/905] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:41:29 2022] GET /compute/v2.1/servers/fef25575-f211-4db2-8c1f-e1cd8e73e69d => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:41:29.355221 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-ed39aa6e-b2fb-4f19-a554-ed3772202189 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:41:29.355838 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-ed39aa6e-b2fb-4f19-a554-ed3772202189 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] [instance: 15d4a46e-9504-4897-918d-39aafc20d22a] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:41:29.363070 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ed39aa6e-b2fb-4f19-a554-ed3772202189 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:29.363619 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ed39aa6e-b2fb-4f19-a554-ed3772202189 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:29.364062 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ed39aa6e-b2fb-4f19-a554-ed3772202189 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:29.364769 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ed39aa6e-b2fb-4f19-a554-ed3772202189 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:29.365302 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ed39aa6e-b2fb-4f19-a554-ed3772202189 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:29.365727 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ed39aa6e-b2fb-4f19-a554-ed3772202189 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:29.515089 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-67d7ee52-ea3f-45fd-84e6-44f1905b378c tempest-VolumesSnapshotsTestJSON-1946888255 tempest-VolumesSnapshotsTestJSON-1946888255-project] 10.222.0.84 "DELETE /compute/v2.1/os-volumes/921179c6-51fd-4835-a3e8-6a6361cf8ca0" status: 202 len: 0 microversion: 2.1 time: 0.283561 Aug 24 11:41:29.515748 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 479/906] 10.222.0.84 () {58 vars in 1248 bytes} [Wed Aug 24 11:41:29 2022] DELETE /compute/v2.1/os-volumes/921179c6-51fd-4835-a3e8-6a6361cf8ca0 => generated 0 bytes in 285 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:41:29.520395 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-ed39aa6e-b2fb-4f19-a554-ed3772202189 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031939e16194f63b99e6f27f700fa8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecec6d0c155f4d658197c4779ab9ffce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:41:29.524689 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-8ca642ee-87e2-4552-9a7c-678890d24a09 tempest-VolumesSnapshotsTestJSON-1946888255 tempest-VolumesSnapshotsTestJSON-1946888255-project] Calling method '.version_select at 0x7f0e2a594c10>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:41:29.529775 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-ed39aa6e-b2fb-4f19-a554-ed3772202189 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] 10.222.0.84 "GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a" status: 200 len: 1673 microversion: 2.1 time: 0.177937 Aug 24 11:41:29.530459 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 428/907] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:41:29 2022] GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a => generated 1673 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:41:29.576882 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-8ca642ee-87e2-4552-9a7c-678890d24a09 tempest-VolumesSnapshotsTestJSON-1946888255 tempest-VolumesSnapshotsTestJSON-1946888255-project] 10.222.0.84 "GET /compute/v2.1/os-volumes/921179c6-51fd-4835-a3e8-6a6361cf8ca0" status: 200 len: 344 microversion: 2.1 time: 0.055997 Aug 24 11:41:29.577523 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 480/908] 10.222.0.84 () {58 vars in 1245 bytes} [Wed Aug 24 11:41:29 2022] GET /compute/v2.1/os-volumes/921179c6-51fd-4835-a3e8-6a6361cf8ca0 => generated 344 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:41:30.378396 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-df1c3a20-8125-42ec-b05f-e8621399525c tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:41:30.379494 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-df1c3a20-8125-42ec-b05f-e8621399525c tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] [instance: fef25575-f211-4db2-8c1f-e1cd8e73e69d] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:41:30.389086 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-df1c3a20-8125-42ec-b05f-e8621399525c tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:30.389569 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-df1c3a20-8125-42ec-b05f-e8621399525c tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:30.390004 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-df1c3a20-8125-42ec-b05f-e8621399525c tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:30.390784 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-df1c3a20-8125-42ec-b05f-e8621399525c tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:30.391237 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-df1c3a20-8125-42ec-b05f-e8621399525c tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:30.392606 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-df1c3a20-8125-42ec-b05f-e8621399525c tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:30.533203 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-df1c3a20-8125-42ec-b05f-e8621399525c tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b82b6f568bd41fa9d6b44facb766e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ef3fc15a0147e39228729d2b5b2631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:41:30.541299 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-df1c3a20-8125-42ec-b05f-e8621399525c tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] 10.222.0.84 "GET /compute/v2.1/servers/fef25575-f211-4db2-8c1f-e1cd8e73e69d" status: 200 len: 1266 microversion: 2.1 time: 0.170996 Aug 24 11:41:30.541893 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 429/909] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:41:30 2022] GET /compute/v2.1/servers/fef25575-f211-4db2-8c1f-e1cd8e73e69d => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:41:30.556176 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-25508335-0e5e-48c5-afb0-61989d8dbbff tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:41:30.556914 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-25508335-0e5e-48c5-afb0-61989d8dbbff tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] [instance: 15d4a46e-9504-4897-918d-39aafc20d22a] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:41:30.564616 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-25508335-0e5e-48c5-afb0-61989d8dbbff tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:30.564891 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-25508335-0e5e-48c5-afb0-61989d8dbbff tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:30.569814 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-25508335-0e5e-48c5-afb0-61989d8dbbff tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:30.569814 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-25508335-0e5e-48c5-afb0-61989d8dbbff tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:30.569814 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-25508335-0e5e-48c5-afb0-61989d8dbbff tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:30.569814 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-25508335-0e5e-48c5-afb0-61989d8dbbff tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:30.597049 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-ff0cc1d6-dbaa-4505-824e-511034f55aa2 tempest-VolumesSnapshotsTestJSON-1946888255 tempest-VolumesSnapshotsTestJSON-1946888255-project] Calling method '.version_select at 0x7f0e2a4b04c0>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:41:30.633343 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.wsgi [None req-ff0cc1d6-dbaa-4505-824e-511034f55aa2 tempest-VolumesSnapshotsTestJSON-1946888255 tempest-VolumesSnapshotsTestJSON-1946888255-project] HTTP exception thrown: Volume 921179c6-51fd-4835-a3e8-6a6361cf8ca0 could not be found. Aug 24 11:41:30.635384 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-ff0cc1d6-dbaa-4505-824e-511034f55aa2 tempest-VolumesSnapshotsTestJSON-1946888255 tempest-VolumesSnapshotsTestJSON-1946888255-project] Request method failure captured: Aug 24 11:41:30.635384 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: request: GET /compute/v2.1/os-volumes/921179c6-51fd-4835-a3e8-6a6361cf8ca0 HTTP/1.1 Aug 24 11:41:30.635384 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Accept: application/json Aug 24 11:41:30.635384 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Accept-Encoding: identity Aug 24 11:41:30.635384 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Connection: close Aug 24 11:41:30.635384 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Content-Length: 0 Aug 24 11:41:30.635384 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Content-Type: application/json Aug 24 11:41:30.635384 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Host: 10.222.0.84 Aug 24 11:41:30.635384 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Openstack-System-Scope: None Aug 24 11:41:30.635384 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: User-Agent: python-urllib3/1.26.11 Aug 24 11:41:30.635384 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Auth-Token: gAAAAABjBg5ee6-kNBQgoc6R4F_WOrXQZvXQe8VCpQtoVEIWDw3Ed5E30duyeb90eDNoH9eLaJsrSflWn4_DR83qEBy135I0ajnvXOQHlOK0_eBdeAMvi5eDQqNRhSalZ84SDdRehoECwplNgHoHyxNLk1icvyqUwdroxgrCNsiCiCRFWwm7ocE Aug 24 11:41:30.635384 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Domain-Id: None Aug 24 11:41:30.635384 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Domain-Name: None Aug 24 11:41:30.635384 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Identity-Status: Confirmed Aug 24 11:41:30.635384 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Is-Admin-Project: True Aug 24 11:41:30.635384 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Project-Domain-Id: default Aug 24 11:41:30.635384 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Project-Domain-Name: Default Aug 24 11:41:30.635384 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Project-Id: 94ddc47b253841f6911e0368833b7d52 Aug 24 11:41:30.635384 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1946888255 Aug 24 11:41:30.635384 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Role: reader,member Aug 24 11:41:30.635384 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Roles: reader,member Aug 24 11:41:30.637089 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/volume/v3/94ddc47b253841f6911e0368833b7d52"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/volume/v3/94ddc47b253841f6911e0368833b7d52"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/compute/v2/94ddc47b253841f6911e0368833b7d52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84:8080/v1/AUTH_94ddc47b253841f6911e0368833b7d52", "adminURL": "http://10.222.0.84:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/placement"}]}] Aug 24 11:41:30.637089 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1946888255 Aug 24 11:41:30.637089 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Tenant-Id: 94ddc47b253841f6911e0368833b7d52 Aug 24 11:41:30.637089 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1946888255 Aug 24 11:41:30.637089 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User: tempest-VolumesSnapshotsTestJSON-1946888255-project Aug 24 11:41:30.637089 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User-Domain-Id: default Aug 24 11:41:30.637089 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User-Domain-Name: Default Aug 24 11:41:30.637089 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User-Id: 49baa99380cf4acba2240bbd9486b0ab Aug 24 11:41:30.637089 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1946888255-project Aug 24 11:41:30.637089 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: method: Aug 24 11:41:30.637089 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: exception: Volume 921179c6-51fd-4835-a3e8-6a6361cf8ca0 could not be found. Aug 24 11:41:30.637089 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: action_args: {'id': '921179c6-51fd-4835-a3e8-6a6361cf8ca0'} Aug 24 11:41:30.637089 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:41:30.637895 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:41:30.637895 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 11:41:30.637895 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 11:41:30.637895 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 11:41:30.637895 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 11:41:30.637895 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 11:41:30.637895 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 11:41:30.637895 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 11:41:30.637895 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 11:41:30.637895 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 11:41:30.637895 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 11:41:30.637895 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 11:41:30.637895 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 11:41:30.637895 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 11:41:30.637895 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 11:41:30.637895 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 921179c6-51fd-4835-a3e8-6a6361cf8ca0 could not be found. (HTTP 404) (Request-ID: req-4f5cb3f5-3cd4-4f63-9bba-9e6224128af3) Aug 24 11:41:30.637895 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:41:30.637895 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:41:30.637895 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:41:30.639040 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:41:30.639040 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 11:41:30.639040 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 11:41:30.639040 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 11:41:30.639040 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 11:41:30.639040 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 11:41:30.639040 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 11:41:30.639040 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 11:41:30.639040 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 11:41:30.639040 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 11:41:30.639040 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 11:41:30.639040 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 11:41:30.639040 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 11:41:30.639040 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 11:41:30.639040 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 11:41:30.639040 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 11:41:30.639040 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 11:41:30.639040 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 11:41:30.639040 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 11:41:30.640763 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 11:41:30.640763 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 11:41:30.640763 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 11:41:30.640763 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 11:41:30.640763 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 921179c6-51fd-4835-a3e8-6a6361cf8ca0 could not be found. Aug 24 11:41:30.640763 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:41:30.640763 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:41:30.640763 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:41:30.640763 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:41:30.640763 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:41:30.640763 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:41:30.640763 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:41:30.640763 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:41:30.640763 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 11:41:30.640763 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 11:41:30.640763 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:41:30.640763 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:41:30.640763 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 11:41:30.640763 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:41:30.643225 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 921179c6-51fd-4835-a3e8-6a6361cf8ca0 could not be found. Aug 24 11:41:30.643225 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:41:30.643225 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:41:30.643225 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:41:30.643225 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:41:30.643225 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:41:30.643225 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:41:30.643225 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:41:30.643225 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:41:30.643225 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 921179c6-51fd-4835-a3e8-6a6361cf8ca0 could not be found. Aug 24 11:41:30.643225 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:41:30.643225 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-ff0cc1d6-dbaa-4505-824e-511034f55aa2 tempest-VolumesSnapshotsTestJSON-1946888255 tempest-VolumesSnapshotsTestJSON-1946888255-project] Returning 404 to user: Volume 921179c6-51fd-4835-a3e8-6a6361cf8ca0 could not be found. {{(pid=124770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:41:30.643225 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-ff0cc1d6-dbaa-4505-824e-511034f55aa2 tempest-VolumesSnapshotsTestJSON-1946888255 tempest-VolumesSnapshotsTestJSON-1946888255-project] 10.222.0.84 "GET /compute/v2.1/os-volumes/921179c6-51fd-4835-a3e8-6a6361cf8ca0" status: 404 len: 109 microversion: 2.1 time: 0.046644 Aug 24 11:41:30.643225 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 430/910] 10.222.0.84 () {58 vars in 1245 bytes} [Wed Aug 24 11:41:30 2022] GET /compute/v2.1/os-volumes/921179c6-51fd-4835-a3e8-6a6361cf8ca0 => generated 109 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:41:30.660202 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-2d53edd1-94a0-4468-afae-9a89d32c8b03 tempest-VolumesSnapshotsTestJSON-1946888255 tempest-VolumesSnapshotsTestJSON-1946888255-project] Calling method '.version_select at 0x7f0e2ed89670>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:41:30.694682 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.wsgi [None req-2d53edd1-94a0-4468-afae-9a89d32c8b03 tempest-VolumesSnapshotsTestJSON-1946888255 tempest-VolumesSnapshotsTestJSON-1946888255-project] HTTP exception thrown: Volume 921179c6-51fd-4835-a3e8-6a6361cf8ca0 could not be found. Aug 24 11:41:30.696645 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-2d53edd1-94a0-4468-afae-9a89d32c8b03 tempest-VolumesSnapshotsTestJSON-1946888255 tempest-VolumesSnapshotsTestJSON-1946888255-project] Request method failure captured: Aug 24 11:41:30.696645 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: request: DELETE /compute/v2.1/os-volumes/921179c6-51fd-4835-a3e8-6a6361cf8ca0 HTTP/1.1 Aug 24 11:41:30.696645 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Accept: application/json Aug 24 11:41:30.696645 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Accept-Encoding: identity Aug 24 11:41:30.696645 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Connection: close Aug 24 11:41:30.696645 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Content-Length: 0 Aug 24 11:41:30.696645 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Content-Type: application/json Aug 24 11:41:30.696645 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Host: 10.222.0.84 Aug 24 11:41:30.696645 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Openstack-System-Scope: None Aug 24 11:41:30.696645 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: User-Agent: python-urllib3/1.26.11 Aug 24 11:41:30.696645 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Auth-Token: gAAAAABjBg5ee6-kNBQgoc6R4F_WOrXQZvXQe8VCpQtoVEIWDw3Ed5E30duyeb90eDNoH9eLaJsrSflWn4_DR83qEBy135I0ajnvXOQHlOK0_eBdeAMvi5eDQqNRhSalZ84SDdRehoECwplNgHoHyxNLk1icvyqUwdroxgrCNsiCiCRFWwm7ocE Aug 24 11:41:30.696645 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Domain-Id: None Aug 24 11:41:30.696645 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Domain-Name: None Aug 24 11:41:30.696645 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Identity-Status: Confirmed Aug 24 11:41:30.696645 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Is-Admin-Project: True Aug 24 11:41:30.696645 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Project-Domain-Id: default Aug 24 11:41:30.696645 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Project-Domain-Name: Default Aug 24 11:41:30.696645 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Project-Id: 94ddc47b253841f6911e0368833b7d52 Aug 24 11:41:30.696645 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1946888255 Aug 24 11:41:30.696645 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Role: reader,member Aug 24 11:41:30.696645 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Roles: reader,member Aug 24 11:41:30.698274 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/volume/v3/94ddc47b253841f6911e0368833b7d52"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/volume/v3/94ddc47b253841f6911e0368833b7d52"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/compute/v2/94ddc47b253841f6911e0368833b7d52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84:8080/v1/AUTH_94ddc47b253841f6911e0368833b7d52", "adminURL": "http://10.222.0.84:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/placement"}]}] Aug 24 11:41:30.698274 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1946888255 Aug 24 11:41:30.698274 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Tenant-Id: 94ddc47b253841f6911e0368833b7d52 Aug 24 11:41:30.698274 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1946888255 Aug 24 11:41:30.698274 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User: tempest-VolumesSnapshotsTestJSON-1946888255-project Aug 24 11:41:30.698274 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User-Domain-Id: default Aug 24 11:41:30.698274 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User-Domain-Name: Default Aug 24 11:41:30.698274 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User-Id: 49baa99380cf4acba2240bbd9486b0ab Aug 24 11:41:30.698274 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1946888255-project Aug 24 11:41:30.698274 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: method: Aug 24 11:41:30.698274 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: exception: Volume 921179c6-51fd-4835-a3e8-6a6361cf8ca0 could not be found. Aug 24 11:41:30.698274 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: action_args: {'id': '921179c6-51fd-4835-a3e8-6a6361cf8ca0'} Aug 24 11:41:30.698274 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:41:30.700066 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:41:30.700066 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 11:41:30.700066 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 11:41:30.700066 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 11:41:30.700066 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 11:41:30.700066 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 11:41:30.700066 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 11:41:30.700066 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 11:41:30.700066 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 11:41:30.700066 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 11:41:30.700066 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 11:41:30.700066 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 11:41:30.700066 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 11:41:30.700066 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 11:41:30.700066 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 11:41:30.700066 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 921179c6-51fd-4835-a3e8-6a6361cf8ca0 could not be found. (HTTP 404) (Request-ID: req-dc6c997e-01a3-4023-96c5-76cc0fa3a914) Aug 24 11:41:30.700066 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:41:30.700066 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:41:30.700066 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:41:30.702492 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:41:30.702492 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 24 11:41:30.702492 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 24 11:41:30.702492 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 11:41:30.702492 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 11:41:30.702492 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 11:41:30.702492 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 11:41:30.702492 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 11:41:30.702492 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 11:41:30.702492 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 11:41:30.702492 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 11:41:30.702492 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 11:41:30.702492 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 11:41:30.702492 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 11:41:30.702492 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 11:41:30.702492 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 11:41:30.702492 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 11:41:30.702492 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 11:41:30.702492 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 11:41:30.704580 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 11:41:30.704580 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 11:41:30.704580 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 11:41:30.704580 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 11:41:30.704580 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 921179c6-51fd-4835-a3e8-6a6361cf8ca0 could not be found. Aug 24 11:41:30.704580 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:41:30.704580 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:41:30.704580 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:41:30.704580 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:41:30.704580 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:41:30.704580 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:41:30.704580 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:41:30.704580 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:41:30.704580 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 11:41:30.704580 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 11:41:30.704580 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:41:30.704580 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:41:30.704580 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 24 11:41:30.704580 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:41:30.706012 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 921179c6-51fd-4835-a3e8-6a6361cf8ca0 could not be found. Aug 24 11:41:30.706012 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:41:30.706012 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:41:30.706012 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:41:30.706012 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:41:30.706012 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:41:30.706012 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:41:30.706012 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:41:30.706012 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:41:30.706012 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 921179c6-51fd-4835-a3e8-6a6361cf8ca0 could not be found. Aug 24 11:41:30.706012 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:41:30.706012 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-2d53edd1-94a0-4468-afae-9a89d32c8b03 tempest-VolumesSnapshotsTestJSON-1946888255 tempest-VolumesSnapshotsTestJSON-1946888255-project] Returning 404 to user: Volume 921179c6-51fd-4835-a3e8-6a6361cf8ca0 could not be found. {{(pid=124770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:41:30.706012 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-2d53edd1-94a0-4468-afae-9a89d32c8b03 tempest-VolumesSnapshotsTestJSON-1946888255 tempest-VolumesSnapshotsTestJSON-1946888255-project] 10.222.0.84 "DELETE /compute/v2.1/os-volumes/921179c6-51fd-4835-a3e8-6a6361cf8ca0" status: 404 len: 109 microversion: 2.1 time: 0.046181 Aug 24 11:41:30.706012 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 431/911] 10.222.0.84 () {58 vars in 1248 bytes} [Wed Aug 24 11:41:30 2022] DELETE /compute/v2.1/os-volumes/921179c6-51fd-4835-a3e8-6a6361cf8ca0 => generated 109 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:41:30.713433 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-07671f5e-116f-4bb7-9209-ef5d499003e9 tempest-VolumesSnapshotsTestJSON-1946888255 tempest-VolumesSnapshotsTestJSON-1946888255-project] Calling method '.version_select at 0x7f0e2ed89af0>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:41:30.716824 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-25508335-0e5e-48c5-afb0-61989d8dbbff tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031939e16194f63b99e6f27f700fa8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecec6d0c155f4d658197c4779ab9ffce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:41:30.725814 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-25508335-0e5e-48c5-afb0-61989d8dbbff tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] 10.222.0.84 "GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a" status: 200 len: 1673 microversion: 2.1 time: 0.176174 Aug 24 11:41:30.726401 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 481/912] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:41:30 2022] GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a => generated 1673 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:41:30.747397 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.wsgi [None req-07671f5e-116f-4bb7-9209-ef5d499003e9 tempest-VolumesSnapshotsTestJSON-1946888255 tempest-VolumesSnapshotsTestJSON-1946888255-project] HTTP exception thrown: Volume 921179c6-51fd-4835-a3e8-6a6361cf8ca0 could not be found. Aug 24 11:41:30.749771 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-07671f5e-116f-4bb7-9209-ef5d499003e9 tempest-VolumesSnapshotsTestJSON-1946888255 tempest-VolumesSnapshotsTestJSON-1946888255-project] Request method failure captured: Aug 24 11:41:30.749771 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: request: GET /compute/v2.1/os-volumes/921179c6-51fd-4835-a3e8-6a6361cf8ca0 HTTP/1.1 Aug 24 11:41:30.749771 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Accept: application/json Aug 24 11:41:30.749771 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Accept-Encoding: identity Aug 24 11:41:30.749771 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Connection: close Aug 24 11:41:30.749771 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Content-Length: 0 Aug 24 11:41:30.749771 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Content-Type: application/json Aug 24 11:41:30.749771 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Host: 10.222.0.84 Aug 24 11:41:30.749771 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Openstack-System-Scope: None Aug 24 11:41:30.749771 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: User-Agent: python-urllib3/1.26.11 Aug 24 11:41:30.749771 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Auth-Token: gAAAAABjBg5ee6-kNBQgoc6R4F_WOrXQZvXQe8VCpQtoVEIWDw3Ed5E30duyeb90eDNoH9eLaJsrSflWn4_DR83qEBy135I0ajnvXOQHlOK0_eBdeAMvi5eDQqNRhSalZ84SDdRehoECwplNgHoHyxNLk1icvyqUwdroxgrCNsiCiCRFWwm7ocE Aug 24 11:41:30.749771 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Domain-Id: None Aug 24 11:41:30.749771 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Domain-Name: None Aug 24 11:41:30.749771 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Identity-Status: Confirmed Aug 24 11:41:30.749771 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Is-Admin-Project: True Aug 24 11:41:30.749771 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Project-Domain-Id: default Aug 24 11:41:30.749771 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Project-Domain-Name: Default Aug 24 11:41:30.749771 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Project-Id: 94ddc47b253841f6911e0368833b7d52 Aug 24 11:41:30.749771 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1946888255 Aug 24 11:41:30.749771 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Role: reader,member Aug 24 11:41:30.749771 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Roles: reader,member Aug 24 11:41:30.751478 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/volume/v3/94ddc47b253841f6911e0368833b7d52"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/volume/v3/94ddc47b253841f6911e0368833b7d52"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/compute/v2/94ddc47b253841f6911e0368833b7d52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84:8080/v1/AUTH_94ddc47b253841f6911e0368833b7d52", "adminURL": "http://10.222.0.84:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/placement"}]}] Aug 24 11:41:30.751478 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1946888255 Aug 24 11:41:30.751478 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Tenant-Id: 94ddc47b253841f6911e0368833b7d52 Aug 24 11:41:30.751478 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1946888255 Aug 24 11:41:30.751478 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User: tempest-VolumesSnapshotsTestJSON-1946888255-project Aug 24 11:41:30.751478 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User-Domain-Id: default Aug 24 11:41:30.751478 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User-Domain-Name: Default Aug 24 11:41:30.751478 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User-Id: 49baa99380cf4acba2240bbd9486b0ab Aug 24 11:41:30.751478 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1946888255-project Aug 24 11:41:30.751478 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: method: Aug 24 11:41:30.751478 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: exception: Volume 921179c6-51fd-4835-a3e8-6a6361cf8ca0 could not be found. Aug 24 11:41:30.751478 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: action_args: {'id': '921179c6-51fd-4835-a3e8-6a6361cf8ca0'} Aug 24 11:41:30.751478 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:41:30.752310 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:41:30.752310 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 11:41:30.752310 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 11:41:30.752310 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 11:41:30.752310 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 11:41:30.752310 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 11:41:30.752310 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 11:41:30.752310 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 11:41:30.752310 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 11:41:30.752310 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 11:41:30.752310 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 11:41:30.752310 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 11:41:30.752310 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 11:41:30.752310 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 11:41:30.752310 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 11:41:30.752310 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 921179c6-51fd-4835-a3e8-6a6361cf8ca0 could not be found. (HTTP 404) (Request-ID: req-bcb45401-3966-4347-9882-d17895545b08) Aug 24 11:41:30.752310 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:41:30.752310 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:41:30.752310 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:41:30.753453 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:41:30.753453 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 11:41:30.753453 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 11:41:30.753453 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 11:41:30.753453 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 11:41:30.753453 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 11:41:30.753453 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 11:41:30.753453 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 11:41:30.753453 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 11:41:30.753453 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 11:41:30.753453 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 11:41:30.753453 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 11:41:30.753453 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 11:41:30.753453 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 11:41:30.753453 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 11:41:30.753453 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 11:41:30.753453 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 11:41:30.753453 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 11:41:30.753453 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 11:41:30.754580 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 11:41:30.754580 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 11:41:30.754580 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 11:41:30.754580 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 11:41:30.754580 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 921179c6-51fd-4835-a3e8-6a6361cf8ca0 could not be found. Aug 24 11:41:30.754580 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:41:30.754580 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:41:30.754580 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:41:30.754580 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:41:30.754580 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:41:30.754580 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:41:30.754580 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:41:30.754580 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:41:30.754580 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 11:41:30.754580 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 11:41:30.754580 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:41:30.754580 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:41:30.754580 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 11:41:30.754580 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:41:30.755709 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 921179c6-51fd-4835-a3e8-6a6361cf8ca0 could not be found. Aug 24 11:41:30.755709 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:41:30.755709 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:41:30.755709 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:41:30.755709 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:41:30.755709 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:41:30.755709 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:41:30.755709 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:41:30.755709 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:41:30.755709 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 921179c6-51fd-4835-a3e8-6a6361cf8ca0 could not be found. Aug 24 11:41:30.755709 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:41:30.755709 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-07671f5e-116f-4bb7-9209-ef5d499003e9 tempest-VolumesSnapshotsTestJSON-1946888255 tempest-VolumesSnapshotsTestJSON-1946888255-project] Returning 404 to user: Volume 921179c6-51fd-4835-a3e8-6a6361cf8ca0 could not be found. {{(pid=124770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:41:30.755709 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-07671f5e-116f-4bb7-9209-ef5d499003e9 tempest-VolumesSnapshotsTestJSON-1946888255 tempest-VolumesSnapshotsTestJSON-1946888255-project] 10.222.0.84 "GET /compute/v2.1/os-volumes/921179c6-51fd-4835-a3e8-6a6361cf8ca0" status: 404 len: 109 microversion: 2.1 time: 0.045197 Aug 24 11:41:30.755709 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 432/913] 10.222.0.84 () {58 vars in 1245 bytes} [Wed Aug 24 11:41:30 2022] GET /compute/v2.1/os-volumes/921179c6-51fd-4835-a3e8-6a6361cf8ca0 => generated 109 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:41:31.563023 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-41d175f2-d721-4f8a-9255-ec2aeaf6ab36 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:41:31.564469 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-41d175f2-d721-4f8a-9255-ec2aeaf6ab36 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] [instance: fef25575-f211-4db2-8c1f-e1cd8e73e69d] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:41:31.571446 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-41d175f2-d721-4f8a-9255-ec2aeaf6ab36 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:31.571934 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-41d175f2-d721-4f8a-9255-ec2aeaf6ab36 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:31.572367 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-41d175f2-d721-4f8a-9255-ec2aeaf6ab36 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:31.573083 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-41d175f2-d721-4f8a-9255-ec2aeaf6ab36 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:31.573533 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-41d175f2-d721-4f8a-9255-ec2aeaf6ab36 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:31.574159 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-41d175f2-d721-4f8a-9255-ec2aeaf6ab36 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:31.753378 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-41d175f2-d721-4f8a-9255-ec2aeaf6ab36 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b82b6f568bd41fa9d6b44facb766e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ef3fc15a0147e39228729d2b5b2631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:41:31.755072 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-ff5a2e57-cb44-4e19-a995-039472005941 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:41:31.755723 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-ff5a2e57-cb44-4e19-a995-039472005941 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] [instance: 15d4a46e-9504-4897-918d-39aafc20d22a] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:41:31.767578 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ff5a2e57-cb44-4e19-a995-039472005941 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:31.768325 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ff5a2e57-cb44-4e19-a995-039472005941 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:31.769130 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ff5a2e57-cb44-4e19-a995-039472005941 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:31.769477 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-41d175f2-d721-4f8a-9255-ec2aeaf6ab36 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] 10.222.0.84 "GET /compute/v2.1/servers/fef25575-f211-4db2-8c1f-e1cd8e73e69d" status: 200 len: 1266 microversion: 2.1 time: 0.210201 Aug 24 11:41:31.769988 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ff5a2e57-cb44-4e19-a995-039472005941 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:31.770463 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 482/914] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:41:31 2022] GET /compute/v2.1/servers/fef25575-f211-4db2-8c1f-e1cd8e73e69d => generated 1266 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:41:31.770764 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ff5a2e57-cb44-4e19-a995-039472005941 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:31.771293 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ff5a2e57-cb44-4e19-a995-039472005941 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:31.827041 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [req-9faaac92-8915-4f0a-9883-31c0ecf245c6 req-b5dad866-1be2-499f-af5d-7819815c81a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15d4a46e-9504-4897-918d-39aafc20d22a", "name": "network-vif-deleted", "tag": "a6afa636-0862-4c9f-9c7f-a90a8c528daa"}]} {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:41:31.841312 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [req-9faaac92-8915-4f0a-9883-31c0ecf245c6 req-b5dad866-1be2-499f-af5d-7819815c81a3 service nova] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:31.842141 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [req-9faaac92-8915-4f0a-9883-31c0ecf245c6 req-b5dad866-1be2-499f-af5d-7819815c81a3 service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:31.842773 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [req-9faaac92-8915-4f0a-9883-31c0ecf245c6 req-b5dad866-1be2-499f-af5d-7819815c81a3 service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:31.861354 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.compute.server_external_events [req-9faaac92-8915-4f0a-9883-31c0ecf245c6 req-b5dad866-1be2-499f-af5d-7819815c81a3 service nova] Creating event network-vif-deleted:a6afa636-0862-4c9f-9c7f-a90a8c528daa for instance 15d4a46e-9504-4897-918d-39aafc20d22a on hv-cinder-85427 Aug 24 11:41:31.870614 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [req-9faaac92-8915-4f0a-9883-31c0ecf245c6 req-b5dad866-1be2-499f-af5d-7819815c81a3 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050024 Aug 24 11:41:31.871532 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 483/915] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Aug 24 11:41:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:41:31.873784 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-ff5a2e57-cb44-4e19-a995-039472005941 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031939e16194f63b99e6f27f700fa8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecec6d0c155f4d658197c4779ab9ffce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:41:31.885826 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-ff5a2e57-cb44-4e19-a995-039472005941 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] 10.222.0.84 "GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a" status: 200 len: 1605 microversion: 2.1 time: 0.141176 Aug 24 11:41:31.886411 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 433/916] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:41:31 2022] GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a => generated 1605 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:41:32.802916 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-208e14ac-764b-4c37-9775-bde3652aac08 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:41:32.803861 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-208e14ac-764b-4c37-9775-bde3652aac08 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] [instance: fef25575-f211-4db2-8c1f-e1cd8e73e69d] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:41:32.811186 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-208e14ac-764b-4c37-9775-bde3652aac08 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:32.811944 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-208e14ac-764b-4c37-9775-bde3652aac08 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:32.812376 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-208e14ac-764b-4c37-9775-bde3652aac08 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:32.813953 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-208e14ac-764b-4c37-9775-bde3652aac08 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:32.814951 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-208e14ac-764b-4c37-9775-bde3652aac08 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:32.815387 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-208e14ac-764b-4c37-9775-bde3652aac08 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:32.914720 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-383dbff8-d94e-4543-9ef3-f35183ff2fa6 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:41:32.915436 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-383dbff8-d94e-4543-9ef3-f35183ff2fa6 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] [instance: 15d4a46e-9504-4897-918d-39aafc20d22a] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:41:32.928043 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-383dbff8-d94e-4543-9ef3-f35183ff2fa6 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:32.928840 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-383dbff8-d94e-4543-9ef3-f35183ff2fa6 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:32.929503 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-383dbff8-d94e-4543-9ef3-f35183ff2fa6 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:32.930209 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-383dbff8-d94e-4543-9ef3-f35183ff2fa6 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:32.932124 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-383dbff8-d94e-4543-9ef3-f35183ff2fa6 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:32.932859 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-383dbff8-d94e-4543-9ef3-f35183ff2fa6 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:32.972541 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-383dbff8-d94e-4543-9ef3-f35183ff2fa6 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:32.973205 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-383dbff8-d94e-4543-9ef3-f35183ff2fa6 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:32.973390 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-208e14ac-764b-4c37-9775-bde3652aac08 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b82b6f568bd41fa9d6b44facb766e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ef3fc15a0147e39228729d2b5b2631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:41:32.973636 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-383dbff8-d94e-4543-9ef3-f35183ff2fa6 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:32.974285 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.objects.instance [None req-383dbff8-d94e-4543-9ef3-f35183ff2fa6 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lazy-loading 'fault' on Instance uuid 15d4a46e-9504-4897-918d-39aafc20d22a {{(pid=124770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:41:32.987248 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-208e14ac-764b-4c37-9775-bde3652aac08 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] 10.222.0.84 "GET /compute/v2.1/servers/fef25575-f211-4db2-8c1f-e1cd8e73e69d" status: 200 len: 1266 microversion: 2.1 time: 0.191364 Aug 24 11:41:32.987836 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 484/917] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:41:32 2022] GET /compute/v2.1/servers/fef25575-f211-4db2-8c1f-e1cd8e73e69d => generated 1266 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:41:33.028010 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-383dbff8-d94e-4543-9ef3-f35183ff2fa6 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031939e16194f63b99e6f27f700fa8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecec6d0c155f4d658197c4779ab9ffce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:41:33.036606 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-383dbff8-d94e-4543-9ef3-f35183ff2fa6 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] 10.222.0.84 "GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a" status: 200 len: 1327 microversion: 2.1 time: 0.126066 Aug 24 11:41:33.037282 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 434/918] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:41:32 2022] GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a => generated 1327 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:41:34.008996 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-4f46f55f-6f16-4a48-b9c9-0c62f840c3bc tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:41:34.009616 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-4f46f55f-6f16-4a48-b9c9-0c62f840c3bc tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] [instance: fef25575-f211-4db2-8c1f-e1cd8e73e69d] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:41:34.016939 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-4f46f55f-6f16-4a48-b9c9-0c62f840c3bc tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:34.018066 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-4f46f55f-6f16-4a48-b9c9-0c62f840c3bc tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:34.018516 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-4f46f55f-6f16-4a48-b9c9-0c62f840c3bc tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:34.019248 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-4f46f55f-6f16-4a48-b9c9-0c62f840c3bc tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:34.019709 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-4f46f55f-6f16-4a48-b9c9-0c62f840c3bc tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:34.020141 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-4f46f55f-6f16-4a48-b9c9-0c62f840c3bc tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:34.064465 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-6a321a01-fff4-4deb-b055-ce86562f7b31 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:41:34.065212 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-6a321a01-fff4-4deb-b055-ce86562f7b31 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] [instance: 15d4a46e-9504-4897-918d-39aafc20d22a] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:41:34.071834 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6a321a01-fff4-4deb-b055-ce86562f7b31 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:34.072338 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6a321a01-fff4-4deb-b055-ce86562f7b31 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:34.072985 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6a321a01-fff4-4deb-b055-ce86562f7b31 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:34.073705 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6a321a01-fff4-4deb-b055-ce86562f7b31 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:34.074166 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6a321a01-fff4-4deb-b055-ce86562f7b31 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:34.074597 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6a321a01-fff4-4deb-b055-ce86562f7b31 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:34.089201 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.wsgi [None req-6a321a01-fff4-4deb-b055-ce86562f7b31 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] HTTP exception thrown: Instance 15d4a46e-9504-4897-918d-39aafc20d22a could not be found. Aug 24 11:41:34.090817 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-6a321a01-fff4-4deb-b055-ce86562f7b31 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Request method failure captured: Aug 24 11:41:34.090817 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: request: GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a HTTP/1.1 Aug 24 11:41:34.090817 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Accept: application/json Aug 24 11:41:34.090817 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Accept-Encoding: identity Aug 24 11:41:34.090817 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Connection: close Aug 24 11:41:34.090817 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Content-Length: 0 Aug 24 11:41:34.090817 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Content-Type: application/json Aug 24 11:41:34.090817 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Host: 10.222.0.84 Aug 24 11:41:34.090817 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Openstack-System-Scope: None Aug 24 11:41:34.090817 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: User-Agent: python-urllib3/1.26.11 Aug 24 11:41:34.090817 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Auth-Token: gAAAAABjBgwhMRA2cc0ufptdwp2_h4V9wxgyG8HRbsXs7voMg4kkNvxs16qRO7dqeMBpzWdJlNOxoL6pRb4rQbp4bL_LJMOsmXfsJ9Cn4wHtcwCJR4buyH1_orEHcIHlFzsC1aopD-eGByxqvTpBRnq6aVvXi5uMcj80D-MqlnO_9B15eXvtaFs Aug 24 11:41:34.090817 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Domain-Id: None Aug 24 11:41:34.090817 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Domain-Name: None Aug 24 11:41:34.090817 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Identity-Status: Confirmed Aug 24 11:41:34.090817 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Is-Admin-Project: True Aug 24 11:41:34.090817 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Project-Domain-Id: default Aug 24 11:41:34.090817 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Project-Domain-Name: Default Aug 24 11:41:34.090817 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Project-Id: ecec6d0c155f4d658197c4779ab9ffce Aug 24 11:41:34.090817 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Project-Name: tempest-AttachVolumeTestJSON-1126541934 Aug 24 11:41:34.090817 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Role: reader,member Aug 24 11:41:34.090817 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Roles: reader,member Aug 24 11:41:34.099790 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/volume/v3/ecec6d0c155f4d658197c4779ab9ffce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/volume/v3/ecec6d0c155f4d658197c4779ab9ffce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/compute/v2/ecec6d0c155f4d658197c4779ab9ffce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84:8080/v1/AUTH_ecec6d0c155f4d658197c4779ab9ffce", "adminURL": "http://10.222.0.84:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/placement"}]}] Aug 24 11:41:34.099790 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Tenant: tempest-AttachVolumeTestJSON-1126541934 Aug 24 11:41:34.099790 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Tenant-Id: ecec6d0c155f4d658197c4779ab9ffce Aug 24 11:41:34.099790 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1126541934 Aug 24 11:41:34.099790 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User: tempest-AttachVolumeTestJSON-1126541934-project Aug 24 11:41:34.099790 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User-Domain-Id: default Aug 24 11:41:34.099790 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User-Domain-Name: Default Aug 24 11:41:34.099790 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User-Id: 0031939e16194f63b99e6f27f700fa8c Aug 24 11:41:34.099790 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User-Name: tempest-AttachVolumeTestJSON-1126541934-project Aug 24 11:41:34.099790 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: method: > Aug 24 11:41:34.099790 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: exception: Instance 15d4a46e-9504-4897-918d-39aafc20d22a could not be found. Aug 24 11:41:34.099790 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: action_args: {'id': '15d4a46e-9504-4897-918d-39aafc20d22a'} Aug 24 11:41:34.100548 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:41:34.100548 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:41:34.100548 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:41:34.100548 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:41:34.100548 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:41:34.100548 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:41:34.100548 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:41:34.100548 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:41:34.100548 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:41:34.100548 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:41:34.100548 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15d4a46e-9504-4897-918d-39aafc20d22a could not be found. Aug 24 11:41:34.100548 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:41:34.100548 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:41:34.100548 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:41:34.100548 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:41:34.100548 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:41:34.100548 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:41:34.100548 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:41:34.100548 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:41:34.100548 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:41:34.101952 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:41:34.101952 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:41:34.101952 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:41:34.101952 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:41:34.101952 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:41:34.101952 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:41:34.101952 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:41:34.101952 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15d4a46e-9504-4897-918d-39aafc20d22a could not be found. Aug 24 11:41:34.101952 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:41:34.101952 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:41:34.101952 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:41:34.101952 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:41:34.101952 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:41:34.101952 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:41:34.101952 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:41:34.101952 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:41:34.101952 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15d4a46e-9504-4897-918d-39aafc20d22a could not be found. Aug 24 11:41:34.101952 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:41:34.104154 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-6a321a01-fff4-4deb-b055-ce86562f7b31 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Returning 404 to user: Instance 15d4a46e-9504-4897-918d-39aafc20d22a could not be found. {{(pid=124770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:41:34.104154 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-6a321a01-fff4-4deb-b055-ce86562f7b31 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] 10.222.0.84 "GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a" status: 404 len: 111 microversion: 2.1 time: 0.032355 Aug 24 11:41:34.104154 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 435/919] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:41:34 2022] GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 11:41:34.104154 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-251c8d59-e088-4869-94ee-3db7ce83d887 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Calling method '.version_select at 0x7f0e2ede7dc0>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:41:34.176731 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-4f46f55f-6f16-4a48-b9c9-0c62f840c3bc tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b82b6f568bd41fa9d6b44facb766e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ef3fc15a0147e39228729d2b5b2631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:41:34.184430 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-4f46f55f-6f16-4a48-b9c9-0c62f840c3bc tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] 10.222.0.84 "GET /compute/v2.1/servers/fef25575-f211-4db2-8c1f-e1cd8e73e69d" status: 200 len: 1266 microversion: 2.1 time: 0.179432 Aug 24 11:41:34.185003 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 485/920] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:41:34 2022] GET /compute/v2.1/servers/fef25575-f211-4db2-8c1f-e1cd8e73e69d => generated 1266 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:41:34.253359 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-251c8d59-e088-4869-94ee-3db7ce83d887 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] 10.222.0.84 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-327347914" status: 202 len: 0 microversion: 2.1 time: 0.154585 Aug 24 11:41:34.253932 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 436/921] 10.222.0.84 () {58 vars in 1218 bytes} [Wed Aug 24 11:41:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-327347914 => generated 0 bytes in 156 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:41:35.207209 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-9eb03b1c-c426-4b9b-b817-d4f094e6fe9b tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:41:35.214245 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-9eb03b1c-c426-4b9b-b817-d4f094e6fe9b tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] [instance: fef25575-f211-4db2-8c1f-e1cd8e73e69d] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:41:35.216420 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-9eb03b1c-c426-4b9b-b817-d4f094e6fe9b tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:35.216952 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-9eb03b1c-c426-4b9b-b817-d4f094e6fe9b tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:35.217388 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-9eb03b1c-c426-4b9b-b817-d4f094e6fe9b tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:35.218152 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-9eb03b1c-c426-4b9b-b817-d4f094e6fe9b tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:35.218610 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-9eb03b1c-c426-4b9b-b817-d4f094e6fe9b tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:35.219025 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-9eb03b1c-c426-4b9b-b817-d4f094e6fe9b tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:35.444893 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-3981f8dd-8868-4a97-9f10-1493a4b243c3 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Action: 'create', calling method: .version_select at 0x7f0e2ed86d30>, body: {"keypair": {"name": "tempest-keypair-1921294098", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDReDBqPUvWZHHpU0NfYedlWgBMyFXFrGvQdqzoDGrbKjzx6JWItxlQvKe+S/cFaIkrEHLf+FM/9ANNb3Dnm1LYVtYAnkGUiSIMIsQgMJR++6c7IBs5QwsR8ODQb3YOWMQ=="}} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:41:35.449095 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-9eb03b1c-c426-4b9b-b817-d4f094e6fe9b tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b82b6f568bd41fa9d6b44facb766e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ef3fc15a0147e39228729d2b5b2631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:41:35.458146 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-9eb03b1c-c426-4b9b-b817-d4f094e6fe9b tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] 10.222.0.84 "GET /compute/v2.1/servers/fef25575-f211-4db2-8c1f-e1cd8e73e69d" status: 200 len: 1266 microversion: 2.1 time: 0.255919 Aug 24 11:41:35.458652 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 486/922] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:41:35 2022] GET /compute/v2.1/servers/fef25575-f211-4db2-8c1f-e1cd8e73e69d => generated 1266 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:41:35.465030 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.quota [None req-3981f8dd-8868-4a97-9f10-1493a4b243c3 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Getting quotas for project ecec6d0c155f4d658197c4779ab9ffce. Resources: {'key_pairs'} {{(pid=124770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:41:35.468867 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.quota [None req-3981f8dd-8868-4a97-9f10-1493a4b243c3 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Getting quotas for user 0031939e16194f63b99e6f27f700fa8c and project ecec6d0c155f4d658197c4779ab9ffce. Resources: {'key_pairs'} {{(pid=124770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:41:35.596481 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-3981f8dd-8868-4a97-9f10-1493a4b243c3 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] 10.222.0.84 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.155748 Aug 24 11:41:35.597145 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 437/923] 10.222.0.84 () {60 vars in 1159 bytes} [Wed Aug 24 11:41:35 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:41:36.481079 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-90859b09-1a70-4dc8-8174-0deb2349fda4 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:41:36.481715 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-90859b09-1a70-4dc8-8174-0deb2349fda4 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] [instance: fef25575-f211-4db2-8c1f-e1cd8e73e69d] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:41:36.489065 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-90859b09-1a70-4dc8-8174-0deb2349fda4 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:36.489599 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-90859b09-1a70-4dc8-8174-0deb2349fda4 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:36.490041 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-90859b09-1a70-4dc8-8174-0deb2349fda4 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:36.490739 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-90859b09-1a70-4dc8-8174-0deb2349fda4 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:36.491192 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-90859b09-1a70-4dc8-8174-0deb2349fda4 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:36.491607 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-90859b09-1a70-4dc8-8174-0deb2349fda4 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:36.660211 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-90859b09-1a70-4dc8-8174-0deb2349fda4 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b82b6f568bd41fa9d6b44facb766e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ef3fc15a0147e39228729d2b5b2631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:41:36.669529 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-90859b09-1a70-4dc8-8174-0deb2349fda4 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] 10.222.0.84 "GET /compute/v2.1/servers/fef25575-f211-4db2-8c1f-e1cd8e73e69d" status: 200 len: 1266 microversion: 2.1 time: 0.192186 Aug 24 11:41:36.670475 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 487/924] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:41:36 2022] GET /compute/v2.1/servers/fef25575-f211-4db2-8c1f-e1cd8e73e69d => generated 1266 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:41:37.692286 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-1d9be661-8cc2-40d6-b81a-1bc71b9f4cef tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:41:37.693228 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-1d9be661-8cc2-40d6-b81a-1bc71b9f4cef tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] [instance: fef25575-f211-4db2-8c1f-e1cd8e73e69d] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:41:37.699367 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1d9be661-8cc2-40d6-b81a-1bc71b9f4cef tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:37.699850 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1d9be661-8cc2-40d6-b81a-1bc71b9f4cef tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:37.700281 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1d9be661-8cc2-40d6-b81a-1bc71b9f4cef tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:37.701023 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1d9be661-8cc2-40d6-b81a-1bc71b9f4cef tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:37.701478 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1d9be661-8cc2-40d6-b81a-1bc71b9f4cef tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:37.701899 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1d9be661-8cc2-40d6-b81a-1bc71b9f4cef tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:37.846789 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-1d9be661-8cc2-40d6-b81a-1bc71b9f4cef tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b82b6f568bd41fa9d6b44facb766e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ef3fc15a0147e39228729d2b5b2631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:41:37.851172 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-1d9be661-8cc2-40d6-b81a-1bc71b9f4cef tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] 10.222.0.84 "GET /compute/v2.1/servers/fef25575-f211-4db2-8c1f-e1cd8e73e69d" status: 200 len: 1266 microversion: 2.1 time: 0.164070 Aug 24 11:41:37.851762 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 438/925] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:41:37 2022] GET /compute/v2.1/servers/fef25575-f211-4db2-8c1f-e1cd8e73e69d => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:41:38.178620 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [req-70dc585b-c9a5-4a42-806f-e92e6129edf7 req-3b7ee7bb-4a94-4719-98b0-8d0fd40463e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fef25575-f211-4db2-8c1f-e1cd8e73e69d", "name": "network-vif-plugged", "status": "completed", "tag": "f074715e-37e5-4ad1-955b-cb3c250052f0"}]} {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:41:38.194635 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [req-70dc585b-c9a5-4a42-806f-e92e6129edf7 req-3b7ee7bb-4a94-4719-98b0-8d0fd40463e4 service nova] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:38.195118 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [req-70dc585b-c9a5-4a42-806f-e92e6129edf7 req-3b7ee7bb-4a94-4719-98b0-8d0fd40463e4 service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:38.195725 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [req-70dc585b-c9a5-4a42-806f-e92e6129edf7 req-3b7ee7bb-4a94-4719-98b0-8d0fd40463e4 service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:38.209324 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.compute.server_external_events [req-70dc585b-c9a5-4a42-806f-e92e6129edf7 req-3b7ee7bb-4a94-4719-98b0-8d0fd40463e4 service nova] Creating event network-vif-plugged:f074715e-37e5-4ad1-955b-cb3c250052f0 for instance fef25575-f211-4db2-8c1f-e1cd8e73e69d on hv-cinder-85427 Aug 24 11:41:38.215476 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [req-70dc585b-c9a5-4a42-806f-e92e6129edf7 req-3b7ee7bb-4a94-4719-98b0-8d0fd40463e4 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040585 Aug 24 11:41:38.216464 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 488/926] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Aug 24 11:41:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:41:38.377840 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-8b01a6c9-ccd5-45f6-8ae2-fb76f367b2cc tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2144578020", "imageRef": "028cad80-8f50-4139-b345-dfdca694dc6b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "061f8dd3-1b71-47bb-aa3c-d02369f28b7d"}], "security_groups": [{"name": "tempest-securitygroup--1670567135"}], "key_name": "tempest-keypair-1921294098", "user_data": "}} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:41:38.515531 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.network.neutron [None req-8b01a6c9-ccd5-45f6-8ae2-fb76f367b2cc tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] validate_networks() for [('061f8dd3-1b71-47bb-aa3c-d02369f28b7d', None, None, None, None, None)] {{(pid=124770) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 11:41:38.875156 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-f59e0820-f9d2-49f3-a478-bcfffc1df4bc tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:41:38.875495 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-f59e0820-f9d2-49f3-a478-bcfffc1df4bc tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] [instance: fef25575-f211-4db2-8c1f-e1cd8e73e69d] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:41:38.883313 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f59e0820-f9d2-49f3-a478-bcfffc1df4bc tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:38.884163 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f59e0820-f9d2-49f3-a478-bcfffc1df4bc tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:38.884778 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f59e0820-f9d2-49f3-a478-bcfffc1df4bc tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:38.885537 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f59e0820-f9d2-49f3-a478-bcfffc1df4bc tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:38.886036 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f59e0820-f9d2-49f3-a478-bcfffc1df4bc tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:38.886479 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f59e0820-f9d2-49f3-a478-bcfffc1df4bc tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:39.040127 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-f59e0820-f9d2-49f3-a478-bcfffc1df4bc tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b82b6f568bd41fa9d6b44facb766e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ef3fc15a0147e39228729d2b5b2631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:41:39.048332 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-f59e0820-f9d2-49f3-a478-bcfffc1df4bc tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] 10.222.0.84 "GET /compute/v2.1/servers/fef25575-f211-4db2-8c1f-e1cd8e73e69d" status: 200 len: 1266 microversion: 2.1 time: 0.178130 Aug 24 11:41:39.049132 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 489/927] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:41:38 2022] GET /compute/v2.1/servers/fef25575-f211-4db2-8c1f-e1cd8e73e69d => generated 1266 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:41:39.238947 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.virt.hardware [None req-8b01a6c9-ccd5-45f6-8ae2-fb76f367b2cc tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Flavor limits 0:0:0 {{(pid=124770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 11:41:39.239473 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.virt.hardware [None req-8b01a6c9-ccd5-45f6-8ae2-fb76f367b2cc tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Image limits 0:0:0 {{(pid=124770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 11:41:39.239825 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.virt.hardware [None req-8b01a6c9-ccd5-45f6-8ae2-fb76f367b2cc tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Flavor pref 0:0:0 {{(pid=124770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 11:41:39.240232 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.virt.hardware [None req-8b01a6c9-ccd5-45f6-8ae2-fb76f367b2cc tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Image pref 0:0:0 {{(pid=124770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 11:41:39.240640 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.virt.hardware [None req-8b01a6c9-ccd5-45f6-8ae2-fb76f367b2cc tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 11:41:39.250240 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8b01a6c9-ccd5-45f6-8ae2-fb76f367b2cc tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:39.250726 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8b01a6c9-ccd5-45f6-8ae2-fb76f367b2cc tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:39.251301 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8b01a6c9-ccd5-45f6-8ae2-fb76f367b2cc tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:39.252047 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8b01a6c9-ccd5-45f6-8ae2-fb76f367b2cc tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:39.252597 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8b01a6c9-ccd5-45f6-8ae2-fb76f367b2cc tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:39.253058 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8b01a6c9-ccd5-45f6-8ae2-fb76f367b2cc tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:39.270458 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.quota [None req-8b01a6c9-ccd5-45f6-8ae2-fb76f367b2cc tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Getting quotas for project ecec6d0c155f4d658197c4779ab9ffce. Resources: {'ram', 'cores', 'instances'} {{(pid=124770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:41:39.275086 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.quota [None req-8b01a6c9-ccd5-45f6-8ae2-fb76f367b2cc tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Getting quotas for user 0031939e16194f63b99e6f27f700fa8c and project ecec6d0c155f4d658197c4779ab9ffce. Resources: {'ram', 'cores', 'instances'} {{(pid=124770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:41:39.287021 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-8b01a6c9-ccd5-45f6-8ae2-fb76f367b2cc tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Going to run 1 instances... {{(pid=124770) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 11:41:39.289421 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-8b01a6c9-ccd5-45f6-8ae2-fb76f367b2cc tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] [instance: 29619526-3255-4729-81c6-53db060e7426] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='028cad80-8f50-4139-b345-dfdca694dc6b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124770) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 11:41:39.444744 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-8b01a6c9-ccd5-45f6-8ae2-fb76f367b2cc tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] 10.222.0.84 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.082013 Aug 24 11:41:39.445632 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 439/928] 10.222.0.84 () {60 vars in 1147 bytes} [Wed Aug 24 11:41:38 2022] POST /compute/v2.1/servers => generated 402 bytes in 1084 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 11:41:39.457238 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-2d3d8659-dcbc-4e25-9e84-2f36589998d9 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:41:39.458274 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-2d3d8659-dcbc-4e25-9e84-2f36589998d9 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] [instance: 29619526-3255-4729-81c6-53db060e7426] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:41:39.522442 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-2d3d8659-dcbc-4e25-9e84-2f36589998d9 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031939e16194f63b99e6f27f700fa8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecec6d0c155f4d658197c4779ab9ffce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:41:39.531181 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-2d3d8659-dcbc-4e25-9e84-2f36589998d9 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] 10.222.0.84 "GET /compute/v2.1/servers/29619526-3255-4729-81c6-53db060e7426" status: 200 len: 1238 microversion: 2.1 time: 0.078107 Aug 24 11:41:39.531990 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 490/929] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:41:39 2022] GET /compute/v2.1/servers/29619526-3255-4729-81c6-53db060e7426 => generated 1238 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:41:40.070778 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-eaa56f0f-383e-41b0-9538-302fb6b47a7c tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:41:40.071373 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-eaa56f0f-383e-41b0-9538-302fb6b47a7c tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] [instance: fef25575-f211-4db2-8c1f-e1cd8e73e69d] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:41:40.077929 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-eaa56f0f-383e-41b0-9538-302fb6b47a7c tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:40.078416 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-eaa56f0f-383e-41b0-9538-302fb6b47a7c tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:40.078851 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-eaa56f0f-383e-41b0-9538-302fb6b47a7c tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:40.080174 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-eaa56f0f-383e-41b0-9538-302fb6b47a7c tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:40.080624 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-eaa56f0f-383e-41b0-9538-302fb6b47a7c tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:40.081065 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-eaa56f0f-383e-41b0-9538-302fb6b47a7c tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:40.226721 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-eaa56f0f-383e-41b0-9538-302fb6b47a7c tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b82b6f568bd41fa9d6b44facb766e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ef3fc15a0147e39228729d2b5b2631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:41:40.234499 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-eaa56f0f-383e-41b0-9538-302fb6b47a7c tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] 10.222.0.84 "GET /compute/v2.1/servers/fef25575-f211-4db2-8c1f-e1cd8e73e69d" status: 200 len: 1266 microversion: 2.1 time: 0.167654 Aug 24 11:41:40.235057 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 440/930] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:41:40 2022] GET /compute/v2.1/servers/fef25575-f211-4db2-8c1f-e1cd8e73e69d => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:41:40.553499 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-243d703c-90f0-4e50-873b-01cf66a64105 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:41:40.554110 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-243d703c-90f0-4e50-873b-01cf66a64105 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] [instance: 29619526-3255-4729-81c6-53db060e7426] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:41:40.560549 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-243d703c-90f0-4e50-873b-01cf66a64105 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:40.561066 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-243d703c-90f0-4e50-873b-01cf66a64105 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:40.561503 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-243d703c-90f0-4e50-873b-01cf66a64105 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:40.562301 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-243d703c-90f0-4e50-873b-01cf66a64105 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:40.562764 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-243d703c-90f0-4e50-873b-01cf66a64105 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:40.563243 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-243d703c-90f0-4e50-873b-01cf66a64105 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:40.632212 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-243d703c-90f0-4e50-873b-01cf66a64105 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031939e16194f63b99e6f27f700fa8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecec6d0c155f4d658197c4779ab9ffce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:41:40.640416 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-243d703c-90f0-4e50-873b-01cf66a64105 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] 10.222.0.84 "GET /compute/v2.1/servers/29619526-3255-4729-81c6-53db060e7426" status: 200 len: 1242 microversion: 2.1 time: 0.091054 Aug 24 11:41:40.641031 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 491/931] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:41:40 2022] GET /compute/v2.1/servers/29619526-3255-4729-81c6-53db060e7426 => generated 1242 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:41:41.469325 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-546b1416-62dd-4d3c-a086-bcffc16c9a6d tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:41:41.470840 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-546b1416-62dd-4d3c-a086-bcffc16c9a6d tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] [instance: fef25575-f211-4db2-8c1f-e1cd8e73e69d] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:41:41.477839 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-546b1416-62dd-4d3c-a086-bcffc16c9a6d tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:41.478320 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-546b1416-62dd-4d3c-a086-bcffc16c9a6d tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:41.478755 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-546b1416-62dd-4d3c-a086-bcffc16c9a6d tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:41.479447 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-546b1416-62dd-4d3c-a086-bcffc16c9a6d tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:41.479898 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-546b1416-62dd-4d3c-a086-bcffc16c9a6d tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:41.480317 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-546b1416-62dd-4d3c-a086-bcffc16c9a6d tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:41.668138 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-3b050e17-c46b-4f71-b50b-fd5a43a03977 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:41:41.668757 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-3b050e17-c46b-4f71-b50b-fd5a43a03977 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] [instance: 29619526-3255-4729-81c6-53db060e7426] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:41:41.676511 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-3b050e17-c46b-4f71-b50b-fd5a43a03977 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:41.677043 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-3b050e17-c46b-4f71-b50b-fd5a43a03977 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:41.677502 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-3b050e17-c46b-4f71-b50b-fd5a43a03977 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:41.678215 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-3b050e17-c46b-4f71-b50b-fd5a43a03977 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:41.678672 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-3b050e17-c46b-4f71-b50b-fd5a43a03977 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:41.679104 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-3b050e17-c46b-4f71-b50b-fd5a43a03977 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:41.752306 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-3b050e17-c46b-4f71-b50b-fd5a43a03977 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031939e16194f63b99e6f27f700fa8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecec6d0c155f4d658197c4779ab9ffce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:41:41.760600 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-3b050e17-c46b-4f71-b50b-fd5a43a03977 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] 10.222.0.84 "GET /compute/v2.1/servers/29619526-3255-4729-81c6-53db060e7426" status: 200 len: 1242 microversion: 2.1 time: 0.096880 Aug 24 11:41:41.761221 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 492/932] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:41:41 2022] GET /compute/v2.1/servers/29619526-3255-4729-81c6-53db060e7426 => generated 1242 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:41:41.795130 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-546b1416-62dd-4d3c-a086-bcffc16c9a6d tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b82b6f568bd41fa9d6b44facb766e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ef3fc15a0147e39228729d2b5b2631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:41:41.805689 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-546b1416-62dd-4d3c-a086-bcffc16c9a6d tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] 10.222.0.84 "GET /compute/v2.1/servers/fef25575-f211-4db2-8c1f-e1cd8e73e69d" status: 200 len: 1453 microversion: 2.1 time: 0.553174 Aug 24 11:41:41.811283 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 441/933] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:41:41 2022] GET /compute/v2.1/servers/fef25575-f211-4db2-8c1f-e1cd8e73e69d => generated 1453 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:41:41.834028 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-dd108857-8695-4c5d-901a-f0f8c4a533c3 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:41:41.834827 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-dd108857-8695-4c5d-901a-f0f8c4a533c3 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] [instance: fef25575-f211-4db2-8c1f-e1cd8e73e69d] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:41:41.842363 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-dd108857-8695-4c5d-901a-f0f8c4a533c3 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:41.843221 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-dd108857-8695-4c5d-901a-f0f8c4a533c3 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:41.843735 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-dd108857-8695-4c5d-901a-f0f8c4a533c3 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:41.844561 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-dd108857-8695-4c5d-901a-f0f8c4a533c3 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:41.845150 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-dd108857-8695-4c5d-901a-f0f8c4a533c3 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:41.845863 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-dd108857-8695-4c5d-901a-f0f8c4a533c3 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:41.995535 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-dd108857-8695-4c5d-901a-f0f8c4a533c3 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b82b6f568bd41fa9d6b44facb766e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ef3fc15a0147e39228729d2b5b2631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:41:42.004787 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-dd108857-8695-4c5d-901a-f0f8c4a533c3 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] 10.222.0.84 "GET /compute/v2.1/servers/fef25575-f211-4db2-8c1f-e1cd8e73e69d" status: 200 len: 1453 microversion: 2.1 time: 0.176186 Aug 24 11:41:42.005901 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 493/934] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:41:41 2022] GET /compute/v2.1/servers/fef25575-f211-4db2-8c1f-e1cd8e73e69d => generated 1453 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:41:42.791293 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-03b81389-fb1c-4b01-a9ff-88d6af978ed1 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:41:42.795922 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-03b81389-fb1c-4b01-a9ff-88d6af978ed1 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] [instance: 29619526-3255-4729-81c6-53db060e7426] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:41:42.808460 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-03b81389-fb1c-4b01-a9ff-88d6af978ed1 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:42.809166 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-03b81389-fb1c-4b01-a9ff-88d6af978ed1 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:42.811984 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-03b81389-fb1c-4b01-a9ff-88d6af978ed1 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:42.811984 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-03b81389-fb1c-4b01-a9ff-88d6af978ed1 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:42.811984 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-03b81389-fb1c-4b01-a9ff-88d6af978ed1 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:42.811984 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-03b81389-fb1c-4b01-a9ff-88d6af978ed1 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:42.816679 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_cell1:SELECT=100 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:41:42.898116 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-03b81389-fb1c-4b01-a9ff-88d6af978ed1 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031939e16194f63b99e6f27f700fa8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecec6d0c155f4d658197c4779ab9ffce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:41:42.908189 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-03b81389-fb1c-4b01-a9ff-88d6af978ed1 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] 10.222.0.84 "GET /compute/v2.1/servers/29619526-3255-4729-81c6-53db060e7426" status: 200 len: 1298 microversion: 2.1 time: 0.127911 Aug 24 11:41:42.908815 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 442/935] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:41:42 2022] GET /compute/v2.1/servers/29619526-3255-4729-81c6-53db060e7426 => generated 1298 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:41:43.930171 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-982c7ce3-468d-4e01-8727-34358a035faa tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:41:43.931413 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-982c7ce3-468d-4e01-8727-34358a035faa tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] [instance: 29619526-3255-4729-81c6-53db060e7426] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:41:43.939185 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-982c7ce3-468d-4e01-8727-34358a035faa tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:43.940818 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-982c7ce3-468d-4e01-8727-34358a035faa tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:43.941430 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-982c7ce3-468d-4e01-8727-34358a035faa tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:43.942435 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-982c7ce3-468d-4e01-8727-34358a035faa tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:43.943089 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-982c7ce3-468d-4e01-8727-34358a035faa tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:43.943682 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-982c7ce3-468d-4e01-8727-34358a035faa tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:44.236840 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-982c7ce3-468d-4e01-8727-34358a035faa tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031939e16194f63b99e6f27f700fa8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecec6d0c155f4d658197c4779ab9ffce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:41:44.245907 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-982c7ce3-468d-4e01-8727-34358a035faa tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] 10.222.0.84 "GET /compute/v2.1/servers/29619526-3255-4729-81c6-53db060e7426" status: 200 len: 1364 microversion: 2.1 time: 0.319649 Aug 24 11:41:44.259905 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 494/936] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:41:43 2022] GET /compute/v2.1/servers/29619526-3255-4729-81c6-53db060e7426 => generated 1364 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:41:44.613228 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [req-71fea7a1-77a0-4c8e-a0c7-b3669f8f1f59 req-50684bff-045a-4d2a-aa25-965ae77627fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fef25575-f211-4db2-8c1f-e1cd8e73e69d", "tag": "f074715e-37e5-4ad1-955b-cb3c250052f0"}]} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:41:44.624300 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-71fea7a1-77a0-4c8e-a0c7-b3669f8f1f59 req-50684bff-045a-4d2a-aa25-965ae77627fe service nova] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:44.624781 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-71fea7a1-77a0-4c8e-a0c7-b3669f8f1f59 req-50684bff-045a-4d2a-aa25-965ae77627fe service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:44.625227 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-71fea7a1-77a0-4c8e-a0c7-b3669f8f1f59 req-50684bff-045a-4d2a-aa25-965ae77627fe service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:44.656097 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.compute.server_external_events [req-71fea7a1-77a0-4c8e-a0c7-b3669f8f1f59 req-50684bff-045a-4d2a-aa25-965ae77627fe service nova] Creating event network-changed:f074715e-37e5-4ad1-955b-cb3c250052f0 for instance fef25575-f211-4db2-8c1f-e1cd8e73e69d on hv-cinder-85427 Aug 24 11:41:44.667194 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [req-71fea7a1-77a0-4c8e-a0c7-b3669f8f1f59 req-50684bff-045a-4d2a-aa25-965ae77627fe service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057967 Aug 24 11:41:44.668405 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 443/937] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Aug 24 11:41:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:41:45.157956 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [req-ce8dc3ba-a22d-4c8e-92c2-1a2535bfd497 req-ddd488ca-88b2-4dd6-9a4b-5cc3ee0e2aef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29619526-3255-4729-81c6-53db060e7426", "tag": "f9cbcf81-59b4-42ee-b9fb-05ef5f045b65"}]} {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:41:45.169006 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [req-ce8dc3ba-a22d-4c8e-92c2-1a2535bfd497 req-ddd488ca-88b2-4dd6-9a4b-5cc3ee0e2aef service nova] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:45.169607 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [req-ce8dc3ba-a22d-4c8e-92c2-1a2535bfd497 req-ddd488ca-88b2-4dd6-9a4b-5cc3ee0e2aef service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:45.170249 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [req-ce8dc3ba-a22d-4c8e-92c2-1a2535bfd497 req-ddd488ca-88b2-4dd6-9a4b-5cc3ee0e2aef service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:45.184037 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.compute.server_external_events [req-ce8dc3ba-a22d-4c8e-92c2-1a2535bfd497 req-ddd488ca-88b2-4dd6-9a4b-5cc3ee0e2aef service nova] Creating event network-changed:f9cbcf81-59b4-42ee-b9fb-05ef5f045b65 for instance 29619526-3255-4729-81c6-53db060e7426 on hv-cinder-85427 Aug 24 11:41:45.190991 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [req-ce8dc3ba-a22d-4c8e-92c2-1a2535bfd497 req-ddd488ca-88b2-4dd6-9a4b-5cc3ee0e2aef service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039413 Aug 24 11:41:45.191975 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 495/938] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Aug 24 11:41:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:41:45.271763 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-ebe93dde-4f1c-49fb-9444-79d65350a472 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:41:45.272584 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-ebe93dde-4f1c-49fb-9444-79d65350a472 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] [instance: 29619526-3255-4729-81c6-53db060e7426] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:41:45.284283 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ebe93dde-4f1c-49fb-9444-79d65350a472 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:45.284776 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ebe93dde-4f1c-49fb-9444-79d65350a472 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:45.285248 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ebe93dde-4f1c-49fb-9444-79d65350a472 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:45.288372 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ebe93dde-4f1c-49fb-9444-79d65350a472 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:45.289318 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ebe93dde-4f1c-49fb-9444-79d65350a472 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:45.297035 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ebe93dde-4f1c-49fb-9444-79d65350a472 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:45.882011 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-ebe93dde-4f1c-49fb-9444-79d65350a472 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031939e16194f63b99e6f27f700fa8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecec6d0c155f4d658197c4779ab9ffce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:41:45.890002 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-ebe93dde-4f1c-49fb-9444-79d65350a472 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] 10.222.0.84 "GET /compute/v2.1/servers/29619526-3255-4729-81c6-53db060e7426" status: 200 len: 1364 microversion: 2.1 time: 0.626236 Aug 24 11:41:45.890573 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 444/939] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:41:45 2022] GET /compute/v2.1/servers/29619526-3255-4729-81c6-53db060e7426 => generated 1364 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:41:46.912972 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-1de8d0e4-994b-4bd8-b6d7-3e43d883efaf tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:41:46.913590 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-1de8d0e4-994b-4bd8-b6d7-3e43d883efaf tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] [instance: 29619526-3255-4729-81c6-53db060e7426] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:41:46.919969 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-1de8d0e4-994b-4bd8-b6d7-3e43d883efaf tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:46.920454 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-1de8d0e4-994b-4bd8-b6d7-3e43d883efaf tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:46.920931 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-1de8d0e4-994b-4bd8-b6d7-3e43d883efaf tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:46.921638 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-1de8d0e4-994b-4bd8-b6d7-3e43d883efaf tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:46.922095 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-1de8d0e4-994b-4bd8-b6d7-3e43d883efaf tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:46.923101 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-1de8d0e4-994b-4bd8-b6d7-3e43d883efaf tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:47.071895 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-1de8d0e4-994b-4bd8-b6d7-3e43d883efaf tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031939e16194f63b99e6f27f700fa8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecec6d0c155f4d658197c4779ab9ffce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:41:47.080115 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-1de8d0e4-994b-4bd8-b6d7-3e43d883efaf tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] 10.222.0.84 "GET /compute/v2.1/servers/29619526-3255-4729-81c6-53db060e7426" status: 200 len: 1364 microversion: 2.1 time: 0.172388 Aug 24 11:41:47.080687 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 496/940] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:41:46 2022] GET /compute/v2.1/servers/29619526-3255-4729-81c6-53db060e7426 => generated 1364 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:41:48.101419 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-c4525c54-249d-42fb-b0c2-4f17a55db8c6 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:41:48.102039 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-c4525c54-249d-42fb-b0c2-4f17a55db8c6 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] [instance: 29619526-3255-4729-81c6-53db060e7426] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:41:48.108884 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c4525c54-249d-42fb-b0c2-4f17a55db8c6 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:48.109377 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c4525c54-249d-42fb-b0c2-4f17a55db8c6 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:48.109812 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c4525c54-249d-42fb-b0c2-4f17a55db8c6 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:48.111026 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c4525c54-249d-42fb-b0c2-4f17a55db8c6 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:48.111491 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c4525c54-249d-42fb-b0c2-4f17a55db8c6 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:48.112038 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c4525c54-249d-42fb-b0c2-4f17a55db8c6 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:48.253178 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-c4525c54-249d-42fb-b0c2-4f17a55db8c6 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031939e16194f63b99e6f27f700fa8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecec6d0c155f4d658197c4779ab9ffce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:41:48.260940 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-c4525c54-249d-42fb-b0c2-4f17a55db8c6 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] 10.222.0.84 "GET /compute/v2.1/servers/29619526-3255-4729-81c6-53db060e7426" status: 200 len: 1364 microversion: 2.1 time: 0.163762 Aug 24 11:41:48.261511 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 445/941] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:41:48 2022] GET /compute/v2.1/servers/29619526-3255-4729-81c6-53db060e7426 => generated 1364 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:41:49.283041 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-0dd19ba3-bb26-49ae-9952-4b7487731d31 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:41:49.283596 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-0dd19ba3-bb26-49ae-9952-4b7487731d31 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] [instance: 29619526-3255-4729-81c6-53db060e7426] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:41:49.291040 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-0dd19ba3-bb26-49ae-9952-4b7487731d31 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:49.291524 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-0dd19ba3-bb26-49ae-9952-4b7487731d31 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:49.291965 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-0dd19ba3-bb26-49ae-9952-4b7487731d31 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:49.292660 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-0dd19ba3-bb26-49ae-9952-4b7487731d31 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:49.293147 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-0dd19ba3-bb26-49ae-9952-4b7487731d31 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:49.293570 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-0dd19ba3-bb26-49ae-9952-4b7487731d31 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:49.450656 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-0dd19ba3-bb26-49ae-9952-4b7487731d31 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031939e16194f63b99e6f27f700fa8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecec6d0c155f4d658197c4779ab9ffce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:41:49.459614 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-0dd19ba3-bb26-49ae-9952-4b7487731d31 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] 10.222.0.84 "GET /compute/v2.1/servers/29619526-3255-4729-81c6-53db060e7426" status: 200 len: 1364 microversion: 2.1 time: 0.181143 Aug 24 11:41:49.460185 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 497/942] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:41:49 2022] GET /compute/v2.1/servers/29619526-3255-4729-81c6-53db060e7426 => generated 1364 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:41:50.488072 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-936257d1-0c2d-4dc5-ba8e-7cd0b6a750d4 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:41:50.496845 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-936257d1-0c2d-4dc5-ba8e-7cd0b6a750d4 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] [instance: 29619526-3255-4729-81c6-53db060e7426] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:41:50.496845 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_cell0:SELECT=2 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:41:50.496845 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_cell0:SELECT=10 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:41:50.496845 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_api:SELECT=75,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:41:50.501197 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-936257d1-0c2d-4dc5-ba8e-7cd0b6a750d4 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:50.502256 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-936257d1-0c2d-4dc5-ba8e-7cd0b6a750d4 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:50.502938 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-936257d1-0c2d-4dc5-ba8e-7cd0b6a750d4 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:50.503829 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-936257d1-0c2d-4dc5-ba8e-7cd0b6a750d4 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:50.504444 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-936257d1-0c2d-4dc5-ba8e-7cd0b6a750d4 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:50.505039 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-936257d1-0c2d-4dc5-ba8e-7cd0b6a750d4 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:50.662840 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-936257d1-0c2d-4dc5-ba8e-7cd0b6a750d4 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031939e16194f63b99e6f27f700fa8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecec6d0c155f4d658197c4779ab9ffce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:41:50.670824 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-936257d1-0c2d-4dc5-ba8e-7cd0b6a750d4 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] 10.222.0.84 "GET /compute/v2.1/servers/29619526-3255-4729-81c6-53db060e7426" status: 200 len: 1364 microversion: 2.1 time: 0.187569 Aug 24 11:41:50.671665 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 446/943] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:41:50 2022] GET /compute/v2.1/servers/29619526-3255-4729-81c6-53db060e7426 => generated 1364 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:41:51.691814 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-0882bfc9-9b65-41c5-8a43-34eaea87eb43 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:41:51.692565 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-0882bfc9-9b65-41c5-8a43-34eaea87eb43 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] [instance: 29619526-3255-4729-81c6-53db060e7426] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:41:51.694650 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG dbcounter [-] [124769] Writing DB stats nova_cell0:SELECT=2 {{(pid=124769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:41:51.700072 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-0882bfc9-9b65-41c5-8a43-34eaea87eb43 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:51.700680 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-0882bfc9-9b65-41c5-8a43-34eaea87eb43 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:51.701212 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-0882bfc9-9b65-41c5-8a43-34eaea87eb43 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:51.701982 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-0882bfc9-9b65-41c5-8a43-34eaea87eb43 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:51.702527 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-0882bfc9-9b65-41c5-8a43-34eaea87eb43 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:51.703043 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-0882bfc9-9b65-41c5-8a43-34eaea87eb43 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:52.032930 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-0882bfc9-9b65-41c5-8a43-34eaea87eb43 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031939e16194f63b99e6f27f700fa8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecec6d0c155f4d658197c4779ab9ffce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:41:52.040928 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-0882bfc9-9b65-41c5-8a43-34eaea87eb43 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] 10.222.0.84 "GET /compute/v2.1/servers/29619526-3255-4729-81c6-53db060e7426" status: 200 len: 1364 microversion: 2.1 time: 0.353153 Aug 24 11:41:52.041502 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 498/944] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:41:51 2022] GET /compute/v2.1/servers/29619526-3255-4729-81c6-53db060e7426 => generated 1364 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:41:52.639835 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [req-e8c2fe90-a5b3-4278-92b9-a31473d1359d req-bad56ebc-df8e-48de-af14-1014e2229d81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29619526-3255-4729-81c6-53db060e7426", "name": "network-vif-plugged", "status": "completed", "tag": "f9cbcf81-59b4-42ee-b9fb-05ef5f045b65"}]} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:41:52.652477 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-e8c2fe90-a5b3-4278-92b9-a31473d1359d req-bad56ebc-df8e-48de-af14-1014e2229d81 service nova] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:52.652992 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-e8c2fe90-a5b3-4278-92b9-a31473d1359d req-bad56ebc-df8e-48de-af14-1014e2229d81 service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:52.653420 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-e8c2fe90-a5b3-4278-92b9-a31473d1359d req-bad56ebc-df8e-48de-af14-1014e2229d81 service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:52.666410 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.compute.server_external_events [req-e8c2fe90-a5b3-4278-92b9-a31473d1359d req-bad56ebc-df8e-48de-af14-1014e2229d81 service nova] Creating event network-vif-plugged:f9cbcf81-59b4-42ee-b9fb-05ef5f045b65 for instance 29619526-3255-4729-81c6-53db060e7426 on hv-cinder-85427 Aug 24 11:41:52.671687 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [req-e8c2fe90-a5b3-4278-92b9-a31473d1359d req-bad56ebc-df8e-48de-af14-1014e2229d81 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037888 Aug 24 11:41:52.672522 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 447/945] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Aug 24 11:41:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:41:53.062371 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-de652c4d-a59e-4e71-93e0-4b9a75dddc83 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:41:53.063633 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-de652c4d-a59e-4e71-93e0-4b9a75dddc83 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] [instance: 29619526-3255-4729-81c6-53db060e7426] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:41:53.066052 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG dbcounter [-] [124769] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=124769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:41:53.070805 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-de652c4d-a59e-4e71-93e0-4b9a75dddc83 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:53.071285 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-de652c4d-a59e-4e71-93e0-4b9a75dddc83 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:53.071722 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-de652c4d-a59e-4e71-93e0-4b9a75dddc83 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:53.072405 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-de652c4d-a59e-4e71-93e0-4b9a75dddc83 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:53.072877 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-de652c4d-a59e-4e71-93e0-4b9a75dddc83 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:53.073302 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-de652c4d-a59e-4e71-93e0-4b9a75dddc83 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:53.092455 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG dbcounter [-] [124769] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=124769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:41:53.213655 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-de652c4d-a59e-4e71-93e0-4b9a75dddc83 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031939e16194f63b99e6f27f700fa8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecec6d0c155f4d658197c4779ab9ffce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:41:53.223768 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-de652c4d-a59e-4e71-93e0-4b9a75dddc83 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] 10.222.0.84 "GET /compute/v2.1/servers/29619526-3255-4729-81c6-53db060e7426" status: 200 len: 1364 microversion: 2.1 time: 0.165201 Aug 24 11:41:53.224785 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 499/946] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:41:53 2022] GET /compute/v2.1/servers/29619526-3255-4729-81c6-53db060e7426 => generated 1364 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:41:54.254068 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-40c25fd2-1ad6-4a70-8cae-ac25fcb2edd2 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:41:54.255925 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-40c25fd2-1ad6-4a70-8cae-ac25fcb2edd2 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] [instance: 29619526-3255-4729-81c6-53db060e7426] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:41:54.269320 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-40c25fd2-1ad6-4a70-8cae-ac25fcb2edd2 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:54.270116 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-40c25fd2-1ad6-4a70-8cae-ac25fcb2edd2 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:54.270757 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-40c25fd2-1ad6-4a70-8cae-ac25fcb2edd2 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:54.271881 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-40c25fd2-1ad6-4a70-8cae-ac25fcb2edd2 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:54.272517 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-40c25fd2-1ad6-4a70-8cae-ac25fcb2edd2 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:54.273149 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-40c25fd2-1ad6-4a70-8cae-ac25fcb2edd2 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:54.416050 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-40c25fd2-1ad6-4a70-8cae-ac25fcb2edd2 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031939e16194f63b99e6f27f700fa8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecec6d0c155f4d658197c4779ab9ffce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:41:54.425526 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-40c25fd2-1ad6-4a70-8cae-ac25fcb2edd2 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] 10.222.0.84 "GET /compute/v2.1/servers/29619526-3255-4729-81c6-53db060e7426" status: 200 len: 1364 microversion: 2.1 time: 0.181012 Aug 24 11:41:54.426112 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 448/947] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:41:54 2022] GET /compute/v2.1/servers/29619526-3255-4729-81c6-53db060e7426 => generated 1364 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:41:55.449964 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-8cbc148e-df1c-49b0-b5fb-e691c82d8e62 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:41:55.450814 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-8cbc148e-df1c-49b0-b5fb-e691c82d8e62 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] [instance: 29619526-3255-4729-81c6-53db060e7426] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:41:55.460168 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-8cbc148e-df1c-49b0-b5fb-e691c82d8e62 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:55.460657 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-8cbc148e-df1c-49b0-b5fb-e691c82d8e62 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:55.461275 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-8cbc148e-df1c-49b0-b5fb-e691c82d8e62 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:55.463259 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-8cbc148e-df1c-49b0-b5fb-e691c82d8e62 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:55.463259 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-8cbc148e-df1c-49b0-b5fb-e691c82d8e62 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:55.463259 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-8cbc148e-df1c-49b0-b5fb-e691c82d8e62 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:55.641316 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-8cbc148e-df1c-49b0-b5fb-e691c82d8e62 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031939e16194f63b99e6f27f700fa8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecec6d0c155f4d658197c4779ab9ffce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:41:55.655812 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-8cbc148e-df1c-49b0-b5fb-e691c82d8e62 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] 10.222.0.84 "GET /compute/v2.1/servers/29619526-3255-4729-81c6-53db060e7426" status: 200 len: 1364 microversion: 2.1 time: 0.211546 Aug 24 11:41:55.657055 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 500/948] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:41:55 2022] GET /compute/v2.1/servers/29619526-3255-4729-81c6-53db060e7426 => generated 1364 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:41:56.691378 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-36dc7a20-2ed2-4181-bed8-c8f4ab6b1717 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:41:56.692100 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-36dc7a20-2ed2-4181-bed8-c8f4ab6b1717 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] [instance: 29619526-3255-4729-81c6-53db060e7426] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:41:56.704749 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-36dc7a20-2ed2-4181-bed8-c8f4ab6b1717 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:56.706456 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-36dc7a20-2ed2-4181-bed8-c8f4ab6b1717 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:56.706914 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-36dc7a20-2ed2-4181-bed8-c8f4ab6b1717 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:56.707650 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-36dc7a20-2ed2-4181-bed8-c8f4ab6b1717 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:56.708115 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-36dc7a20-2ed2-4181-bed8-c8f4ab6b1717 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:56.708554 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-36dc7a20-2ed2-4181-bed8-c8f4ab6b1717 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:56.859556 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-36dc7a20-2ed2-4181-bed8-c8f4ab6b1717 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031939e16194f63b99e6f27f700fa8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecec6d0c155f4d658197c4779ab9ffce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:41:56.868914 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-36dc7a20-2ed2-4181-bed8-c8f4ab6b1717 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] 10.222.0.84 "GET /compute/v2.1/servers/29619526-3255-4729-81c6-53db060e7426" status: 200 len: 1549 microversion: 2.1 time: 0.183818 Aug 24 11:41:56.869531 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 449/949] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:41:56 2022] GET /compute/v2.1/servers/29619526-3255-4729-81c6-53db060e7426 => generated 1549 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:41:56.890109 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-6e73ee81-6079-4f69-9d93-f03ce2d3cb56 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:41:56.890931 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-6e73ee81-6079-4f69-9d93-f03ce2d3cb56 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] [instance: 29619526-3255-4729-81c6-53db060e7426] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:41:56.898047 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-6e73ee81-6079-4f69-9d93-f03ce2d3cb56 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:56.898532 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-6e73ee81-6079-4f69-9d93-f03ce2d3cb56 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:56.898965 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-6e73ee81-6079-4f69-9d93-f03ce2d3cb56 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:56.899663 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-6e73ee81-6079-4f69-9d93-f03ce2d3cb56 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:56.900119 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-6e73ee81-6079-4f69-9d93-f03ce2d3cb56 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:56.900550 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-6e73ee81-6079-4f69-9d93-f03ce2d3cb56 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:57.003858 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-6e73ee81-6079-4f69-9d93-f03ce2d3cb56 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] 10.222.0.84 "GET /compute/v2.1/servers/29619526-3255-4729-81c6-53db060e7426/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.117654 Aug 24 11:41:57.004863 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 501/950] 10.222.0.84 () {58 vars in 1275 bytes} [Wed Aug 24 11:41:56 2022] GET /compute/v2.1/servers/29619526-3255-4729-81c6-53db060e7426/os-interface => generated 284 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:41:58.501659 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [req-fe8020c7-45a3-4c8b-9c06-1335ec2b93b9 req-17de090e-fe1a-4c5c-bf7f-f2375825438a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29619526-3255-4729-81c6-53db060e7426", "tag": "f9cbcf81-59b4-42ee-b9fb-05ef5f045b65"}]} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:41:58.512911 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-fe8020c7-45a3-4c8b-9c06-1335ec2b93b9 req-17de090e-fe1a-4c5c-bf7f-f2375825438a service nova] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:58.513365 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-fe8020c7-45a3-4c8b-9c06-1335ec2b93b9 req-17de090e-fe1a-4c5c-bf7f-f2375825438a service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:58.513806 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-fe8020c7-45a3-4c8b-9c06-1335ec2b93b9 req-17de090e-fe1a-4c5c-bf7f-f2375825438a service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:58.534434 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.compute.server_external_events [req-fe8020c7-45a3-4c8b-9c06-1335ec2b93b9 req-17de090e-fe1a-4c5c-bf7f-f2375825438a service nova] Creating event network-changed:f9cbcf81-59b4-42ee-b9fb-05ef5f045b65 for instance 29619526-3255-4729-81c6-53db060e7426 on hv-cinder-85427 Aug 24 11:41:58.539974 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [req-fe8020c7-45a3-4c8b-9c06-1335ec2b93b9 req-17de090e-fe1a-4c5c-bf7f-f2375825438a service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042954 Aug 24 11:41:58.540664 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 450/951] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Aug 24 11:41:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:42:02.757586 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-0eca76d7-b43f-4060-a3c2-c2f8c05a28af tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:42:02.758175 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-0eca76d7-b43f-4060-a3c2-c2f8c05a28af tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] [instance: 52f331ec-d0ce-4940-8430-11e9b6732cfe] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:42:02.774369 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-0eca76d7-b43f-4060-a3c2-c2f8c05a28af tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:42:02.774862 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-0eca76d7-b43f-4060-a3c2-c2f8c05a28af tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:42:02.775303 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-0eca76d7-b43f-4060-a3c2-c2f8c05a28af tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:42:02.776005 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-0eca76d7-b43f-4060-a3c2-c2f8c05a28af tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:42:02.776457 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-0eca76d7-b43f-4060-a3c2-c2f8c05a28af tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:42:02.776943 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-0eca76d7-b43f-4060-a3c2-c2f8c05a28af tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:42:02.801538 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.objects.instance [None req-0eca76d7-b43f-4060-a3c2-c2f8c05a28af tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lazy-loading 'flavor' on Instance uuid 52f331ec-d0ce-4940-8430-11e9b6732cfe {{(pid=124769) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:42:03.200903 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-0eca76d7-b43f-4060-a3c2-c2f8c05a28af tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] 10.222.0.84 "POST /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe/action" status: 202 len: 0 microversion: 2.1 time: 0.457217 Aug 24 11:42:03.201997 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 502/952] 10.222.0.84 () {60 vars in 1278 bytes} [Wed Aug 24 11:42:02 2022] POST /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe/action => generated 0 bytes in 459 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:42:03.212670 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-fe72cdf9-857f-4049-92a0-1a675016d2b3 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:42:03.213421 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-fe72cdf9-857f-4049-92a0-1a675016d2b3 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] [instance: 52f331ec-d0ce-4940-8430-11e9b6732cfe] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:42:03.220556 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-fe72cdf9-857f-4049-92a0-1a675016d2b3 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:42:03.220899 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-fe72cdf9-857f-4049-92a0-1a675016d2b3 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:42:03.221265 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-fe72cdf9-857f-4049-92a0-1a675016d2b3 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:42:03.221976 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-fe72cdf9-857f-4049-92a0-1a675016d2b3 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:42:03.222431 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-fe72cdf9-857f-4049-92a0-1a675016d2b3 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:42:03.222857 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-fe72cdf9-857f-4049-92a0-1a675016d2b3 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:42:03.393071 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-fe72cdf9-857f-4049-92a0-1a675016d2b3 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac5dffd3204413a8834d05db267c3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31998483af514a1a8f87ab761d5cf3ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:42:03.402137 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-fe72cdf9-857f-4049-92a0-1a675016d2b3 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] 10.222.0.84 "GET /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe" status: 200 len: 1567 microversion: 2.1 time: 0.194567 Aug 24 11:42:03.402722 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 451/953] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:42:03 2022] GET /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe => generated 1567 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:42:04.426486 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-942a7b75-2a20-4c67-8405-73f68efaf985 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:42:04.427189 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-942a7b75-2a20-4c67-8405-73f68efaf985 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] [instance: 52f331ec-d0ce-4940-8430-11e9b6732cfe] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:42:04.434017 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-942a7b75-2a20-4c67-8405-73f68efaf985 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:42:04.434583 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-942a7b75-2a20-4c67-8405-73f68efaf985 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:42:04.435019 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-942a7b75-2a20-4c67-8405-73f68efaf985 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:42:04.435712 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-942a7b75-2a20-4c67-8405-73f68efaf985 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:42:04.436157 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-942a7b75-2a20-4c67-8405-73f68efaf985 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:42:04.436573 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-942a7b75-2a20-4c67-8405-73f68efaf985 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:42:04.607890 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-942a7b75-2a20-4c67-8405-73f68efaf985 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac5dffd3204413a8834d05db267c3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31998483af514a1a8f87ab761d5cf3ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:42:04.617272 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-942a7b75-2a20-4c67-8405-73f68efaf985 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] 10.222.0.84 "GET /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe" status: 200 len: 1567 microversion: 2.1 time: 0.196315 Aug 24 11:42:04.618047 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 503/954] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:42:04 2022] GET /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe => generated 1567 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:42:05.643074 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-fdcdb1ab-36bf-4999-b7f1-ac204eea5896 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:42:05.644033 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-fdcdb1ab-36bf-4999-b7f1-ac204eea5896 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] [instance: 52f331ec-d0ce-4940-8430-11e9b6732cfe] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:42:05.654346 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-fdcdb1ab-36bf-4999-b7f1-ac204eea5896 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:42:05.655113 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-fdcdb1ab-36bf-4999-b7f1-ac204eea5896 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:42:05.655833 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-fdcdb1ab-36bf-4999-b7f1-ac204eea5896 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:42:05.656631 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-fdcdb1ab-36bf-4999-b7f1-ac204eea5896 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:42:05.657168 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-fdcdb1ab-36bf-4999-b7f1-ac204eea5896 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:42:05.657629 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-fdcdb1ab-36bf-4999-b7f1-ac204eea5896 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:42:05.855103 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-fdcdb1ab-36bf-4999-b7f1-ac204eea5896 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac5dffd3204413a8834d05db267c3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31998483af514a1a8f87ab761d5cf3ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:42:05.866402 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-fdcdb1ab-36bf-4999-b7f1-ac204eea5896 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] 10.222.0.84 "GET /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe" status: 200 len: 1567 microversion: 2.1 time: 0.227647 Aug 24 11:42:05.867000 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 452/955] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:42:05 2022] GET /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe => generated 1567 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:42:06.894429 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-d7166a8b-d0f8-4cc0-9f32-8c2338700280 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:42:06.895484 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-d7166a8b-d0f8-4cc0-9f32-8c2338700280 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] [instance: 52f331ec-d0ce-4940-8430-11e9b6732cfe] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:42:06.904423 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-d7166a8b-d0f8-4cc0-9f32-8c2338700280 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:42:06.905106 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-d7166a8b-d0f8-4cc0-9f32-8c2338700280 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:42:06.905689 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-d7166a8b-d0f8-4cc0-9f32-8c2338700280 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:42:06.906689 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-d7166a8b-d0f8-4cc0-9f32-8c2338700280 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:42:06.907275 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-d7166a8b-d0f8-4cc0-9f32-8c2338700280 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:42:06.908338 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-d7166a8b-d0f8-4cc0-9f32-8c2338700280 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:42:07.060722 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-d7166a8b-d0f8-4cc0-9f32-8c2338700280 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac5dffd3204413a8834d05db267c3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31998483af514a1a8f87ab761d5cf3ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:42:07.069671 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-d7166a8b-d0f8-4cc0-9f32-8c2338700280 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] 10.222.0.84 "GET /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe" status: 200 len: 1567 microversion: 2.1 time: 0.182948 Aug 24 11:42:07.080543 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 504/956] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:42:06 2022] GET /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe => generated 1567 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:42:08.092087 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-dc8ba34f-5708-42a0-97bd-c7f374ec4bb1 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:42:08.093149 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-dc8ba34f-5708-42a0-97bd-c7f374ec4bb1 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] [instance: 52f331ec-d0ce-4940-8430-11e9b6732cfe] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:42:08.101341 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-dc8ba34f-5708-42a0-97bd-c7f374ec4bb1 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:42:08.101867 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-dc8ba34f-5708-42a0-97bd-c7f374ec4bb1 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:42:08.102310 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-dc8ba34f-5708-42a0-97bd-c7f374ec4bb1 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:42:08.103020 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-dc8ba34f-5708-42a0-97bd-c7f374ec4bb1 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:42:08.103474 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-dc8ba34f-5708-42a0-97bd-c7f374ec4bb1 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:42:08.103902 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-dc8ba34f-5708-42a0-97bd-c7f374ec4bb1 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:42:08.276077 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-dc8ba34f-5708-42a0-97bd-c7f374ec4bb1 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac5dffd3204413a8834d05db267c3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31998483af514a1a8f87ab761d5cf3ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:42:08.285768 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-dc8ba34f-5708-42a0-97bd-c7f374ec4bb1 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] 10.222.0.84 "GET /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe" status: 200 len: 1567 microversion: 2.1 time: 0.197659 Aug 24 11:42:08.286434 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 453/957] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:42:08 2022] GET /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe => generated 1567 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:42:09.307289 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-712b3fd9-71d3-4c60-bb66-ee3820006cd4 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:42:09.307902 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-712b3fd9-71d3-4c60-bb66-ee3820006cd4 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] [instance: 52f331ec-d0ce-4940-8430-11e9b6732cfe] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:42:09.314770 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-712b3fd9-71d3-4c60-bb66-ee3820006cd4 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:42:09.315256 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-712b3fd9-71d3-4c60-bb66-ee3820006cd4 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:42:09.315695 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-712b3fd9-71d3-4c60-bb66-ee3820006cd4 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:42:09.316392 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-712b3fd9-71d3-4c60-bb66-ee3820006cd4 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:42:09.316873 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-712b3fd9-71d3-4c60-bb66-ee3820006cd4 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:42:09.317304 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-712b3fd9-71d3-4c60-bb66-ee3820006cd4 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:42:09.459592 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-712b3fd9-71d3-4c60-bb66-ee3820006cd4 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac5dffd3204413a8834d05db267c3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31998483af514a1a8f87ab761d5cf3ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:42:09.467649 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-712b3fd9-71d3-4c60-bb66-ee3820006cd4 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] 10.222.0.84 "GET /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe" status: 200 len: 1567 microversion: 2.1 time: 0.164228 Aug 24 11:42:09.468317 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 505/958] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:42:09 2022] GET /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe => generated 1567 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:42:10.492370 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-9328161b-7a31-4494-a5fc-e4495236adff tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:42:10.492992 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-9328161b-7a31-4494-a5fc-e4495236adff tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] [instance: 52f331ec-d0ce-4940-8430-11e9b6732cfe] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:42:10.500078 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9328161b-7a31-4494-a5fc-e4495236adff tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:42:10.500565 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9328161b-7a31-4494-a5fc-e4495236adff tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:42:10.501037 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9328161b-7a31-4494-a5fc-e4495236adff tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:42:10.501808 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9328161b-7a31-4494-a5fc-e4495236adff tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:42:10.502267 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9328161b-7a31-4494-a5fc-e4495236adff tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:42:10.502688 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9328161b-7a31-4494-a5fc-e4495236adff tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:42:10.679657 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-9328161b-7a31-4494-a5fc-e4495236adff tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac5dffd3204413a8834d05db267c3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31998483af514a1a8f87ab761d5cf3ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:42:10.688348 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-9328161b-7a31-4494-a5fc-e4495236adff tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] 10.222.0.84 "GET /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe" status: 200 len: 1567 microversion: 2.1 time: 0.200614 Aug 24 11:42:10.689603 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 454/959] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:42:10 2022] GET /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe => generated 1567 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:42:11.710762 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-499232a7-b07c-47f3-a00c-61ca4cfece8a tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:42:11.711347 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-499232a7-b07c-47f3-a00c-61ca4cfece8a tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] [instance: 52f331ec-d0ce-4940-8430-11e9b6732cfe] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:42:11.717869 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-499232a7-b07c-47f3-a00c-61ca4cfece8a tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:42:11.718344 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-499232a7-b07c-47f3-a00c-61ca4cfece8a tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:42:11.718782 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-499232a7-b07c-47f3-a00c-61ca4cfece8a tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:42:11.719479 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-499232a7-b07c-47f3-a00c-61ca4cfece8a tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:42:11.719961 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-499232a7-b07c-47f3-a00c-61ca4cfece8a tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:42:11.721083 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-499232a7-b07c-47f3-a00c-61ca4cfece8a tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:42:11.871392 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-499232a7-b07c-47f3-a00c-61ca4cfece8a tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac5dffd3204413a8834d05db267c3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31998483af514a1a8f87ab761d5cf3ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:42:11.879992 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-499232a7-b07c-47f3-a00c-61ca4cfece8a tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] 10.222.0.84 "GET /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe" status: 200 len: 1567 microversion: 2.1 time: 0.173141 Aug 24 11:42:11.886628 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 506/960] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:42:11 2022] GET /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe => generated 1567 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:42:12.901992 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-174b7c7c-a7fc-487d-a622-d43cd4eea6dd tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:42:12.902604 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-174b7c7c-a7fc-487d-a622-d43cd4eea6dd tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] [instance: 52f331ec-d0ce-4940-8430-11e9b6732cfe] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:42:12.909993 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-174b7c7c-a7fc-487d-a622-d43cd4eea6dd tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:42:12.910396 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-174b7c7c-a7fc-487d-a622-d43cd4eea6dd tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:42:12.910834 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-174b7c7c-a7fc-487d-a622-d43cd4eea6dd tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:42:12.911549 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-174b7c7c-a7fc-487d-a622-d43cd4eea6dd tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:42:12.911993 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-174b7c7c-a7fc-487d-a622-d43cd4eea6dd tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:42:12.912419 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-174b7c7c-a7fc-487d-a622-d43cd4eea6dd tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:42:13.051869 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-174b7c7c-a7fc-487d-a622-d43cd4eea6dd tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac5dffd3204413a8834d05db267c3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31998483af514a1a8f87ab761d5cf3ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:42:13.059918 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-174b7c7c-a7fc-487d-a622-d43cd4eea6dd tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] 10.222.0.84 "GET /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe" status: 200 len: 1567 microversion: 2.1 time: 0.161934 Aug 24 11:42:13.060494 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 455/961] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:42:12 2022] GET /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe => generated 1567 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:42:14.082003 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-9bbc04e4-d1b2-47be-b21d-73f9a5811c1c tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:42:14.082612 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-9bbc04e4-d1b2-47be-b21d-73f9a5811c1c tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] [instance: 52f331ec-d0ce-4940-8430-11e9b6732cfe] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:42:14.089306 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-9bbc04e4-d1b2-47be-b21d-73f9a5811c1c tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:42:14.089789 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-9bbc04e4-d1b2-47be-b21d-73f9a5811c1c tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:42:14.090225 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-9bbc04e4-d1b2-47be-b21d-73f9a5811c1c tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:42:14.090950 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-9bbc04e4-d1b2-47be-b21d-73f9a5811c1c tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:42:14.091405 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-9bbc04e4-d1b2-47be-b21d-73f9a5811c1c tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:42:14.091835 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-9bbc04e4-d1b2-47be-b21d-73f9a5811c1c tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:42:14.253602 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-9bbc04e4-d1b2-47be-b21d-73f9a5811c1c tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac5dffd3204413a8834d05db267c3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31998483af514a1a8f87ab761d5cf3ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:42:14.262258 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-9bbc04e4-d1b2-47be-b21d-73f9a5811c1c tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] 10.222.0.84 "GET /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe" status: 200 len: 1567 microversion: 2.1 time: 0.184417 Aug 24 11:42:14.262840 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 507/962] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:42:14 2022] GET /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe => generated 1567 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:42:15.285591 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-fb2cdb63-1c50-43e9-8ce7-af6674c20807 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:42:15.286232 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-fb2cdb63-1c50-43e9-8ce7-af6674c20807 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] [instance: 52f331ec-d0ce-4940-8430-11e9b6732cfe] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:42:15.295597 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-fb2cdb63-1c50-43e9-8ce7-af6674c20807 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:42:15.296095 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-fb2cdb63-1c50-43e9-8ce7-af6674c20807 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:42:15.296535 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-fb2cdb63-1c50-43e9-8ce7-af6674c20807 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:42:15.297268 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-fb2cdb63-1c50-43e9-8ce7-af6674c20807 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:42:15.297727 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-fb2cdb63-1c50-43e9-8ce7-af6674c20807 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:42:15.298188 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-fb2cdb63-1c50-43e9-8ce7-af6674c20807 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:42:15.301631 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_cell1:SELECT=72 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:42:15.452866 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-fb2cdb63-1c50-43e9-8ce7-af6674c20807 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac5dffd3204413a8834d05db267c3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31998483af514a1a8f87ab761d5cf3ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:42:15.461098 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-fb2cdb63-1c50-43e9-8ce7-af6674c20807 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] 10.222.0.84 "GET /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe" status: 200 len: 1567 microversion: 2.1 time: 0.180871 Aug 24 11:42:15.461678 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 456/963] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:42:15 2022] GET /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe => generated 1567 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:42:16.482613 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-92334bc5-5642-4878-a3fc-0f024bfce671 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:42:16.483365 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-92334bc5-5642-4878-a3fc-0f024bfce671 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] [instance: 52f331ec-d0ce-4940-8430-11e9b6732cfe] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:42:16.490674 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-92334bc5-5642-4878-a3fc-0f024bfce671 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:42:16.491151 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-92334bc5-5642-4878-a3fc-0f024bfce671 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:42:16.491761 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-92334bc5-5642-4878-a3fc-0f024bfce671 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:42:16.492341 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-92334bc5-5642-4878-a3fc-0f024bfce671 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:42:16.492821 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-92334bc5-5642-4878-a3fc-0f024bfce671 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:42:16.493239 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-92334bc5-5642-4878-a3fc-0f024bfce671 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:42:16.645224 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-92334bc5-5642-4878-a3fc-0f024bfce671 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac5dffd3204413a8834d05db267c3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31998483af514a1a8f87ab761d5cf3ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:42:16.654342 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-92334bc5-5642-4878-a3fc-0f024bfce671 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] 10.222.0.84 "GET /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe" status: 200 len: 1567 microversion: 2.1 time: 0.175698 Aug 24 11:42:16.654959 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 508/964] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:42:16 2022] GET /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe => generated 1567 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:42:17.676707 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-1fc4eb4e-bc73-453d-b922-f2e3f32da6ce tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:42:17.677372 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-1fc4eb4e-bc73-453d-b922-f2e3f32da6ce tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] [instance: 52f331ec-d0ce-4940-8430-11e9b6732cfe] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:42:17.684028 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1fc4eb4e-bc73-453d-b922-f2e3f32da6ce tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:42:17.684503 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1fc4eb4e-bc73-453d-b922-f2e3f32da6ce tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:42:17.684967 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1fc4eb4e-bc73-453d-b922-f2e3f32da6ce tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:42:17.685656 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1fc4eb4e-bc73-453d-b922-f2e3f32da6ce tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:42:17.687110 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1fc4eb4e-bc73-453d-b922-f2e3f32da6ce tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:42:17.687546 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1fc4eb4e-bc73-453d-b922-f2e3f32da6ce tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:42:17.825262 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-1fc4eb4e-bc73-453d-b922-f2e3f32da6ce tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac5dffd3204413a8834d05db267c3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31998483af514a1a8f87ab761d5cf3ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:42:17.833282 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-1fc4eb4e-bc73-453d-b922-f2e3f32da6ce tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] 10.222.0.84 "GET /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe" status: 200 len: 1567 microversion: 2.1 time: 0.160780 Aug 24 11:42:17.833844 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 457/965] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:42:17 2022] GET /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:42:18.855718 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-3e1da47e-e9d1-48c3-9e9a-c7ecd64e92f3 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:42:18.900392 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-3e1da47e-e9d1-48c3-9e9a-c7ecd64e92f3 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] [instance: 52f331ec-d0ce-4940-8430-11e9b6732cfe] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:42:18.900392 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-3e1da47e-e9d1-48c3-9e9a-c7ecd64e92f3 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:42:18.900392 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-3e1da47e-e9d1-48c3-9e9a-c7ecd64e92f3 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:42:18.900392 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-3e1da47e-e9d1-48c3-9e9a-c7ecd64e92f3 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:42:18.900941 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-3e1da47e-e9d1-48c3-9e9a-c7ecd64e92f3 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:42:18.900941 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-3e1da47e-e9d1-48c3-9e9a-c7ecd64e92f3 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:42:18.900941 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-3e1da47e-e9d1-48c3-9e9a-c7ecd64e92f3 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:42:19.024550 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-3e1da47e-e9d1-48c3-9e9a-c7ecd64e92f3 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac5dffd3204413a8834d05db267c3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31998483af514a1a8f87ab761d5cf3ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:42:19.060747 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-3e1da47e-e9d1-48c3-9e9a-c7ecd64e92f3 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] 10.222.0.84 "GET /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe" status: 200 len: 1567 microversion: 2.1 time: 0.182611 Aug 24 11:42:19.060747 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 509/966] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:42:18 2022] GET /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe => generated 1567 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:42:20.056940 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-7449847e-134e-41c2-b98b-0de76bb67531 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:42:20.057561 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-7449847e-134e-41c2-b98b-0de76bb67531 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] [instance: 52f331ec-d0ce-4940-8430-11e9b6732cfe] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:42:20.064459 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-7449847e-134e-41c2-b98b-0de76bb67531 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:42:20.064989 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-7449847e-134e-41c2-b98b-0de76bb67531 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:42:20.065474 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-7449847e-134e-41c2-b98b-0de76bb67531 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:42:20.066172 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-7449847e-134e-41c2-b98b-0de76bb67531 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:42:20.066625 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-7449847e-134e-41c2-b98b-0de76bb67531 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:42:20.067049 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-7449847e-134e-41c2-b98b-0de76bb67531 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:42:20.212551 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-7449847e-134e-41c2-b98b-0de76bb67531 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac5dffd3204413a8834d05db267c3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31998483af514a1a8f87ab761d5cf3ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:42:20.221689 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-7449847e-134e-41c2-b98b-0de76bb67531 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] 10.222.0.84 "GET /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe" status: 200 len: 1567 microversion: 2.1 time: 0.168408 Aug 24 11:42:20.223242 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 458/967] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:42:20 2022] GET /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe => generated 1567 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:42:21.247123 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-b5e0d131-2a6d-471e-b91a-e89dcc19a448 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:42:21.247712 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-b5e0d131-2a6d-471e-b91a-e89dcc19a448 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] [instance: 52f331ec-d0ce-4940-8430-11e9b6732cfe] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:42:21.254721 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-b5e0d131-2a6d-471e-b91a-e89dcc19a448 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:42:21.255234 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-b5e0d131-2a6d-471e-b91a-e89dcc19a448 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:42:21.255684 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-b5e0d131-2a6d-471e-b91a-e89dcc19a448 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:42:21.256419 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-b5e0d131-2a6d-471e-b91a-e89dcc19a448 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:42:21.256922 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-b5e0d131-2a6d-471e-b91a-e89dcc19a448 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:42:21.257350 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-b5e0d131-2a6d-471e-b91a-e89dcc19a448 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:42:21.407549 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-b5e0d131-2a6d-471e-b91a-e89dcc19a448 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac5dffd3204413a8834d05db267c3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31998483af514a1a8f87ab761d5cf3ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:42:21.416668 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-b5e0d131-2a6d-471e-b91a-e89dcc19a448 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] 10.222.0.84 "GET /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe" status: 200 len: 1567 microversion: 2.1 time: 0.174819 Aug 24 11:42:21.417290 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 510/968] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:42:21 2022] GET /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe => generated 1567 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:42:22.438333 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-0a3484a5-bc94-4b95-8b54-43de77531071 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:42:22.438984 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-0a3484a5-bc94-4b95-8b54-43de77531071 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] [instance: 52f331ec-d0ce-4940-8430-11e9b6732cfe] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:42:22.446458 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-0a3484a5-bc94-4b95-8b54-43de77531071 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:42:22.446975 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-0a3484a5-bc94-4b95-8b54-43de77531071 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:42:22.447424 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-0a3484a5-bc94-4b95-8b54-43de77531071 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:42:22.448113 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-0a3484a5-bc94-4b95-8b54-43de77531071 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:42:22.448602 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-0a3484a5-bc94-4b95-8b54-43de77531071 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:42:22.449092 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-0a3484a5-bc94-4b95-8b54-43de77531071 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:42:22.597661 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-0a3484a5-bc94-4b95-8b54-43de77531071 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac5dffd3204413a8834d05db267c3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31998483af514a1a8f87ab761d5cf3ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:42:22.605799 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-0a3484a5-bc94-4b95-8b54-43de77531071 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] 10.222.0.84 "GET /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe" status: 200 len: 1567 microversion: 2.1 time: 0.171281 Aug 24 11:42:22.606365 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 459/969] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:42:22 2022] GET /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe => generated 1567 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:42:23.628537 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-742cdee5-8486-4032-91e3-e686554dd638 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:42:23.629799 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-742cdee5-8486-4032-91e3-e686554dd638 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] [instance: 52f331ec-d0ce-4940-8430-11e9b6732cfe] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:42:23.636371 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-742cdee5-8486-4032-91e3-e686554dd638 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:42:23.636895 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-742cdee5-8486-4032-91e3-e686554dd638 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:42:23.637335 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-742cdee5-8486-4032-91e3-e686554dd638 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:42:23.638041 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-742cdee5-8486-4032-91e3-e686554dd638 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:42:23.638514 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-742cdee5-8486-4032-91e3-e686554dd638 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:42:23.638941 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-742cdee5-8486-4032-91e3-e686554dd638 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:42:23.809282 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-742cdee5-8486-4032-91e3-e686554dd638 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac5dffd3204413a8834d05db267c3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31998483af514a1a8f87ab761d5cf3ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:42:23.824490 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-742cdee5-8486-4032-91e3-e686554dd638 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] 10.222.0.84 "GET /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe" status: 200 len: 1568 microversion: 2.1 time: 0.199509 Aug 24 11:42:23.825544 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 511/970] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:42:23 2022] GET /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe => generated 1568 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:42:23.862015 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-49af2493-a9ef-4719-9346-871cdf295a55 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:42:23.863192 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-49af2493-a9ef-4719-9346-871cdf295a55 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] [instance: 52f331ec-d0ce-4940-8430-11e9b6732cfe] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:42:23.872545 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-49af2493-a9ef-4719-9346-871cdf295a55 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:42:23.873418 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-49af2493-a9ef-4719-9346-871cdf295a55 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:42:23.873929 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-49af2493-a9ef-4719-9346-871cdf295a55 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:42:23.874795 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-49af2493-a9ef-4719-9346-871cdf295a55 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:42:23.883034 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-49af2493-a9ef-4719-9346-871cdf295a55 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:42:23.883034 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-49af2493-a9ef-4719-9346-871cdf295a55 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:42:23.927418 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-49af2493-a9ef-4719-9346-871cdf295a55 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] [instance: 52f331ec-d0ce-4940-8430-11e9b6732cfe] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=124770) unshelve /opt/stack/nova/nova/compute/api.py:4578}} Aug 24 11:42:24.339398 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-49af2493-a9ef-4719-9346-871cdf295a55 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] 10.222.0.84 "POST /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe/action" status: 202 len: 0 microversion: 2.1 time: 0.483811 Aug 24 11:42:24.340224 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 460/971] 10.222.0.84 () {60 vars in 1278 bytes} [Wed Aug 24 11:42:23 2022] POST /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe/action => generated 0 bytes in 489 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:42:24.349517 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-04832b6f-1b0e-47c7-945b-b1c6c37db563 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:42:24.350135 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-04832b6f-1b0e-47c7-945b-b1c6c37db563 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] [instance: 52f331ec-d0ce-4940-8430-11e9b6732cfe] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:42:24.356332 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-04832b6f-1b0e-47c7-945b-b1c6c37db563 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:42:24.356845 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-04832b6f-1b0e-47c7-945b-b1c6c37db563 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:42:24.357291 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-04832b6f-1b0e-47c7-945b-b1c6c37db563 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:42:24.358002 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-04832b6f-1b0e-47c7-945b-b1c6c37db563 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:42:24.358494 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-04832b6f-1b0e-47c7-945b-b1c6c37db563 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:42:24.359041 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-04832b6f-1b0e-47c7-945b-b1c6c37db563 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:42:24.544288 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-04832b6f-1b0e-47c7-945b-b1c6c37db563 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac5dffd3204413a8834d05db267c3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31998483af514a1a8f87ab761d5cf3ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:42:24.552717 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-04832b6f-1b0e-47c7-945b-b1c6c37db563 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] 10.222.0.84 "GET /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe" status: 200 len: 1516 microversion: 2.1 time: 0.208090 Aug 24 11:42:24.553655 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 512/972] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:42:24 2022] GET /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe => generated 1516 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:42:24.603854 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [req-87730ba8-c0ac-44dd-b1fe-5cfff6bcee97 req-0634dcf6-f761-49d4-8ae2-39768f83942a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52f331ec-d0ce-4940-8430-11e9b6732cfe", "name": "network-vif-unplugged", "status": "completed", "tag": "2922ba9f-42e7-4aaf-a9d1-30bc6103646f"}]} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:42:24.623467 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-87730ba8-c0ac-44dd-b1fe-5cfff6bcee97 req-0634dcf6-f761-49d4-8ae2-39768f83942a service nova] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:42:24.624095 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-87730ba8-c0ac-44dd-b1fe-5cfff6bcee97 req-0634dcf6-f761-49d4-8ae2-39768f83942a service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:42:24.624564 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-87730ba8-c0ac-44dd-b1fe-5cfff6bcee97 req-0634dcf6-f761-49d4-8ae2-39768f83942a service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:42:24.636003 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.compute.server_external_events [req-87730ba8-c0ac-44dd-b1fe-5cfff6bcee97 req-0634dcf6-f761-49d4-8ae2-39768f83942a service nova] Unable to find a host for instance 52f331ec-d0ce-4940-8430-11e9b6732cfe. Dropping event network-vif-unplugged {{(pid=124770) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 24 11:42:24.636936 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [req-87730ba8-c0ac-44dd-b1fe-5cfff6bcee97 req-0634dcf6-f761-49d4-8ae2-39768f83942a service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.037386 Aug 24 11:42:24.637837 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 461/973] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Aug 24 11:42:24 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 39 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 24 11:42:25.574847 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-93c4c3d6-eccb-4046-996d-6f5e040070c1 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:42:25.575455 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-93c4c3d6-eccb-4046-996d-6f5e040070c1 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] [instance: 52f331ec-d0ce-4940-8430-11e9b6732cfe] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:42:25.577906 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG dbcounter [-] [124769] Writing DB stats nova_api:SELECT=28 {{(pid=124769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:42:25.582703 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-93c4c3d6-eccb-4046-996d-6f5e040070c1 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:42:25.584050 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-93c4c3d6-eccb-4046-996d-6f5e040070c1 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:42:25.584515 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-93c4c3d6-eccb-4046-996d-6f5e040070c1 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:42:25.585333 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-93c4c3d6-eccb-4046-996d-6f5e040070c1 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:42:25.585845 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-93c4c3d6-eccb-4046-996d-6f5e040070c1 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:42:25.586266 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-93c4c3d6-eccb-4046-996d-6f5e040070c1 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:42:25.731766 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-93c4c3d6-eccb-4046-996d-6f5e040070c1 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac5dffd3204413a8834d05db267c3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31998483af514a1a8f87ab761d5cf3ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:42:25.740005 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-93c4c3d6-eccb-4046-996d-6f5e040070c1 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] 10.222.0.84 "GET /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe" status: 200 len: 1516 microversion: 2.1 time: 0.169034 Aug 24 11:42:25.740583 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 513/974] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:42:25 2022] GET /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe => generated 1516 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:42:26.762974 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-ded75e85-faa5-4ae8-a44f-d71ddb1f1368 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:42:26.763953 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-ded75e85-faa5-4ae8-a44f-d71ddb1f1368 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] [instance: 52f331ec-d0ce-4940-8430-11e9b6732cfe] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:42:26.766826 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:42:26.772263 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ded75e85-faa5-4ae8-a44f-d71ddb1f1368 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:42:26.772757 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ded75e85-faa5-4ae8-a44f-d71ddb1f1368 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:42:26.773225 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ded75e85-faa5-4ae8-a44f-d71ddb1f1368 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:42:26.773922 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ded75e85-faa5-4ae8-a44f-d71ddb1f1368 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:42:26.774377 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ded75e85-faa5-4ae8-a44f-d71ddb1f1368 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:42:26.774806 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ded75e85-faa5-4ae8-a44f-d71ddb1f1368 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:42:26.914736 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-ded75e85-faa5-4ae8-a44f-d71ddb1f1368 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac5dffd3204413a8834d05db267c3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31998483af514a1a8f87ab761d5cf3ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:42:26.922742 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-ded75e85-faa5-4ae8-a44f-d71ddb1f1368 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] 10.222.0.84 "GET /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe" status: 200 len: 1518 microversion: 2.1 time: 0.164336 Aug 24 11:42:26.923295 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 462/975] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:42:26 2022] GET /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe => generated 1518 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:42:27.949884 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-5ab1b7c2-0b86-4302-acc7-95d4d8b67990 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:42:27.950500 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-5ab1b7c2-0b86-4302-acc7-95d4d8b67990 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] [instance: 52f331ec-d0ce-4940-8430-11e9b6732cfe] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:42:27.957344 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-5ab1b7c2-0b86-4302-acc7-95d4d8b67990 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:42:27.958356 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-5ab1b7c2-0b86-4302-acc7-95d4d8b67990 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:42:27.958831 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-5ab1b7c2-0b86-4302-acc7-95d4d8b67990 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:42:27.959532 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-5ab1b7c2-0b86-4302-acc7-95d4d8b67990 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:42:27.959984 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-5ab1b7c2-0b86-4302-acc7-95d4d8b67990 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:42:27.960588 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-5ab1b7c2-0b86-4302-acc7-95d4d8b67990 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:42:27.963780 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG dbcounter [-] [124769] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:42:28.108646 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-5ab1b7c2-0b86-4302-acc7-95d4d8b67990 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac5dffd3204413a8834d05db267c3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31998483af514a1a8f87ab761d5cf3ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:42:28.116832 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-5ab1b7c2-0b86-4302-acc7-95d4d8b67990 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] 10.222.0.84 "GET /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe" status: 200 len: 1574 microversion: 2.1 time: 0.170768 Aug 24 11:42:28.117598 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 514/976] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:42:27 2022] GET /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe => generated 1574 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:42:29.143676 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-77663260-697a-42e9-a3a3-1c6d2a78d51b tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:42:29.144856 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-77663260-697a-42e9-a3a3-1c6d2a78d51b tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] [instance: 52f331ec-d0ce-4940-8430-11e9b6732cfe] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:42:29.156402 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-77663260-697a-42e9-a3a3-1c6d2a78d51b tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:42:29.156954 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-77663260-697a-42e9-a3a3-1c6d2a78d51b tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:42:29.157387 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-77663260-697a-42e9-a3a3-1c6d2a78d51b tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:42:29.158076 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-77663260-697a-42e9-a3a3-1c6d2a78d51b tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:42:29.158531 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-77663260-697a-42e9-a3a3-1c6d2a78d51b tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:42:29.158951 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-77663260-697a-42e9-a3a3-1c6d2a78d51b tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:42:29.295918 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-77663260-697a-42e9-a3a3-1c6d2a78d51b tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac5dffd3204413a8834d05db267c3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31998483af514a1a8f87ab761d5cf3ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:42:29.304822 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-77663260-697a-42e9-a3a3-1c6d2a78d51b tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] 10.222.0.84 "GET /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe" status: 200 len: 1574 microversion: 2.1 time: 0.165059 Aug 24 11:42:29.305561 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 463/977] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:42:29 2022] GET /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe => generated 1574 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:42:30.331448 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-0cb1fdbe-e1bd-4701-87f6-79a2c129efdb tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:42:30.332074 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-0cb1fdbe-e1bd-4701-87f6-79a2c129efdb tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] [instance: 52f331ec-d0ce-4940-8430-11e9b6732cfe] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:42:30.339934 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-0cb1fdbe-e1bd-4701-87f6-79a2c129efdb tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:42:30.340420 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-0cb1fdbe-e1bd-4701-87f6-79a2c129efdb tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:42:30.340884 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-0cb1fdbe-e1bd-4701-87f6-79a2c129efdb tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:42:30.341584 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-0cb1fdbe-e1bd-4701-87f6-79a2c129efdb tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:42:30.342035 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-0cb1fdbe-e1bd-4701-87f6-79a2c129efdb tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:42:30.342457 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-0cb1fdbe-e1bd-4701-87f6-79a2c129efdb tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:42:30.478219 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-0cb1fdbe-e1bd-4701-87f6-79a2c129efdb tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac5dffd3204413a8834d05db267c3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31998483af514a1a8f87ab761d5cf3ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:42:30.486168 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-0cb1fdbe-e1bd-4701-87f6-79a2c129efdb tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] 10.222.0.84 "GET /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe" status: 200 len: 1574 microversion: 2.1 time: 0.158611 Aug 24 11:42:30.486735 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 515/978] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:42:30 2022] GET /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe => generated 1574 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:42:31.508426 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-c7fe1bb3-3a3b-4843-b5c3-d35572e2ef5a tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:42:31.509082 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-c7fe1bb3-3a3b-4843-b5c3-d35572e2ef5a tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] [instance: 52f331ec-d0ce-4940-8430-11e9b6732cfe] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:42:31.515636 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c7fe1bb3-3a3b-4843-b5c3-d35572e2ef5a tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:42:31.516120 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c7fe1bb3-3a3b-4843-b5c3-d35572e2ef5a tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:42:31.516556 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c7fe1bb3-3a3b-4843-b5c3-d35572e2ef5a tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:42:31.517297 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c7fe1bb3-3a3b-4843-b5c3-d35572e2ef5a tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:42:31.517751 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c7fe1bb3-3a3b-4843-b5c3-d35572e2ef5a tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:42:31.518175 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c7fe1bb3-3a3b-4843-b5c3-d35572e2ef5a tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:42:31.670346 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-c7fe1bb3-3a3b-4843-b5c3-d35572e2ef5a tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac5dffd3204413a8834d05db267c3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31998483af514a1a8f87ab761d5cf3ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:42:31.679030 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-c7fe1bb3-3a3b-4843-b5c3-d35572e2ef5a tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] 10.222.0.84 "GET /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe" status: 200 len: 1574 microversion: 2.1 time: 0.174810 Aug 24 11:42:31.679607 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 464/979] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:42:31 2022] GET /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe => generated 1574 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:42:32.702207 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-6ee4e7d1-bcb6-47ad-a35f-9dafa5041873 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:42:32.702818 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-6ee4e7d1-bcb6-47ad-a35f-9dafa5041873 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] [instance: 52f331ec-d0ce-4940-8430-11e9b6732cfe] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:42:32.710517 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-6ee4e7d1-bcb6-47ad-a35f-9dafa5041873 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:42:32.710997 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-6ee4e7d1-bcb6-47ad-a35f-9dafa5041873 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:42:32.711433 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-6ee4e7d1-bcb6-47ad-a35f-9dafa5041873 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:42:32.712130 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-6ee4e7d1-bcb6-47ad-a35f-9dafa5041873 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:42:32.712581 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-6ee4e7d1-bcb6-47ad-a35f-9dafa5041873 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:42:32.713043 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-6ee4e7d1-bcb6-47ad-a35f-9dafa5041873 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:42:32.852700 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-6ee4e7d1-bcb6-47ad-a35f-9dafa5041873 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac5dffd3204413a8834d05db267c3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31998483af514a1a8f87ab761d5cf3ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:42:32.860544 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-6ee4e7d1-bcb6-47ad-a35f-9dafa5041873 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] 10.222.0.84 "GET /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe" status: 200 len: 1574 microversion: 2.1 time: 0.162299 Aug 24 11:42:32.861133 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 516/980] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:42:32 2022] GET /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe => generated 1574 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:42:33.883482 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-41591f86-4ad6-4c3a-9d52-6b9c36bdf2f4 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:42:33.884137 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-41591f86-4ad6-4c3a-9d52-6b9c36bdf2f4 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] [instance: 52f331ec-d0ce-4940-8430-11e9b6732cfe] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:42:33.891349 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-41591f86-4ad6-4c3a-9d52-6b9c36bdf2f4 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:42:33.891825 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-41591f86-4ad6-4c3a-9d52-6b9c36bdf2f4 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:42:33.892257 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-41591f86-4ad6-4c3a-9d52-6b9c36bdf2f4 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:42:33.893069 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-41591f86-4ad6-4c3a-9d52-6b9c36bdf2f4 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:42:33.893441 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-41591f86-4ad6-4c3a-9d52-6b9c36bdf2f4 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:42:33.893851 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-41591f86-4ad6-4c3a-9d52-6b9c36bdf2f4 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:42:34.041050 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-41591f86-4ad6-4c3a-9d52-6b9c36bdf2f4 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac5dffd3204413a8834d05db267c3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31998483af514a1a8f87ab761d5cf3ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:42:34.050025 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-41591f86-4ad6-4c3a-9d52-6b9c36bdf2f4 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] 10.222.0.84 "GET /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe" status: 200 len: 1574 microversion: 2.1 time: 0.170115 Aug 24 11:42:34.050605 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 465/981] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:42:33 2022] GET /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe => generated 1574 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:42:35.078675 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-4286dfc9-8df1-4b6a-b352-483059af0cdd tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:42:35.079293 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-4286dfc9-8df1-4b6a-b352-483059af0cdd tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] [instance: 52f331ec-d0ce-4940-8430-11e9b6732cfe] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:42:35.087196 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-4286dfc9-8df1-4b6a-b352-483059af0cdd tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:42:35.087687 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-4286dfc9-8df1-4b6a-b352-483059af0cdd tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:42:35.088135 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-4286dfc9-8df1-4b6a-b352-483059af0cdd tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:42:35.088897 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-4286dfc9-8df1-4b6a-b352-483059af0cdd tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:42:35.089357 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-4286dfc9-8df1-4b6a-b352-483059af0cdd tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:42:35.089786 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-4286dfc9-8df1-4b6a-b352-483059af0cdd tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:42:35.226413 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-4286dfc9-8df1-4b6a-b352-483059af0cdd tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac5dffd3204413a8834d05db267c3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31998483af514a1a8f87ab761d5cf3ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:42:35.234149 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-4286dfc9-8df1-4b6a-b352-483059af0cdd tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] 10.222.0.84 "GET /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe" status: 200 len: 1574 microversion: 2.1 time: 0.159400 Aug 24 11:42:35.234714 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 517/982] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:42:35 2022] GET /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe => generated 1574 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:42:36.257681 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-4ac745aa-a791-4a19-bf97-749dc6f98d25 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:42:36.258310 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-4ac745aa-a791-4a19-bf97-749dc6f98d25 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] [instance: 52f331ec-d0ce-4940-8430-11e9b6732cfe] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:42:36.264836 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4ac745aa-a791-4a19-bf97-749dc6f98d25 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:42:36.265320 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4ac745aa-a791-4a19-bf97-749dc6f98d25 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:42:36.265762 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4ac745aa-a791-4a19-bf97-749dc6f98d25 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:42:36.266444 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4ac745aa-a791-4a19-bf97-749dc6f98d25 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:42:36.266890 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4ac745aa-a791-4a19-bf97-749dc6f98d25 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:42:36.267318 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4ac745aa-a791-4a19-bf97-749dc6f98d25 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:42:36.404980 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-4ac745aa-a791-4a19-bf97-749dc6f98d25 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac5dffd3204413a8834d05db267c3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31998483af514a1a8f87ab761d5cf3ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:42:36.412776 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-4ac745aa-a791-4a19-bf97-749dc6f98d25 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] 10.222.0.84 "GET /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe" status: 200 len: 1574 microversion: 2.1 time: 0.159987 Aug 24 11:42:36.413354 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 466/983] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:42:36 2022] GET /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe => generated 1574 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:42:37.433964 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-5eb3bb65-d25a-4d94-b02f-7129a07fce67 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:42:37.434836 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-5eb3bb65-d25a-4d94-b02f-7129a07fce67 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] [instance: 52f331ec-d0ce-4940-8430-11e9b6732cfe] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:42:37.441212 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-5eb3bb65-d25a-4d94-b02f-7129a07fce67 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:42:37.441619 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-5eb3bb65-d25a-4d94-b02f-7129a07fce67 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:42:37.442055 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-5eb3bb65-d25a-4d94-b02f-7129a07fce67 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:42:37.442743 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-5eb3bb65-d25a-4d94-b02f-7129a07fce67 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:42:37.443201 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-5eb3bb65-d25a-4d94-b02f-7129a07fce67 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:42:37.443625 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-5eb3bb65-d25a-4d94-b02f-7129a07fce67 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:42:37.583576 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-5eb3bb65-d25a-4d94-b02f-7129a07fce67 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac5dffd3204413a8834d05db267c3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31998483af514a1a8f87ab761d5cf3ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:42:37.591936 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-5eb3bb65-d25a-4d94-b02f-7129a07fce67 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] 10.222.0.84 "GET /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe" status: 200 len: 1574 microversion: 2.1 time: 0.162119 Aug 24 11:42:37.592733 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 518/984] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:42:37 2022] GET /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe => generated 1574 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:42:38.613569 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-3f42ef0c-a46b-406e-acd6-0d2ceaab7c8e tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:42:38.614210 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-3f42ef0c-a46b-406e-acd6-0d2ceaab7c8e tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] [instance: 52f331ec-d0ce-4940-8430-11e9b6732cfe] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:42:38.621442 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-3f42ef0c-a46b-406e-acd6-0d2ceaab7c8e tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:42:38.621925 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-3f42ef0c-a46b-406e-acd6-0d2ceaab7c8e tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:42:38.622358 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-3f42ef0c-a46b-406e-acd6-0d2ceaab7c8e tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:42:38.623044 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-3f42ef0c-a46b-406e-acd6-0d2ceaab7c8e tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:42:38.623754 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-3f42ef0c-a46b-406e-acd6-0d2ceaab7c8e tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:42:38.624168 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-3f42ef0c-a46b-406e-acd6-0d2ceaab7c8e tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:42:38.929360 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-3f42ef0c-a46b-406e-acd6-0d2ceaab7c8e tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac5dffd3204413a8834d05db267c3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31998483af514a1a8f87ab761d5cf3ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:42:38.938302 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-3f42ef0c-a46b-406e-acd6-0d2ceaab7c8e tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] 10.222.0.84 "GET /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe" status: 200 len: 1574 microversion: 2.1 time: 0.328590 Aug 24 11:42:38.938953 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 467/985] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:42:38 2022] GET /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe => generated 1574 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:42:39.963354 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-debcd013-c34b-42f4-b7fd-1e92e98957ad tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:42:39.963980 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-debcd013-c34b-42f4-b7fd-1e92e98957ad tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] [instance: 52f331ec-d0ce-4940-8430-11e9b6732cfe] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:42:39.970159 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-debcd013-c34b-42f4-b7fd-1e92e98957ad tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:42:39.970652 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-debcd013-c34b-42f4-b7fd-1e92e98957ad tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:42:39.971100 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-debcd013-c34b-42f4-b7fd-1e92e98957ad tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:42:39.971798 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-debcd013-c34b-42f4-b7fd-1e92e98957ad tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:42:39.972259 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-debcd013-c34b-42f4-b7fd-1e92e98957ad tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:42:39.972690 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-debcd013-c34b-42f4-b7fd-1e92e98957ad tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:42:40.115788 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-debcd013-c34b-42f4-b7fd-1e92e98957ad tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac5dffd3204413a8834d05db267c3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31998483af514a1a8f87ab761d5cf3ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:42:40.122177 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-debcd013-c34b-42f4-b7fd-1e92e98957ad tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] 10.222.0.84 "GET /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe" status: 200 len: 1574 microversion: 2.1 time: 0.163257 Aug 24 11:42:40.122792 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 519/986] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:42:39 2022] GET /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe => generated 1574 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:42:41.147641 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-be47802b-78af-48b2-aa00-baef7f57963c tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:42:41.148248 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-be47802b-78af-48b2-aa00-baef7f57963c tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] [instance: 52f331ec-d0ce-4940-8430-11e9b6732cfe] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:42:41.158066 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-be47802b-78af-48b2-aa00-baef7f57963c tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:42:41.158338 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-be47802b-78af-48b2-aa00-baef7f57963c tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:42:41.158785 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-be47802b-78af-48b2-aa00-baef7f57963c tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:42:41.159940 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-be47802b-78af-48b2-aa00-baef7f57963c tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:42:41.160614 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-be47802b-78af-48b2-aa00-baef7f57963c tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:42:41.161068 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-be47802b-78af-48b2-aa00-baef7f57963c tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:42:41.306706 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-be47802b-78af-48b2-aa00-baef7f57963c tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac5dffd3204413a8834d05db267c3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31998483af514a1a8f87ab761d5cf3ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:42:41.313862 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-be47802b-78af-48b2-aa00-baef7f57963c tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] 10.222.0.84 "GET /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe" status: 200 len: 1574 microversion: 2.1 time: 0.170323 Aug 24 11:42:41.314420 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 468/987] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:42:41 2022] GET /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe => generated 1574 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:42:42.336958 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-72528d7a-0de4-4149-bfe9-fe8325861b86 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:42:42.338232 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-72528d7a-0de4-4149-bfe9-fe8325861b86 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] [instance: 52f331ec-d0ce-4940-8430-11e9b6732cfe] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:42:42.347417 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-72528d7a-0de4-4149-bfe9-fe8325861b86 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:42:42.347904 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-72528d7a-0de4-4149-bfe9-fe8325861b86 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:42:42.348356 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-72528d7a-0de4-4149-bfe9-fe8325861b86 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:42:42.349073 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-72528d7a-0de4-4149-bfe9-fe8325861b86 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:42:42.349816 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-72528d7a-0de4-4149-bfe9-fe8325861b86 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:42:42.350249 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-72528d7a-0de4-4149-bfe9-fe8325861b86 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:42:42.494421 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-72528d7a-0de4-4149-bfe9-fe8325861b86 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac5dffd3204413a8834d05db267c3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31998483af514a1a8f87ab761d5cf3ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:42:42.503765 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-72528d7a-0de4-4149-bfe9-fe8325861b86 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] 10.222.0.84 "GET /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe" status: 200 len: 1574 microversion: 2.1 time: 0.170809 Aug 24 11:42:42.507996 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 520/988] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:42:42 2022] GET /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe => generated 1574 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:42:43.526537 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-352db637-1d1d-4460-a653-21655331d81c tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:42:43.534501 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-352db637-1d1d-4460-a653-21655331d81c tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] [instance: 52f331ec-d0ce-4940-8430-11e9b6732cfe] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:42:43.535486 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-352db637-1d1d-4460-a653-21655331d81c tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:42:43.535978 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-352db637-1d1d-4460-a653-21655331d81c tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:42:43.536417 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-352db637-1d1d-4460-a653-21655331d81c tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:42:43.537144 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-352db637-1d1d-4460-a653-21655331d81c tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:42:43.537592 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-352db637-1d1d-4460-a653-21655331d81c tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:42:43.538007 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-352db637-1d1d-4460-a653-21655331d81c tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:42:43.682293 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-352db637-1d1d-4460-a653-21655331d81c tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac5dffd3204413a8834d05db267c3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31998483af514a1a8f87ab761d5cf3ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:42:43.691725 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-352db637-1d1d-4460-a653-21655331d81c tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] 10.222.0.84 "GET /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe" status: 200 len: 1574 microversion: 2.1 time: 0.169787 Aug 24 11:42:43.696231 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 469/989] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:42:43 2022] GET /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe => generated 1574 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:42:44.713447 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-72a49585-3b35-44a4-8ec8-2f3be8cd830e tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:42:44.714093 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-72a49585-3b35-44a4-8ec8-2f3be8cd830e tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] [instance: 52f331ec-d0ce-4940-8430-11e9b6732cfe] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:42:44.720564 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-72a49585-3b35-44a4-8ec8-2f3be8cd830e tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:42:44.721086 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-72a49585-3b35-44a4-8ec8-2f3be8cd830e tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:42:44.721530 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-72a49585-3b35-44a4-8ec8-2f3be8cd830e tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:42:44.722235 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-72a49585-3b35-44a4-8ec8-2f3be8cd830e tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:42:44.722693 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-72a49585-3b35-44a4-8ec8-2f3be8cd830e tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:42:44.723124 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-72a49585-3b35-44a4-8ec8-2f3be8cd830e tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:42:44.871608 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-72a49585-3b35-44a4-8ec8-2f3be8cd830e tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac5dffd3204413a8834d05db267c3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31998483af514a1a8f87ab761d5cf3ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:42:44.880710 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-72a49585-3b35-44a4-8ec8-2f3be8cd830e tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] 10.222.0.84 "GET /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe" status: 200 len: 1574 microversion: 2.1 time: 0.171052 Aug 24 11:42:44.881325 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 521/990] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:42:44 2022] GET /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe => generated 1574 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:42:45.906214 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-f84d84c5-f10e-4961-a2d7-3c7daf7db3e8 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:42:45.906993 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-f84d84c5-f10e-4961-a2d7-3c7daf7db3e8 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] [instance: 52f331ec-d0ce-4940-8430-11e9b6732cfe] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:42:45.913696 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-f84d84c5-f10e-4961-a2d7-3c7daf7db3e8 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:42:45.914178 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-f84d84c5-f10e-4961-a2d7-3c7daf7db3e8 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:42:45.914607 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-f84d84c5-f10e-4961-a2d7-3c7daf7db3e8 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:42:45.915604 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-f84d84c5-f10e-4961-a2d7-3c7daf7db3e8 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:42:45.916076 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-f84d84c5-f10e-4961-a2d7-3c7daf7db3e8 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:42:45.916504 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-f84d84c5-f10e-4961-a2d7-3c7daf7db3e8 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:42:45.919384 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:42:46.059484 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-f84d84c5-f10e-4961-a2d7-3c7daf7db3e8 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac5dffd3204413a8834d05db267c3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31998483af514a1a8f87ab761d5cf3ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:42:46.068522 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-f84d84c5-f10e-4961-a2d7-3c7daf7db3e8 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] 10.222.0.84 "GET /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe" status: 200 len: 1574 microversion: 2.1 time: 0.167372 Aug 24 11:42:46.069149 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 470/991] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:42:45 2022] GET /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe => generated 1574 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:42:47.091558 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-5792ec85-8c66-4ff2-901e-e2de328be082 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:42:47.091938 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-5792ec85-8c66-4ff2-901e-e2de328be082 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] [instance: 52f331ec-d0ce-4940-8430-11e9b6732cfe] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:42:47.098390 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-5792ec85-8c66-4ff2-901e-e2de328be082 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:42:47.103654 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-5792ec85-8c66-4ff2-901e-e2de328be082 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:42:47.103654 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-5792ec85-8c66-4ff2-901e-e2de328be082 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:42:47.103654 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-5792ec85-8c66-4ff2-901e-e2de328be082 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:42:47.103654 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-5792ec85-8c66-4ff2-901e-e2de328be082 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:42:47.104371 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-5792ec85-8c66-4ff2-901e-e2de328be082 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:42:47.257891 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-5792ec85-8c66-4ff2-901e-e2de328be082 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac5dffd3204413a8834d05db267c3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31998483af514a1a8f87ab761d5cf3ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:42:47.267469 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-5792ec85-8c66-4ff2-901e-e2de328be082 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] 10.222.0.84 "GET /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe" status: 200 len: 1574 microversion: 2.1 time: 0.180924 Aug 24 11:42:47.268094 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 522/992] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:42:47 2022] GET /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe => generated 1574 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:42:48.290112 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-e1c6fbe8-0144-4201-8322-6037d7559eff tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:42:48.291376 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-e1c6fbe8-0144-4201-8322-6037d7559eff tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] [instance: 52f331ec-d0ce-4940-8430-11e9b6732cfe] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:42:48.298503 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e1c6fbe8-0144-4201-8322-6037d7559eff tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:42:48.298991 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e1c6fbe8-0144-4201-8322-6037d7559eff tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:42:48.299466 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e1c6fbe8-0144-4201-8322-6037d7559eff tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:42:48.300161 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e1c6fbe8-0144-4201-8322-6037d7559eff tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:42:48.300617 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e1c6fbe8-0144-4201-8322-6037d7559eff tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:42:48.301079 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e1c6fbe8-0144-4201-8322-6037d7559eff tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:42:48.442671 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-e1c6fbe8-0144-4201-8322-6037d7559eff tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac5dffd3204413a8834d05db267c3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31998483af514a1a8f87ab761d5cf3ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:42:48.451143 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-e1c6fbe8-0144-4201-8322-6037d7559eff tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] 10.222.0.84 "GET /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe" status: 200 len: 1574 microversion: 2.1 time: 0.165207 Aug 24 11:42:48.451755 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 471/993] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:42:48 2022] GET /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe => generated 1574 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:42:49.473151 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-2250a4bf-4784-454b-8f22-c4117e22d179 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:42:49.473808 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-2250a4bf-4784-454b-8f22-c4117e22d179 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] [instance: 52f331ec-d0ce-4940-8430-11e9b6732cfe] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:42:49.481220 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-2250a4bf-4784-454b-8f22-c4117e22d179 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:42:49.481709 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-2250a4bf-4784-454b-8f22-c4117e22d179 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:42:49.482149 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-2250a4bf-4784-454b-8f22-c4117e22d179 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:42:49.482852 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-2250a4bf-4784-454b-8f22-c4117e22d179 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:42:49.483304 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-2250a4bf-4784-454b-8f22-c4117e22d179 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:42:49.483731 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-2250a4bf-4784-454b-8f22-c4117e22d179 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:42:49.628406 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-2250a4bf-4784-454b-8f22-c4117e22d179 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac5dffd3204413a8834d05db267c3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31998483af514a1a8f87ab761d5cf3ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:42:49.636309 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-2250a4bf-4784-454b-8f22-c4117e22d179 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] 10.222.0.84 "GET /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe" status: 200 len: 1574 microversion: 2.1 time: 0.167198 Aug 24 11:42:49.636874 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 523/994] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:42:49 2022] GET /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe => generated 1574 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:42:50.657350 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-7a99b519-fa9f-4377-8cde-acd0ee190641 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:42:50.658392 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-7a99b519-fa9f-4377-8cde-acd0ee190641 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] [instance: 52f331ec-d0ce-4940-8430-11e9b6732cfe] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:42:50.664876 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-7a99b519-fa9f-4377-8cde-acd0ee190641 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:42:50.665371 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-7a99b519-fa9f-4377-8cde-acd0ee190641 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:42:50.665808 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-7a99b519-fa9f-4377-8cde-acd0ee190641 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:42:50.666750 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-7a99b519-fa9f-4377-8cde-acd0ee190641 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:42:50.667309 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-7a99b519-fa9f-4377-8cde-acd0ee190641 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:42:50.667769 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-7a99b519-fa9f-4377-8cde-acd0ee190641 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:42:50.899511 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-7a99b519-fa9f-4377-8cde-acd0ee190641 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac5dffd3204413a8834d05db267c3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31998483af514a1a8f87ab761d5cf3ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:42:50.908072 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-7a99b519-fa9f-4377-8cde-acd0ee190641 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] 10.222.0.84 "GET /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe" status: 200 len: 1574 microversion: 2.1 time: 0.255019 Aug 24 11:42:50.908666 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 472/995] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:42:50 2022] GET /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe => generated 1574 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:42:51.480213 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-3c66b69b-5b75-49ff-a7b4-3aaa2847ac7b tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:42:51.481086 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-3c66b69b-5b75-49ff-a7b4-3aaa2847ac7b tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: 4b0af30d-b2e2-466a-bc9b-50ae86e6af28] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:42:51.487438 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-3c66b69b-5b75-49ff-a7b4-3aaa2847ac7b tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:42:51.487934 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-3c66b69b-5b75-49ff-a7b4-3aaa2847ac7b tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:42:51.488376 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-3c66b69b-5b75-49ff-a7b4-3aaa2847ac7b tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:42:51.489129 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-3c66b69b-5b75-49ff-a7b4-3aaa2847ac7b tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:42:51.489598 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-3c66b69b-5b75-49ff-a7b4-3aaa2847ac7b tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:42:51.490025 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-3c66b69b-5b75-49ff-a7b4-3aaa2847ac7b tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:42:51.516142 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-3c66b69b-5b75-49ff-a7b4-3aaa2847ac7b tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "GET /compute/v2.1/servers/4b0af30d-b2e2-466a-bc9b-50ae86e6af28/ips" status: 200 len: 150 microversion: 2.1 time: 0.289481 Aug 24 11:42:51.516726 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 524/996] 10.222.0.84 () {58 vars in 1248 bytes} [Wed Aug 24 11:42:51 2022] GET /compute/v2.1/servers/4b0af30d-b2e2-466a-bc9b-50ae86e6af28/ips => generated 150 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:42:51.931248 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-d94bed45-5558-4f2a-b15e-c96a70dc2291 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:42:51.931821 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-d94bed45-5558-4f2a-b15e-c96a70dc2291 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] [instance: 52f331ec-d0ce-4940-8430-11e9b6732cfe] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:42:51.938729 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d94bed45-5558-4f2a-b15e-c96a70dc2291 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:42:51.939217 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d94bed45-5558-4f2a-b15e-c96a70dc2291 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:42:51.939652 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d94bed45-5558-4f2a-b15e-c96a70dc2291 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:42:51.940357 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d94bed45-5558-4f2a-b15e-c96a70dc2291 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:42:51.940838 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d94bed45-5558-4f2a-b15e-c96a70dc2291 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:42:51.941282 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d94bed45-5558-4f2a-b15e-c96a70dc2291 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:42:52.090586 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-d94bed45-5558-4f2a-b15e-c96a70dc2291 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac5dffd3204413a8834d05db267c3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31998483af514a1a8f87ab761d5cf3ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:42:52.099318 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-d94bed45-5558-4f2a-b15e-c96a70dc2291 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] 10.222.0.84 "GET /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe" status: 200 len: 1574 microversion: 2.1 time: 0.172105 Aug 24 11:42:52.099940 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 473/997] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:42:51 2022] GET /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe => generated 1574 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:42:52.577860 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-d42e6f09-9123-4e2f-9bbb-8f9b1ea792a1 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:42:52.578633 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-d42e6f09-9123-4e2f-9bbb-8f9b1ea792a1 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: bf04b523-cedf-4e68-b77f-f6039d0de59c] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:42:52.585803 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-d42e6f09-9123-4e2f-9bbb-8f9b1ea792a1 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:42:52.586298 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-d42e6f09-9123-4e2f-9bbb-8f9b1ea792a1 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:42:52.586796 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-d42e6f09-9123-4e2f-9bbb-8f9b1ea792a1 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:42:52.587497 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-d42e6f09-9123-4e2f-9bbb-8f9b1ea792a1 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:42:52.588032 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-d42e6f09-9123-4e2f-9bbb-8f9b1ea792a1 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:42:52.589155 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-d42e6f09-9123-4e2f-9bbb-8f9b1ea792a1 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:42:52.616129 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-d42e6f09-9123-4e2f-9bbb-8f9b1ea792a1 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c/ips" status: 200 len: 152 microversion: 2.20 time: 0.219234 Aug 24 11:42:52.616697 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 525/998] 10.222.0.84 () {60 vars in 1289 bytes} [Wed Aug 24 11:42:52 2022] GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c/ips => generated 152 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 11:42:53.124659 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-fc707a9b-bfd8-44a5-87e7-7b9ff27f404f tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:42:53.125313 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-fc707a9b-bfd8-44a5-87e7-7b9ff27f404f tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] [instance: 52f331ec-d0ce-4940-8430-11e9b6732cfe] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:42:53.132442 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-fc707a9b-bfd8-44a5-87e7-7b9ff27f404f tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:42:53.132964 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-fc707a9b-bfd8-44a5-87e7-7b9ff27f404f tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:42:53.133402 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-fc707a9b-bfd8-44a5-87e7-7b9ff27f404f tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:42:53.134159 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-fc707a9b-bfd8-44a5-87e7-7b9ff27f404f tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:42:53.134611 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-fc707a9b-bfd8-44a5-87e7-7b9ff27f404f tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:42:53.135609 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-fc707a9b-bfd8-44a5-87e7-7b9ff27f404f tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:42:53.292968 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-fc707a9b-bfd8-44a5-87e7-7b9ff27f404f tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac5dffd3204413a8834d05db267c3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31998483af514a1a8f87ab761d5cf3ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:42:53.303593 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-fc707a9b-bfd8-44a5-87e7-7b9ff27f404f tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] 10.222.0.84 "GET /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe" status: 200 len: 1574 microversion: 2.1 time: 0.183084 Aug 24 11:42:53.304338 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 474/999] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:42:53 2022] GET /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe => generated 1574 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:42:54.326270 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-591fa12d-d92f-4e3e-b961-eaf0b813ba7a tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:42:54.326954 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-591fa12d-d92f-4e3e-b961-eaf0b813ba7a tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] [instance: 52f331ec-d0ce-4940-8430-11e9b6732cfe] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:42:54.327595 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-671ebbfc-7f5b-4dd6-ade5-4254c4ab5b05 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9b05511d-d63b-40b5-a67c-ee03b1887726"}} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:42:54.330068 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-671ebbfc-7f5b-4dd6-ade5-4254c4ab5b05 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: 4b0af30d-b2e2-466a-bc9b-50ae86e6af28] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:42:54.333905 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-591fa12d-d92f-4e3e-b961-eaf0b813ba7a tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:42:54.334396 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-591fa12d-d92f-4e3e-b961-eaf0b813ba7a tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:42:54.334857 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-591fa12d-d92f-4e3e-b961-eaf0b813ba7a tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:42:54.335568 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-591fa12d-d92f-4e3e-b961-eaf0b813ba7a tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:42:54.336189 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-591fa12d-d92f-4e3e-b961-eaf0b813ba7a tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:42:54.342445 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-591fa12d-d92f-4e3e-b961-eaf0b813ba7a tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:42:54.342593 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-671ebbfc-7f5b-4dd6-ade5-4254c4ab5b05 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:42:54.342593 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-671ebbfc-7f5b-4dd6-ade5-4254c4ab5b05 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:42:54.342593 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-671ebbfc-7f5b-4dd6-ade5-4254c4ab5b05 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:42:54.342593 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-671ebbfc-7f5b-4dd6-ade5-4254c4ab5b05 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:42:54.343217 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-671ebbfc-7f5b-4dd6-ade5-4254c4ab5b05 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:42:54.343217 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-671ebbfc-7f5b-4dd6-ade5-4254c4ab5b05 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:42:54.496957 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-591fa12d-d92f-4e3e-b961-eaf0b813ba7a tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac5dffd3204413a8834d05db267c3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31998483af514a1a8f87ab761d5cf3ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:42:54.512074 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-591fa12d-d92f-4e3e-b961-eaf0b813ba7a tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] 10.222.0.84 "GET /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe" status: 200 len: 1574 microversion: 2.1 time: 0.190157 Aug 24 11:42:54.513546 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 526/1000] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:42:54 2022] GET /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe => generated 1574 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:42:55.283237 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-671ebbfc-7f5b-4dd6-ade5-4254c4ab5b05 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "POST /compute/v2.1/servers/4b0af30d-b2e2-466a-bc9b-50ae86e6af28/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.960937 Aug 24 11:42:55.289497 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 475/1001] 10.222.0.84 () {60 vars in 1323 bytes} [Wed Aug 24 11:42:54 2022] POST /compute/v2.1/servers/4b0af30d-b2e2-466a-bc9b-50ae86e6af28/os-volume_attachments => generated 194 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:42:55.358157 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [req-a2626ab8-aeb7-4c88-82a5-e904a732a90b req-cbfe4751-4d9c-4ad7-a86b-e4de7af07150 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52f331ec-d0ce-4940-8430-11e9b6732cfe", "name": "network-vif-plugged", "status": "completed", "tag": "2922ba9f-42e7-4aaf-a9d1-30bc6103646f"}]} {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:42:55.367672 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [req-a2626ab8-aeb7-4c88-82a5-e904a732a90b req-cbfe4751-4d9c-4ad7-a86b-e4de7af07150 service nova] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:42:55.368269 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [req-a2626ab8-aeb7-4c88-82a5-e904a732a90b req-cbfe4751-4d9c-4ad7-a86b-e4de7af07150 service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:42:55.368694 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [req-a2626ab8-aeb7-4c88-82a5-e904a732a90b req-cbfe4751-4d9c-4ad7-a86b-e4de7af07150 service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:42:55.380411 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.compute.server_external_events [req-a2626ab8-aeb7-4c88-82a5-e904a732a90b req-cbfe4751-4d9c-4ad7-a86b-e4de7af07150 service nova] Creating event network-vif-plugged:2922ba9f-42e7-4aaf-a9d1-30bc6103646f for instance 52f331ec-d0ce-4940-8430-11e9b6732cfe on hv-cinder-85427 Aug 24 11:42:55.387275 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [req-a2626ab8-aeb7-4c88-82a5-e904a732a90b req-cbfe4751-4d9c-4ad7-a86b-e4de7af07150 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102000 Aug 24 11:42:55.388477 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 527/1002] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Aug 24 11:42:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:42:55.538506 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-fd5c4d1c-2e59-421d-9369-2a3587d2a634 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:42:55.539208 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-fd5c4d1c-2e59-421d-9369-2a3587d2a634 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] [instance: 52f331ec-d0ce-4940-8430-11e9b6732cfe] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:42:55.546352 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-fd5c4d1c-2e59-421d-9369-2a3587d2a634 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:42:55.546838 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-fd5c4d1c-2e59-421d-9369-2a3587d2a634 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:42:55.547275 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-fd5c4d1c-2e59-421d-9369-2a3587d2a634 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:42:55.547979 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-fd5c4d1c-2e59-421d-9369-2a3587d2a634 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:42:55.548859 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-fd5c4d1c-2e59-421d-9369-2a3587d2a634 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:42:55.548859 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-fd5c4d1c-2e59-421d-9369-2a3587d2a634 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:42:55.695641 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-fd5c4d1c-2e59-421d-9369-2a3587d2a634 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac5dffd3204413a8834d05db267c3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31998483af514a1a8f87ab761d5cf3ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:42:55.703542 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-fd5c4d1c-2e59-421d-9369-2a3587d2a634 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] 10.222.0.84 "GET /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe" status: 200 len: 1574 microversion: 2.1 time: 0.169524 Aug 24 11:42:55.704130 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 476/1003] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:42:55 2022] GET /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe => generated 1574 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:42:56.134364 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-735e2d30-4539-4a22-a320-6dd5c869bf68 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:42:56.135565 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-735e2d30-4539-4a22-a320-6dd5c869bf68 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: bf04b523-cedf-4e68-b77f-f6039d0de59c] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:42:56.142407 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-735e2d30-4539-4a22-a320-6dd5c869bf68 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:42:56.142808 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-735e2d30-4539-4a22-a320-6dd5c869bf68 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:42:56.143245 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-735e2d30-4539-4a22-a320-6dd5c869bf68 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:42:56.143958 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-735e2d30-4539-4a22-a320-6dd5c869bf68 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:42:56.144415 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-735e2d30-4539-4a22-a320-6dd5c869bf68 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:42:56.144870 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-735e2d30-4539-4a22-a320-6dd5c869bf68 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:42:56.170350 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.objects.instance [None req-735e2d30-4539-4a22-a320-6dd5c869bf68 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lazy-loading 'flavor' on Instance uuid bf04b523-cedf-4e68-b77f-f6039d0de59c {{(pid=124769) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:42:56.727452 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-11265098-fed8-4463-a07e-9e8c42d82d3b tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:42:56.727999 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-11265098-fed8-4463-a07e-9e8c42d82d3b tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] [instance: 52f331ec-d0ce-4940-8430-11e9b6732cfe] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:42:56.734981 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-11265098-fed8-4463-a07e-9e8c42d82d3b tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:42:56.735475 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-11265098-fed8-4463-a07e-9e8c42d82d3b tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:42:56.735943 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-11265098-fed8-4463-a07e-9e8c42d82d3b tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:42:56.736630 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-11265098-fed8-4463-a07e-9e8c42d82d3b tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:42:56.737115 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-11265098-fed8-4463-a07e-9e8c42d82d3b tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:42:56.737537 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-11265098-fed8-4463-a07e-9e8c42d82d3b tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:42:56.804090 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-735e2d30-4539-4a22-a320-6dd5c869bf68 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "POST /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c/action" status: 202 len: 0 microversion: 2.20 time: 0.673869 Aug 24 11:42:56.804699 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 528/1004] 10.222.0.84 () {62 vars in 1319 bytes} [Wed Aug 24 11:42:56 2022] POST /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c/action => generated 0 bytes in 676 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 11:42:56.814691 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-07fc10dc-9465-497e-866f-af4ecbd48563 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:42:56.815486 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-07fc10dc-9465-497e-866f-af4ecbd48563 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: bf04b523-cedf-4e68-b77f-f6039d0de59c] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:42:56.825225 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-07fc10dc-9465-497e-866f-af4ecbd48563 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:42:56.825815 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-07fc10dc-9465-497e-866f-af4ecbd48563 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:42:56.826328 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-07fc10dc-9465-497e-866f-af4ecbd48563 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:42:56.827114 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-07fc10dc-9465-497e-866f-af4ecbd48563 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:42:56.827642 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-07fc10dc-9465-497e-866f-af4ecbd48563 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:42:56.828141 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-07fc10dc-9465-497e-866f-af4ecbd48563 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:42:56.881770 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-11265098-fed8-4463-a07e-9e8c42d82d3b tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac5dffd3204413a8834d05db267c3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31998483af514a1a8f87ab761d5cf3ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:42:56.891419 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-11265098-fed8-4463-a07e-9e8c42d82d3b tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] 10.222.0.84 "GET /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe" status: 200 len: 1574 microversion: 2.1 time: 0.168226 Aug 24 11:42:56.895175 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 477/1005] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:42:56 2022] GET /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe => generated 1574 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:42:56.975872 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-07fc10dc-9465-497e-866f-af4ecbd48563 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:42:56.986695 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-07fc10dc-9465-497e-866f-af4ecbd48563 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:42:56.988656 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-07fc10dc-9465-497e-866f-af4ecbd48563 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:42:56.989987 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-07fc10dc-9465-497e-866f-af4ecbd48563 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c" status: 200 len: 1725 microversion: 2.20 time: 0.179480 Aug 24 11:42:56.990550 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 529/1006] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:42:56 2022] GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c => generated 1725 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 11:42:57.915709 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-a2aeac1f-6314-477e-b901-ab026b9ce4ea tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:42:57.924855 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-a2aeac1f-6314-477e-b901-ab026b9ce4ea tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] [instance: 52f331ec-d0ce-4940-8430-11e9b6732cfe] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:42:57.927999 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a2aeac1f-6314-477e-b901-ab026b9ce4ea tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:42:57.928892 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a2aeac1f-6314-477e-b901-ab026b9ce4ea tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:42:57.929665 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a2aeac1f-6314-477e-b901-ab026b9ce4ea tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:42:57.930934 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a2aeac1f-6314-477e-b901-ab026b9ce4ea tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:42:57.931765 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a2aeac1f-6314-477e-b901-ab026b9ce4ea tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:42:57.932693 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a2aeac1f-6314-477e-b901-ab026b9ce4ea tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:42:58.015991 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-28909daa-48e1-4ec4-8c3f-b3d89c76b173 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:42:58.017836 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-28909daa-48e1-4ec4-8c3f-b3d89c76b173 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: bf04b523-cedf-4e68-b77f-f6039d0de59c] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:42:58.027869 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG dbcounter [-] [124769] Writing DB stats nova_api:SELECT=34 {{(pid=124769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:42:58.033858 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-28909daa-48e1-4ec4-8c3f-b3d89c76b173 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:42:58.034429 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-28909daa-48e1-4ec4-8c3f-b3d89c76b173 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:42:58.034944 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-28909daa-48e1-4ec4-8c3f-b3d89c76b173 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:42:58.035732 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-28909daa-48e1-4ec4-8c3f-b3d89c76b173 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:42:58.036249 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-28909daa-48e1-4ec4-8c3f-b3d89c76b173 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:42:58.036747 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-28909daa-48e1-4ec4-8c3f-b3d89c76b173 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:42:58.039709 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG dbcounter [-] [124769] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:42:58.111653 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-a2aeac1f-6314-477e-b901-ab026b9ce4ea tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac5dffd3204413a8834d05db267c3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31998483af514a1a8f87ab761d5cf3ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:42:58.126041 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-a2aeac1f-6314-477e-b901-ab026b9ce4ea tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] 10.222.0.84 "GET /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe" status: 200 len: 1561 microversion: 2.1 time: 0.215559 Aug 24 11:42:58.127146 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 478/1007] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:42:57 2022] GET /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe => generated 1561 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:42:58.202175 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-28909daa-48e1-4ec4-8c3f-b3d89c76b173 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:42:58.210910 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-28909daa-48e1-4ec4-8c3f-b3d89c76b173 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:42:58.212396 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-28909daa-48e1-4ec4-8c3f-b3d89c76b173 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:42:58.213604 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-28909daa-48e1-4ec4-8c3f-b3d89c76b173 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c" status: 200 len: 1725 microversion: 2.20 time: 0.202574 Aug 24 11:42:58.214371 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 530/1008] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:42:58 2022] GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c => generated 1725 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 11:42:59.240530 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-8210b1b3-a374-4265-a459-5942989eafde tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:42:59.241157 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-8210b1b3-a374-4265-a459-5942989eafde tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: bf04b523-cedf-4e68-b77f-f6039d0de59c] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:42:59.246987 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_api:SELECT=34 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:42:59.253224 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8210b1b3-a374-4265-a459-5942989eafde tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:42:59.253822 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8210b1b3-a374-4265-a459-5942989eafde tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:42:59.254089 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8210b1b3-a374-4265-a459-5942989eafde tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:42:59.254803 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8210b1b3-a374-4265-a459-5942989eafde tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:42:59.256865 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8210b1b3-a374-4265-a459-5942989eafde tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:42:59.257774 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8210b1b3-a374-4265-a459-5942989eafde tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:42:59.445800 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-8210b1b3-a374-4265-a459-5942989eafde tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:42:59.454403 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-8210b1b3-a374-4265-a459-5942989eafde tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:42:59.455887 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-8210b1b3-a374-4265-a459-5942989eafde tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:42:59.457076 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-8210b1b3-a374-4265-a459-5942989eafde tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c" status: 200 len: 1725 microversion: 2.20 time: 0.220375 Aug 24 11:42:59.457625 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 479/1009] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:42:59 2022] GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c => generated 1725 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 11:43:00.482682 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-bd38982d-bb57-40e6-9661-45c37daaad70 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:43:00.483508 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-bd38982d-bb57-40e6-9661-45c37daaad70 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: bf04b523-cedf-4e68-b77f-f6039d0de59c] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:43:00.489900 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-bd38982d-bb57-40e6-9661-45c37daaad70 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:00.490380 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-bd38982d-bb57-40e6-9661-45c37daaad70 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:00.490814 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-bd38982d-bb57-40e6-9661-45c37daaad70 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:00.491562 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-bd38982d-bb57-40e6-9661-45c37daaad70 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:00.492010 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-bd38982d-bb57-40e6-9661-45c37daaad70 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:00.492431 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-bd38982d-bb57-40e6-9661-45c37daaad70 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:00.631120 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-bd38982d-bb57-40e6-9661-45c37daaad70 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:00.640786 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-bd38982d-bb57-40e6-9661-45c37daaad70 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:00.642381 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-bd38982d-bb57-40e6-9661-45c37daaad70 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:00.643506 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-bd38982d-bb57-40e6-9661-45c37daaad70 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c" status: 200 len: 1725 microversion: 2.20 time: 0.165996 Aug 24 11:43:00.644265 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 531/1010] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:43:00 2022] GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c => generated 1725 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:43:01.667613 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-8ab1bd5d-c023-4081-b220-777cd6cd8fc6 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:43:01.668214 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-8ab1bd5d-c023-4081-b220-777cd6cd8fc6 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: bf04b523-cedf-4e68-b77f-f6039d0de59c] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:43:01.675045 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8ab1bd5d-c023-4081-b220-777cd6cd8fc6 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:01.675525 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8ab1bd5d-c023-4081-b220-777cd6cd8fc6 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:01.675958 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8ab1bd5d-c023-4081-b220-777cd6cd8fc6 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:01.676669 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8ab1bd5d-c023-4081-b220-777cd6cd8fc6 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:01.677139 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8ab1bd5d-c023-4081-b220-777cd6cd8fc6 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:01.677561 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8ab1bd5d-c023-4081-b220-777cd6cd8fc6 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:01.815680 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-8ab1bd5d-c023-4081-b220-777cd6cd8fc6 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:01.824500 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-8ab1bd5d-c023-4081-b220-777cd6cd8fc6 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:01.826063 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-8ab1bd5d-c023-4081-b220-777cd6cd8fc6 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:01.827349 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-8ab1bd5d-c023-4081-b220-777cd6cd8fc6 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c" status: 200 len: 1725 microversion: 2.20 time: 0.164334 Aug 24 11:43:01.827907 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 480/1011] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:43:01 2022] GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c => generated 1725 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:43:02.854135 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-36f91349-a6d8-4519-bf2a-2b4c14c2d62a tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:43:02.854961 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-36f91349-a6d8-4519-bf2a-2b4c14c2d62a tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: bf04b523-cedf-4e68-b77f-f6039d0de59c] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:43:02.862101 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-36f91349-a6d8-4519-bf2a-2b4c14c2d62a tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:02.862581 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-36f91349-a6d8-4519-bf2a-2b4c14c2d62a tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:02.863014 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-36f91349-a6d8-4519-bf2a-2b4c14c2d62a tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:02.863940 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-36f91349-a6d8-4519-bf2a-2b4c14c2d62a tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:02.864481 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-36f91349-a6d8-4519-bf2a-2b4c14c2d62a tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:02.865218 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-36f91349-a6d8-4519-bf2a-2b4c14c2d62a tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:03.018041 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-36f91349-a6d8-4519-bf2a-2b4c14c2d62a tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:03.040242 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-36f91349-a6d8-4519-bf2a-2b4c14c2d62a tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:03.040242 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-36f91349-a6d8-4519-bf2a-2b4c14c2d62a tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:03.040242 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-36f91349-a6d8-4519-bf2a-2b4c14c2d62a tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c" status: 200 len: 1725 microversion: 2.20 time: 0.185003 Aug 24 11:43:03.041350 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 532/1012] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:43:02 2022] GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c => generated 1725 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:43:03.955906 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-d1c7ed76-b4d1-4306-a16c-72a7dd3009ed tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9b05511d-d63b-40b5-a67c-ee03b1887726"}} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:43:03.958371 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-d1c7ed76-b4d1-4306-a16c-72a7dd3009ed tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: 4b0af30d-b2e2-466a-bc9b-50ae86e6af28] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:43:03.972111 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d1c7ed76-b4d1-4306-a16c-72a7dd3009ed tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:03.972622 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d1c7ed76-b4d1-4306-a16c-72a7dd3009ed tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:03.973101 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d1c7ed76-b4d1-4306-a16c-72a7dd3009ed tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:03.973845 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d1c7ed76-b4d1-4306-a16c-72a7dd3009ed tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:03.974303 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d1c7ed76-b4d1-4306-a16c-72a7dd3009ed tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:03.974729 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d1c7ed76-b4d1-4306-a16c-72a7dd3009ed tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:04.060867 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-90c78620-3de6-40a0-9759-b894cbd10f9c tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:43:04.061547 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.wsgi [None req-d1c7ed76-b4d1-4306-a16c-72a7dd3009ed tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] HTTP exception thrown: Invalid volume: volume 9b05511d-d63b-40b5-a67c-ee03b1887726 is already attached to instances: 4b0af30d-b2e2-466a-bc9b-50ae86e6af28 Aug 24 11:43:04.061704 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-90c78620-3de6-40a0-9759-b894cbd10f9c tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: bf04b523-cedf-4e68-b77f-f6039d0de59c] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:43:04.063324 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-d1c7ed76-b4d1-4306-a16c-72a7dd3009ed tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Request method failure captured: Aug 24 11:43:04.063324 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: request: POST /compute/v2.1/servers/4b0af30d-b2e2-466a-bc9b-50ae86e6af28/os-volume_attachments HTTP/1.1 Aug 24 11:43:04.063324 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Accept: application/json Aug 24 11:43:04.063324 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Accept-Encoding: identity Aug 24 11:43:04.063324 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Connection: close Aug 24 11:43:04.063324 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Content-Length: 74 Aug 24 11:43:04.063324 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Content-Type: application/json Aug 24 11:43:04.063324 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Host: 10.222.0.84 Aug 24 11:43:04.063324 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Openstack-System-Scope: None Aug 24 11:43:04.063324 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: User-Agent: python-urllib3/1.26.11 Aug 24 11:43:04.063324 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Auth-Token: gAAAAABjBgweR4cEvCTKaEtRPVxZbNsTt1me1RX2L8orBaoPmyfbKHmzEiPGrzhUPAZ-dVqobDImAozYNHZy-giT-StyTeTjwVyRR-kCHyxEj3vuiJ5-SAwaDdad7hiiarcqgu_OA8lN_aNGemV1KcSFFCiGn60rq1bxi6ViCi6rFYftaJqzRGY Aug 24 11:43:04.063324 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Domain-Id: None Aug 24 11:43:04.063324 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Domain-Name: None Aug 24 11:43:04.063324 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Identity-Status: Confirmed Aug 24 11:43:04.063324 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Is-Admin-Project: True Aug 24 11:43:04.063324 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Project-Domain-Id: default Aug 24 11:43:04.063324 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Project-Domain-Name: Default Aug 24 11:43:04.063324 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Project-Id: 4a4159dc366f41bc9e4057a079f6fb5a Aug 24 11:43:04.063324 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Project-Name: tempest-AttachVolumeNegativeTest-1758140935 Aug 24 11:43:04.063324 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Role: reader,member Aug 24 11:43:04.063324 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Roles: reader,member Aug 24 11:43:04.065006 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/volume/v3/4a4159dc366f41bc9e4057a079f6fb5a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/volume/v3/4a4159dc366f41bc9e4057a079f6fb5a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/compute/v2/4a4159dc366f41bc9e4057a079f6fb5a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84:8080/v1/AUTH_4a4159dc366f41bc9e4057a079f6fb5a", "adminURL": "http://10.222.0.84:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/placement"}]}] Aug 24 11:43:04.065006 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Tenant: tempest-AttachVolumeNegativeTest-1758140935 Aug 24 11:43:04.065006 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Tenant-Id: 4a4159dc366f41bc9e4057a079f6fb5a Aug 24 11:43:04.065006 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1758140935 Aug 24 11:43:04.065006 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User: tempest-AttachVolumeNegativeTest-1758140935-project Aug 24 11:43:04.065006 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User-Domain-Id: default Aug 24 11:43:04.065006 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User-Domain-Name: Default Aug 24 11:43:04.065006 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User-Id: 2715cf2a5129439c83a5347bb963f1a9 Aug 24 11:43:04.065006 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User-Name: tempest-AttachVolumeNegativeTest-1758140935-project Aug 24 11:43:04.065006 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Aug 24 11:43:04.065006 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: {"volumeAttachment": {"volumeId": "9b05511d-d63b-40b5-a67c-ee03b1887726"}} Aug 24 11:43:04.065006 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: method: > Aug 24 11:43:04.065952 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: exception: Invalid volume: volume 9b05511d-d63b-40b5-a67c-ee03b1887726 is already attached to instances: 4b0af30d-b2e2-466a-bc9b-50ae86e6af28 Aug 24 11:43:04.065952 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: action_args: {'server_id': '4b0af30d-b2e2-466a-bc9b-50ae86e6af28', 'body': {'volumeAttachment': {'volumeId': '9b05511d-d63b-40b5-a67c-ee03b1887726'}}} Aug 24 11:43:04.065952 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:43:04.065952 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:43:04.065952 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 24 11:43:04.065952 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 24 11:43:04.065952 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 11:43:04.065952 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 11:43:04.065952 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 24 11:43:04.065952 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 24 11:43:04.065952 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5113, in attach_volume Aug 24 11:43:04.065952 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 24 11:43:04.065952 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4953, in _check_volume_already_attached Aug 24 11:43:04.065952 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 24 11:43:04.065952 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 9b05511d-d63b-40b5-a67c-ee03b1887726 is already attached to instances: 4b0af30d-b2e2-466a-bc9b-50ae86e6af28 Aug 24 11:43:04.065952 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:43:04.065952 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:43:04.065952 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:43:04.065952 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:43:04.067510 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:43:04.067510 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:43:04.067510 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:43:04.067510 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:43:04.067510 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:43:04.067510 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:43:04.067510 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 11:43:04.067510 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 11:43:04.067510 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 11:43:04.067510 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 11:43:04.067510 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 11:43:04.067510 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 11:43:04.067510 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 24 11:43:04.067510 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 24 11:43:04.067510 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 9b05511d-d63b-40b5-a67c-ee03b1887726 is already attached to instances: 4b0af30d-b2e2-466a-bc9b-50ae86e6af28 Aug 24 11:43:04.067510 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:43:04.067510 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:43:04.067510 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:43:04.067510 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:43:04.067510 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:43:04.069231 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:43:04.069231 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:43:04.069231 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:43:04.069231 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 9b05511d-d63b-40b5-a67c-ee03b1887726 is already attached to instances: 4b0af30d-b2e2-466a-bc9b-50ae86e6af28 Aug 24 11:43:04.069231 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:43:04.069231 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-d1c7ed76-b4d1-4306-a16c-72a7dd3009ed tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Returning 400 to user: Invalid volume: volume 9b05511d-d63b-40b5-a67c-ee03b1887726 is already attached to instances: 4b0af30d-b2e2-466a-bc9b-50ae86e6af28 {{(pid=124770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:43:04.069231 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-d1c7ed76-b4d1-4306-a16c-72a7dd3009ed tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "POST /compute/v2.1/servers/4b0af30d-b2e2-466a-bc9b-50ae86e6af28/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.112985 Aug 24 11:43:04.069231 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 481/1013] 10.222.0.84 () {60 vars in 1323 bytes} [Wed Aug 24 11:43:03 2022] POST /compute/v2.1/servers/4b0af30d-b2e2-466a-bc9b-50ae86e6af28/os-volume_attachments => generated 174 bytes in 114 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 11:43:04.071440 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-90c78620-3de6-40a0-9759-b894cbd10f9c tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:04.072043 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-90c78620-3de6-40a0-9759-b894cbd10f9c tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:04.073131 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-90c78620-3de6-40a0-9759-b894cbd10f9c tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:04.074109 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-90c78620-3de6-40a0-9759-b894cbd10f9c tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:04.074299 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-90c78620-3de6-40a0-9759-b894cbd10f9c tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:04.074763 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-90c78620-3de6-40a0-9759-b894cbd10f9c tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:04.140936 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-001c8b55-5c1c-40b5-8e1d-8c2c98eb5b03 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:43:04.141417 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-001c8b55-5c1c-40b5-8e1d-8c2c98eb5b03 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: 4b0af30d-b2e2-466a-bc9b-50ae86e6af28] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:43:04.147393 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-001c8b55-5c1c-40b5-8e1d-8c2c98eb5b03 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:04.147918 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-001c8b55-5c1c-40b5-8e1d-8c2c98eb5b03 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:04.148382 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-001c8b55-5c1c-40b5-8e1d-8c2c98eb5b03 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:04.149091 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-001c8b55-5c1c-40b5-8e1d-8c2c98eb5b03 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:04.149539 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-001c8b55-5c1c-40b5-8e1d-8c2c98eb5b03 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:04.150060 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-001c8b55-5c1c-40b5-8e1d-8c2c98eb5b03 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:04.218812 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-90c78620-3de6-40a0-9759-b894cbd10f9c tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:04.229289 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-90c78620-3de6-40a0-9759-b894cbd10f9c tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:04.230934 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-90c78620-3de6-40a0-9759-b894cbd10f9c tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:04.232144 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-90c78620-3de6-40a0-9759-b894cbd10f9c tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c" status: 200 len: 1725 microversion: 2.20 time: 0.176899 Aug 24 11:43:04.239180 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 533/1014] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:43:04 2022] GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c => generated 1725 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 11:43:04.243285 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.objects.instance [None req-001c8b55-5c1c-40b5-8e1d-8c2c98eb5b03 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lazy-loading 'services' on Instance uuid 4b0af30d-b2e2-466a-bc9b-50ae86e6af28 {{(pid=124770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:43:04.576411 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-001c8b55-5c1c-40b5-8e1d-8c2c98eb5b03 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "DELETE /compute/v2.1/servers/4b0af30d-b2e2-466a-bc9b-50ae86e6af28/os-volume_attachments/9b05511d-d63b-40b5-a67c-ee03b1887726" status: 202 len: 0 microversion: 2.1 time: 0.439603 Aug 24 11:43:04.577047 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 482/1015] 10.222.0.84 () {58 vars in 1416 bytes} [Wed Aug 24 11:43:04 2022] DELETE /compute/v2.1/servers/4b0af30d-b2e2-466a-bc9b-50ae86e6af28/os-volume_attachments/9b05511d-d63b-40b5-a67c-ee03b1887726 => generated 0 bytes in 441 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 11:43:04.586836 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-ee4a9d09-cfb8-44a4-aebb-760f3a0be514 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:43:04.589313 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-ee4a9d09-cfb8-44a4-aebb-760f3a0be514 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: 4b0af30d-b2e2-466a-bc9b-50ae86e6af28] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:43:04.595600 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-ee4a9d09-cfb8-44a4-aebb-760f3a0be514 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:04.596017 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-ee4a9d09-cfb8-44a4-aebb-760f3a0be514 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:04.596467 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-ee4a9d09-cfb8-44a4-aebb-760f3a0be514 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:04.597231 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-ee4a9d09-cfb8-44a4-aebb-760f3a0be514 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:04.597693 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-ee4a9d09-cfb8-44a4-aebb-760f3a0be514 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:04.598124 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-ee4a9d09-cfb8-44a4-aebb-760f3a0be514 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:04.631355 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-ee4a9d09-cfb8-44a4-aebb-760f3a0be514 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "GET /compute/v2.1/servers/4b0af30d-b2e2-466a-bc9b-50ae86e6af28/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049617 Aug 24 11:43:04.631928 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 534/1016] 10.222.0.84 () {58 vars in 1302 bytes} [Wed Aug 24 11:43:04 2022] GET /compute/v2.1/servers/4b0af30d-b2e2-466a-bc9b-50ae86e6af28/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:43:05.258866 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-bbd67b40-a839-4d65-a0d7-adf872549397 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:43:05.260637 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-bbd67b40-a839-4d65-a0d7-adf872549397 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: bf04b523-cedf-4e68-b77f-f6039d0de59c] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:43:05.271557 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-bbd67b40-a839-4d65-a0d7-adf872549397 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:05.272348 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-bbd67b40-a839-4d65-a0d7-adf872549397 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:05.272972 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-bbd67b40-a839-4d65-a0d7-adf872549397 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:05.273834 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-bbd67b40-a839-4d65-a0d7-adf872549397 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:05.274603 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-bbd67b40-a839-4d65-a0d7-adf872549397 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:05.275690 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-bbd67b40-a839-4d65-a0d7-adf872549397 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:05.439712 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-bbd67b40-a839-4d65-a0d7-adf872549397 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:05.448904 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-bbd67b40-a839-4d65-a0d7-adf872549397 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:05.450454 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-bbd67b40-a839-4d65-a0d7-adf872549397 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:05.451616 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-bbd67b40-a839-4d65-a0d7-adf872549397 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c" status: 200 len: 1725 microversion: 2.20 time: 0.198812 Aug 24 11:43:05.452159 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 483/1017] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:43:05 2022] GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c => generated 1725 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:43:05.643250 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-285895d1-c279-4775-a872-2a2e0156ec27 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:43:05.645437 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-285895d1-c279-4775-a872-2a2e0156ec27 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: 4b0af30d-b2e2-466a-bc9b-50ae86e6af28] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:43:05.652209 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-285895d1-c279-4775-a872-2a2e0156ec27 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:05.652694 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-285895d1-c279-4775-a872-2a2e0156ec27 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:05.653567 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-285895d1-c279-4775-a872-2a2e0156ec27 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:05.654795 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-285895d1-c279-4775-a872-2a2e0156ec27 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:05.654795 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-285895d1-c279-4775-a872-2a2e0156ec27 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:05.655123 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-285895d1-c279-4775-a872-2a2e0156ec27 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:05.687554 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-285895d1-c279-4775-a872-2a2e0156ec27 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "GET /compute/v2.1/servers/4b0af30d-b2e2-466a-bc9b-50ae86e6af28/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048262 Aug 24 11:43:05.688135 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 535/1018] 10.222.0.84 () {58 vars in 1302 bytes} [Wed Aug 24 11:43:05 2022] GET /compute/v2.1/servers/4b0af30d-b2e2-466a-bc9b-50ae86e6af28/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:43:06.479488 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-05e79d2d-b81a-49ae-ac62-513cf79aca4c tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:43:06.480127 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-05e79d2d-b81a-49ae-ac62-513cf79aca4c tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: bf04b523-cedf-4e68-b77f-f6039d0de59c] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:43:06.486930 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-05e79d2d-b81a-49ae-ac62-513cf79aca4c tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:06.487414 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-05e79d2d-b81a-49ae-ac62-513cf79aca4c tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:06.487857 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-05e79d2d-b81a-49ae-ac62-513cf79aca4c tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:06.488587 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-05e79d2d-b81a-49ae-ac62-513cf79aca4c tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:06.489084 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-05e79d2d-b81a-49ae-ac62-513cf79aca4c tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:06.489632 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-05e79d2d-b81a-49ae-ac62-513cf79aca4c tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:06.624650 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-05e79d2d-b81a-49ae-ac62-513cf79aca4c tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:06.627001 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:43:06.633580 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-05e79d2d-b81a-49ae-ac62-513cf79aca4c tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:06.635748 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-05e79d2d-b81a-49ae-ac62-513cf79aca4c tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:06.636934 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-05e79d2d-b81a-49ae-ac62-513cf79aca4c tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c" status: 200 len: 1725 microversion: 2.20 time: 0.162642 Aug 24 11:43:06.637483 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 484/1019] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:43:06 2022] GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:43:06.700928 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-bfdffb8f-d9c2-4c9b-b55d-c3d681321f31 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:43:06.703066 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-bfdffb8f-d9c2-4c9b-b55d-c3d681321f31 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: 4b0af30d-b2e2-466a-bc9b-50ae86e6af28] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:43:06.709621 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-bfdffb8f-d9c2-4c9b-b55d-c3d681321f31 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:06.710112 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-bfdffb8f-d9c2-4c9b-b55d-c3d681321f31 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:06.710542 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-bfdffb8f-d9c2-4c9b-b55d-c3d681321f31 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:06.711325 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-bfdffb8f-d9c2-4c9b-b55d-c3d681321f31 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:06.711674 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-bfdffb8f-d9c2-4c9b-b55d-c3d681321f31 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:06.712094 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-bfdffb8f-d9c2-4c9b-b55d-c3d681321f31 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:06.743133 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-bfdffb8f-d9c2-4c9b-b55d-c3d681321f31 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "GET /compute/v2.1/servers/4b0af30d-b2e2-466a-bc9b-50ae86e6af28/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046695 Aug 24 11:43:06.743655 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 536/1020] 10.222.0.84 () {58 vars in 1302 bytes} [Wed Aug 24 11:43:06 2022] GET /compute/v2.1/servers/4b0af30d-b2e2-466a-bc9b-50ae86e6af28/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 11:43:06.817619 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-b7ebdaba-ff25-4ceb-8f7f-c89f6388af95 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:43:06.835253 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-b7ebdaba-ff25-4ceb-8f7f-c89f6388af95 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: 4b0af30d-b2e2-466a-bc9b-50ae86e6af28] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:43:06.835253 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b7ebdaba-ff25-4ceb-8f7f-c89f6388af95 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:06.835253 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b7ebdaba-ff25-4ceb-8f7f-c89f6388af95 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:06.835253 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b7ebdaba-ff25-4ceb-8f7f-c89f6388af95 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:06.835719 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b7ebdaba-ff25-4ceb-8f7f-c89f6388af95 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:06.835719 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b7ebdaba-ff25-4ceb-8f7f-c89f6388af95 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:06.835719 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b7ebdaba-ff25-4ceb-8f7f-c89f6388af95 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:06.852725 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-b7ebdaba-ff25-4ceb-8f7f-c89f6388af95 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: 4b0af30d-b2e2-466a-bc9b-50ae86e6af28] Going to try to terminate instance {{(pid=124770) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 11:43:07.262791 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-b7ebdaba-ff25-4ceb-8f7f-c89f6388af95 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "DELETE /compute/v2.1/servers/4b0af30d-b2e2-466a-bc9b-50ae86e6af28" status: 204 len: 0 microversion: 2.1 time: 0.451653 Aug 24 11:43:07.263434 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 485/1021] 10.222.0.84 () {58 vars in 1239 bytes} [Wed Aug 24 11:43:06 2022] DELETE /compute/v2.1/servers/4b0af30d-b2e2-466a-bc9b-50ae86e6af28 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 11:43:07.271738 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-0e18e489-d974-44f6-84a3-fa0cb87ca053 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:43:07.272417 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-0e18e489-d974-44f6-84a3-fa0cb87ca053 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: 4b0af30d-b2e2-466a-bc9b-50ae86e6af28] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:43:07.279032 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-0e18e489-d974-44f6-84a3-fa0cb87ca053 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:07.279517 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-0e18e489-d974-44f6-84a3-fa0cb87ca053 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:07.279948 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-0e18e489-d974-44f6-84a3-fa0cb87ca053 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:07.280668 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-0e18e489-d974-44f6-84a3-fa0cb87ca053 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:07.281145 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-0e18e489-d974-44f6-84a3-fa0cb87ca053 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:07.281612 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-0e18e489-d974-44f6-84a3-fa0cb87ca053 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:07.455107 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-0e18e489-d974-44f6-84a3-fa0cb87ca053 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2715cf2a5129439c83a5347bb963f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4159dc366f41bc9e4057a079f6fb5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:07.455107 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-0e18e489-d974-44f6-84a3-fa0cb87ca053 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "GET /compute/v2.1/servers/4b0af30d-b2e2-466a-bc9b-50ae86e6af28" status: 200 len: 1682 microversion: 2.1 time: 0.173069 Aug 24 11:43:07.455107 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 537/1022] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:43:07 2022] GET /compute/v2.1/servers/4b0af30d-b2e2-466a-bc9b-50ae86e6af28 => generated 1682 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:43:07.662424 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-5f6c9026-8f11-4173-9750-44c844ab4c43 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:43:07.663164 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-5f6c9026-8f11-4173-9750-44c844ab4c43 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: bf04b523-cedf-4e68-b77f-f6039d0de59c] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:43:07.670981 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5f6c9026-8f11-4173-9750-44c844ab4c43 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:07.671476 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5f6c9026-8f11-4173-9750-44c844ab4c43 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:07.671919 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5f6c9026-8f11-4173-9750-44c844ab4c43 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:07.672624 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5f6c9026-8f11-4173-9750-44c844ab4c43 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:07.673122 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5f6c9026-8f11-4173-9750-44c844ab4c43 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:07.673555 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5f6c9026-8f11-4173-9750-44c844ab4c43 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:07.823672 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-5f6c9026-8f11-4173-9750-44c844ab4c43 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:07.832530 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-5f6c9026-8f11-4173-9750-44c844ab4c43 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:07.834059 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-5f6c9026-8f11-4173-9750-44c844ab4c43 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:07.835256 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-5f6c9026-8f11-4173-9750-44c844ab4c43 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c" status: 200 len: 1725 microversion: 2.20 time: 0.178438 Aug 24 11:43:07.835821 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 486/1023] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:43:07 2022] GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c => generated 1725 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:43:08.461934 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-ef7cb61a-8b6d-423d-82f4-75f68f05f9a9 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:43:08.463169 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-ef7cb61a-8b6d-423d-82f4-75f68f05f9a9 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: 4b0af30d-b2e2-466a-bc9b-50ae86e6af28] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:43:08.470116 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-ef7cb61a-8b6d-423d-82f4-75f68f05f9a9 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:08.471828 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-ef7cb61a-8b6d-423d-82f4-75f68f05f9a9 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:08.471828 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-ef7cb61a-8b6d-423d-82f4-75f68f05f9a9 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:08.471828 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-ef7cb61a-8b6d-423d-82f4-75f68f05f9a9 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:08.472173 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-ef7cb61a-8b6d-423d-82f4-75f68f05f9a9 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:08.472575 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-ef7cb61a-8b6d-423d-82f4-75f68f05f9a9 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:08.626285 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-ef7cb61a-8b6d-423d-82f4-75f68f05f9a9 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2715cf2a5129439c83a5347bb963f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4159dc366f41bc9e4057a079f6fb5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:08.635520 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-ef7cb61a-8b6d-423d-82f4-75f68f05f9a9 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "GET /compute/v2.1/servers/4b0af30d-b2e2-466a-bc9b-50ae86e6af28" status: 200 len: 1682 microversion: 2.1 time: 0.177426 Aug 24 11:43:08.636102 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 538/1024] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:43:08 2022] GET /compute/v2.1/servers/4b0af30d-b2e2-466a-bc9b-50ae86e6af28 => generated 1682 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:43:08.859820 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-08e21736-8fce-4bb7-a8d9-5e348c7cbe3d tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:43:08.860494 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-08e21736-8fce-4bb7-a8d9-5e348c7cbe3d tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: bf04b523-cedf-4e68-b77f-f6039d0de59c] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:43:08.867151 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-08e21736-8fce-4bb7-a8d9-5e348c7cbe3d tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:08.867635 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-08e21736-8fce-4bb7-a8d9-5e348c7cbe3d tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:08.868076 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-08e21736-8fce-4bb7-a8d9-5e348c7cbe3d tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:08.869359 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-08e21736-8fce-4bb7-a8d9-5e348c7cbe3d tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:08.869894 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-08e21736-8fce-4bb7-a8d9-5e348c7cbe3d tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:08.870320 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-08e21736-8fce-4bb7-a8d9-5e348c7cbe3d tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:09.020327 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-08e21736-8fce-4bb7-a8d9-5e348c7cbe3d tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:09.029740 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-08e21736-8fce-4bb7-a8d9-5e348c7cbe3d tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:09.032553 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-08e21736-8fce-4bb7-a8d9-5e348c7cbe3d tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:09.032553 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-08e21736-8fce-4bb7-a8d9-5e348c7cbe3d tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c" status: 200 len: 1725 microversion: 2.20 time: 0.176732 Aug 24 11:43:09.033006 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 487/1025] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:43:08 2022] GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c => generated 1725 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:43:09.658172 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-91428ede-f51f-43df-83d2-d321b718c818 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:43:09.658937 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-91428ede-f51f-43df-83d2-d321b718c818 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: 4b0af30d-b2e2-466a-bc9b-50ae86e6af28] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:43:09.665273 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-91428ede-f51f-43df-83d2-d321b718c818 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:09.666356 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-91428ede-f51f-43df-83d2-d321b718c818 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:09.666356 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-91428ede-f51f-43df-83d2-d321b718c818 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:09.667125 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-91428ede-f51f-43df-83d2-d321b718c818 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:09.667434 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-91428ede-f51f-43df-83d2-d321b718c818 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:09.667887 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-91428ede-f51f-43df-83d2-d321b718c818 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:09.808081 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-91428ede-f51f-43df-83d2-d321b718c818 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2715cf2a5129439c83a5347bb963f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4159dc366f41bc9e4057a079f6fb5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:09.817020 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-91428ede-f51f-43df-83d2-d321b718c818 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "GET /compute/v2.1/servers/4b0af30d-b2e2-466a-bc9b-50ae86e6af28" status: 200 len: 1682 microversion: 2.1 time: 0.163412 Aug 24 11:43:09.817626 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 539/1026] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:43:09 2022] GET /compute/v2.1/servers/4b0af30d-b2e2-466a-bc9b-50ae86e6af28 => generated 1682 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:43:10.056938 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-46091cb8-a754-4497-b2a8-fe940a18af2e tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:43:10.057560 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-46091cb8-a754-4497-b2a8-fe940a18af2e tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: bf04b523-cedf-4e68-b77f-f6039d0de59c] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:43:10.064353 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-46091cb8-a754-4497-b2a8-fe940a18af2e tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:10.064872 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-46091cb8-a754-4497-b2a8-fe940a18af2e tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:10.065313 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-46091cb8-a754-4497-b2a8-fe940a18af2e tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:10.066433 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-46091cb8-a754-4497-b2a8-fe940a18af2e tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:10.066574 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-46091cb8-a754-4497-b2a8-fe940a18af2e tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:10.067011 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-46091cb8-a754-4497-b2a8-fe940a18af2e tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:10.279202 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-46091cb8-a754-4497-b2a8-fe940a18af2e tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:10.288009 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-46091cb8-a754-4497-b2a8-fe940a18af2e tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:10.289571 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-46091cb8-a754-4497-b2a8-fe940a18af2e tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:10.291479 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-46091cb8-a754-4497-b2a8-fe940a18af2e tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c" status: 200 len: 1725 microversion: 2.20 time: 0.238577 Aug 24 11:43:10.292082 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 488/1027] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:43:10 2022] GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c => generated 1725 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:43:10.842264 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-80cb327a-a4ce-4996-bcab-5a3f97376510 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:43:10.842893 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-80cb327a-a4ce-4996-bcab-5a3f97376510 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: 4b0af30d-b2e2-466a-bc9b-50ae86e6af28] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:43:10.855683 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-80cb327a-a4ce-4996-bcab-5a3f97376510 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:10.856464 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-80cb327a-a4ce-4996-bcab-5a3f97376510 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:10.857174 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-80cb327a-a4ce-4996-bcab-5a3f97376510 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:10.858602 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-80cb327a-a4ce-4996-bcab-5a3f97376510 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:10.859376 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-80cb327a-a4ce-4996-bcab-5a3f97376510 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:10.860113 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-80cb327a-a4ce-4996-bcab-5a3f97376510 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:10.946498 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-80cb327a-a4ce-4996-bcab-5a3f97376510 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2715cf2a5129439c83a5347bb963f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4159dc366f41bc9e4057a079f6fb5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:10.966814 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-80cb327a-a4ce-4996-bcab-5a3f97376510 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "GET /compute/v2.1/servers/4b0af30d-b2e2-466a-bc9b-50ae86e6af28" status: 200 len: 1615 microversion: 2.1 time: 0.130476 Aug 24 11:43:10.968298 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 540/1028] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:43:10 2022] GET /compute/v2.1/servers/4b0af30d-b2e2-466a-bc9b-50ae86e6af28 => generated 1615 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:43:11.097482 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [req-0ee83dd4-61af-494e-b6b6-1c0b0c598a70 req-79bc81b2-b201-4692-8124-be8b7398cf80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b0af30d-b2e2-466a-bc9b-50ae86e6af28", "name": "network-vif-deleted", "tag": "78105eb8-f7d5-4afd-812f-3c338f397c22"}]} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:43:11.111126 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-0ee83dd4-61af-494e-b6b6-1c0b0c598a70 req-79bc81b2-b201-4692-8124-be8b7398cf80 service nova] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:11.111974 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-0ee83dd4-61af-494e-b6b6-1c0b0c598a70 req-79bc81b2-b201-4692-8124-be8b7398cf80 service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:11.113239 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-0ee83dd4-61af-494e-b6b6-1c0b0c598a70 req-79bc81b2-b201-4692-8124-be8b7398cf80 service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:11.126892 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.compute.server_external_events [req-0ee83dd4-61af-494e-b6b6-1c0b0c598a70 req-79bc81b2-b201-4692-8124-be8b7398cf80 service nova] Creating event network-vif-deleted:78105eb8-f7d5-4afd-812f-3c338f397c22 for instance 4b0af30d-b2e2-466a-bc9b-50ae86e6af28 on hv-cinder-85427 Aug 24 11:43:11.133031 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [req-0ee83dd4-61af-494e-b6b6-1c0b0c598a70 req-79bc81b2-b201-4692-8124-be8b7398cf80 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114539 Aug 24 11:43:11.133925 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 489/1029] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Aug 24 11:43:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:43:11.320102 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-d9d360fc-a776-4861-8e15-f73f9b9ebb68 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:43:11.320712 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-d9d360fc-a776-4861-8e15-f73f9b9ebb68 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: bf04b523-cedf-4e68-b77f-f6039d0de59c] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:43:11.327759 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-d9d360fc-a776-4861-8e15-f73f9b9ebb68 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:11.328684 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-d9d360fc-a776-4861-8e15-f73f9b9ebb68 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:11.329179 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-d9d360fc-a776-4861-8e15-f73f9b9ebb68 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:11.329905 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-d9d360fc-a776-4861-8e15-f73f9b9ebb68 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:11.330371 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-d9d360fc-a776-4861-8e15-f73f9b9ebb68 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:11.330793 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-d9d360fc-a776-4861-8e15-f73f9b9ebb68 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:11.500646 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-d9d360fc-a776-4861-8e15-f73f9b9ebb68 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:11.511403 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-d9d360fc-a776-4861-8e15-f73f9b9ebb68 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:11.513061 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-d9d360fc-a776-4861-8e15-f73f9b9ebb68 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:11.515282 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-d9d360fc-a776-4861-8e15-f73f9b9ebb68 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c" status: 200 len: 1746 microversion: 2.20 time: 0.199332 Aug 24 11:43:11.515948 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 541/1030] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:43:11 2022] GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c => generated 1746 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:43:12.005962 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-dd3432cc-ae0f-43d8-bcab-b89e7c295c78 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:43:12.006709 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-dd3432cc-ae0f-43d8-bcab-b89e7c295c78 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: 4b0af30d-b2e2-466a-bc9b-50ae86e6af28] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:43:12.013727 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-dd3432cc-ae0f-43d8-bcab-b89e7c295c78 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:12.014219 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-dd3432cc-ae0f-43d8-bcab-b89e7c295c78 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:12.014654 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-dd3432cc-ae0f-43d8-bcab-b89e7c295c78 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:12.015352 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-dd3432cc-ae0f-43d8-bcab-b89e7c295c78 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:12.015904 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-dd3432cc-ae0f-43d8-bcab-b89e7c295c78 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:12.016326 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-dd3432cc-ae0f-43d8-bcab-b89e7c295c78 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:12.052701 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-dd3432cc-ae0f-43d8-bcab-b89e7c295c78 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:12.053221 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-dd3432cc-ae0f-43d8-bcab-b89e7c295c78 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:12.053658 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-dd3432cc-ae0f-43d8-bcab-b89e7c295c78 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:12.054109 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.objects.instance [None req-dd3432cc-ae0f-43d8-bcab-b89e7c295c78 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lazy-loading 'fault' on Instance uuid 4b0af30d-b2e2-466a-bc9b-50ae86e6af28 {{(pid=124770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:43:12.105978 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-dd3432cc-ae0f-43d8-bcab-b89e7c295c78 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2715cf2a5129439c83a5347bb963f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4159dc366f41bc9e4057a079f6fb5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:12.122177 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-dd3432cc-ae0f-43d8-bcab-b89e7c295c78 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "GET /compute/v2.1/servers/4b0af30d-b2e2-466a-bc9b-50ae86e6af28" status: 200 len: 1332 microversion: 2.1 time: 0.120207 Aug 24 11:43:12.123111 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 490/1031] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:43:11 2022] GET /compute/v2.1/servers/4b0af30d-b2e2-466a-bc9b-50ae86e6af28 => generated 1332 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:43:12.568511 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-25791e0f-1837-46c0-9a07-718c9d35ad68 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:43:12.569253 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-25791e0f-1837-46c0-9a07-718c9d35ad68 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: bf04b523-cedf-4e68-b77f-f6039d0de59c] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:43:12.576740 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-25791e0f-1837-46c0-9a07-718c9d35ad68 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:12.577252 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-25791e0f-1837-46c0-9a07-718c9d35ad68 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:12.577873 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-25791e0f-1837-46c0-9a07-718c9d35ad68 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:12.578679 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-25791e0f-1837-46c0-9a07-718c9d35ad68 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:12.579240 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-25791e0f-1837-46c0-9a07-718c9d35ad68 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:12.579680 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-25791e0f-1837-46c0-9a07-718c9d35ad68 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:12.733020 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-25791e0f-1837-46c0-9a07-718c9d35ad68 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:12.741931 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-25791e0f-1837-46c0-9a07-718c9d35ad68 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:12.744061 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-25791e0f-1837-46c0-9a07-718c9d35ad68 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:12.745542 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-25791e0f-1837-46c0-9a07-718c9d35ad68 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c" status: 200 len: 1746 microversion: 2.20 time: 0.181747 Aug 24 11:43:12.746177 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 542/1032] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:43:12 2022] GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c => generated 1746 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:43:13.144648 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-e9e913d0-a50c-4d93-bd77-d266bc46d494 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:43:13.145524 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-e9e913d0-a50c-4d93-bd77-d266bc46d494 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: 4b0af30d-b2e2-466a-bc9b-50ae86e6af28] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:43:13.153148 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e9e913d0-a50c-4d93-bd77-d266bc46d494 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:13.153714 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e9e913d0-a50c-4d93-bd77-d266bc46d494 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:13.154272 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e9e913d0-a50c-4d93-bd77-d266bc46d494 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:13.155076 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e9e913d0-a50c-4d93-bd77-d266bc46d494 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:13.155657 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e9e913d0-a50c-4d93-bd77-d266bc46d494 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:13.156170 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e9e913d0-a50c-4d93-bd77-d266bc46d494 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:13.172219 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.wsgi [None req-e9e913d0-a50c-4d93-bd77-d266bc46d494 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] HTTP exception thrown: Instance 4b0af30d-b2e2-466a-bc9b-50ae86e6af28 could not be found. Aug 24 11:43:13.175263 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-e9e913d0-a50c-4d93-bd77-d266bc46d494 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Request method failure captured: Aug 24 11:43:13.175263 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: request: GET /compute/v2.1/servers/4b0af30d-b2e2-466a-bc9b-50ae86e6af28 HTTP/1.1 Aug 24 11:43:13.175263 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Accept: application/json Aug 24 11:43:13.175263 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Accept-Encoding: identity Aug 24 11:43:13.175263 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Connection: close Aug 24 11:43:13.175263 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Content-Length: 0 Aug 24 11:43:13.175263 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Content-Type: application/json Aug 24 11:43:13.175263 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Host: 10.222.0.84 Aug 24 11:43:13.175263 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Openstack-System-Scope: None Aug 24 11:43:13.175263 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: User-Agent: python-urllib3/1.26.11 Aug 24 11:43:13.175263 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Auth-Token: gAAAAABjBgweR4cEvCTKaEtRPVxZbNsTt1me1RX2L8orBaoPmyfbKHmzEiPGrzhUPAZ-dVqobDImAozYNHZy-giT-StyTeTjwVyRR-kCHyxEj3vuiJ5-SAwaDdad7hiiarcqgu_OA8lN_aNGemV1KcSFFCiGn60rq1bxi6ViCi6rFYftaJqzRGY Aug 24 11:43:13.175263 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Domain-Id: None Aug 24 11:43:13.175263 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Domain-Name: None Aug 24 11:43:13.175263 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Identity-Status: Confirmed Aug 24 11:43:13.175263 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Is-Admin-Project: True Aug 24 11:43:13.175263 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Project-Domain-Id: default Aug 24 11:43:13.175263 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Project-Domain-Name: Default Aug 24 11:43:13.175263 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Project-Id: 4a4159dc366f41bc9e4057a079f6fb5a Aug 24 11:43:13.175263 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Project-Name: tempest-AttachVolumeNegativeTest-1758140935 Aug 24 11:43:13.175263 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Role: reader,member Aug 24 11:43:13.175263 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Roles: reader,member Aug 24 11:43:13.177158 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/volume/v3/4a4159dc366f41bc9e4057a079f6fb5a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/volume/v3/4a4159dc366f41bc9e4057a079f6fb5a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/compute/v2/4a4159dc366f41bc9e4057a079f6fb5a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84:8080/v1/AUTH_4a4159dc366f41bc9e4057a079f6fb5a", "adminURL": "http://10.222.0.84:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/placement"}]}] Aug 24 11:43:13.177158 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Tenant: tempest-AttachVolumeNegativeTest-1758140935 Aug 24 11:43:13.177158 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Tenant-Id: 4a4159dc366f41bc9e4057a079f6fb5a Aug 24 11:43:13.177158 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1758140935 Aug 24 11:43:13.177158 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User: tempest-AttachVolumeNegativeTest-1758140935-project Aug 24 11:43:13.177158 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User-Domain-Id: default Aug 24 11:43:13.177158 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User-Domain-Name: Default Aug 24 11:43:13.177158 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User-Id: 2715cf2a5129439c83a5347bb963f1a9 Aug 24 11:43:13.177158 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User-Name: tempest-AttachVolumeNegativeTest-1758140935-project Aug 24 11:43:13.177158 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: method: > Aug 24 11:43:13.177158 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: exception: Instance 4b0af30d-b2e2-466a-bc9b-50ae86e6af28 could not be found. Aug 24 11:43:13.177158 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: action_args: {'id': '4b0af30d-b2e2-466a-bc9b-50ae86e6af28'} Aug 24 11:43:13.178134 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:43:13.178134 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:43:13.178134 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:43:13.178134 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:43:13.178134 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:43:13.178134 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:43:13.178134 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:43:13.178134 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:43:13.178134 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:43:13.178134 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:43:13.178134 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b0af30d-b2e2-466a-bc9b-50ae86e6af28 could not be found. Aug 24 11:43:13.178134 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:43:13.178134 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:43:13.178134 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:43:13.178134 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:43:13.178134 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:43:13.178134 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:43:13.178134 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:43:13.178134 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:43:13.178134 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:43:13.179752 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:43:13.179752 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:43:13.179752 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:43:13.179752 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:43:13.179752 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:43:13.179752 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:43:13.179752 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:43:13.179752 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b0af30d-b2e2-466a-bc9b-50ae86e6af28 could not be found. Aug 24 11:43:13.179752 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:43:13.179752 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:43:13.179752 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:43:13.179752 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:43:13.179752 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:43:13.179752 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:43:13.179752 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:43:13.179752 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:43:13.179752 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b0af30d-b2e2-466a-bc9b-50ae86e6af28 could not be found. Aug 24 11:43:13.179752 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:43:13.181139 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-e9e913d0-a50c-4d93-bd77-d266bc46d494 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Returning 404 to user: Instance 4b0af30d-b2e2-466a-bc9b-50ae86e6af28 could not be found. {{(pid=124770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:43:13.181139 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-e9e913d0-a50c-4d93-bd77-d266bc46d494 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "GET /compute/v2.1/servers/4b0af30d-b2e2-466a-bc9b-50ae86e6af28" status: 404 len: 111 microversion: 2.1 time: 0.037024 Aug 24 11:43:13.183031 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 491/1033] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:43:13 2022] GET /compute/v2.1/servers/4b0af30d-b2e2-466a-bc9b-50ae86e6af28 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:43:13.191683 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-badd3932-fced-4827-9450-ea08f5264c23 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '.version_select at 0x7f0e2a63aaf0>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:43:13.196953 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR oslo.messaging._drivers.impl_rabbit [None req-badd3932-fced-4827-9450-ea08f5264c23 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [cb3d2758-3e3d-4b0d-87db-973c1c16668a] AMQP server on 10.222.0.84:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 11:43:13.770150 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-5a412908-8425-4632-80c4-38fd9cc89a74 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:43:13.770710 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-5a412908-8425-4632-80c4-38fd9cc89a74 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: bf04b523-cedf-4e68-b77f-f6039d0de59c] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:43:13.778523 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5a412908-8425-4632-80c4-38fd9cc89a74 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:13.779190 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5a412908-8425-4632-80c4-38fd9cc89a74 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:13.779509 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5a412908-8425-4632-80c4-38fd9cc89a74 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:13.780220 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5a412908-8425-4632-80c4-38fd9cc89a74 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:13.780684 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5a412908-8425-4632-80c4-38fd9cc89a74 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:13.781136 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5a412908-8425-4632-80c4-38fd9cc89a74 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:13.939146 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-5a412908-8425-4632-80c4-38fd9cc89a74 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:13.949144 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-5a412908-8425-4632-80c4-38fd9cc89a74 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:13.950657 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-5a412908-8425-4632-80c4-38fd9cc89a74 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:13.951882 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-5a412908-8425-4632-80c4-38fd9cc89a74 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c" status: 200 len: 1746 microversion: 2.20 time: 0.185768 Aug 24 11:43:13.952831 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 492/1034] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:43:13 2022] GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c => generated 1746 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 11:43:14.205368 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO oslo.messaging._drivers.impl_rabbit [None req-badd3932-fced-4827-9450-ea08f5264c23 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [cb3d2758-3e3d-4b0d-87db-973c1c16668a] Reconnected to AMQP server on 10.222.0.84:5672 via [amqp] client with port 48972. Aug 24 11:43:14.395176 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-badd3932-fced-4827-9450-ea08f5264c23 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1118927290" status: 202 len: 0 microversion: 2.1 time: 1.210166 Aug 24 11:43:14.395757 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 543/1035] 10.222.0.84 () {58 vars in 1221 bytes} [Wed Aug 24 11:43:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1118927290 => generated 0 bytes in 1212 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:43:14.989733 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-8e6449ed-ced1-489f-a940-69935b03de7f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:43:14.990347 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-8e6449ed-ced1-489f-a940-69935b03de7f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: bf04b523-cedf-4e68-b77f-f6039d0de59c] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:43:14.998495 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8e6449ed-ced1-489f-a940-69935b03de7f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:14.999339 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8e6449ed-ced1-489f-a940-69935b03de7f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:14.999825 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8e6449ed-ced1-489f-a940-69935b03de7f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:15.000540 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8e6449ed-ced1-489f-a940-69935b03de7f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:15.001025 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8e6449ed-ced1-489f-a940-69935b03de7f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:15.001450 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8e6449ed-ced1-489f-a940-69935b03de7f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:15.167399 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-8e6449ed-ced1-489f-a940-69935b03de7f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:15.175664 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-8e6449ed-ced1-489f-a940-69935b03de7f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:15.177179 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-8e6449ed-ced1-489f-a940-69935b03de7f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:15.178403 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-8e6449ed-ced1-489f-a940-69935b03de7f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c" status: 200 len: 1746 microversion: 2.20 time: 0.193254 Aug 24 11:43:15.178950 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 493/1036] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:43:14 2022] GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c => generated 1746 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:43:15.365989 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [req-64d5a047-53a5-4336-8199-e80cea360060 req-b1946949-f109-43f7-adcd-83df8cf2d256 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf04b523-cedf-4e68-b77f-f6039d0de59c", "name": "network-vif-plugged", "status": "completed", "tag": "c30f1b51-2afd-425d-956e-dbabf88edac3"}]} {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:43:15.381566 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [req-64d5a047-53a5-4336-8199-e80cea360060 req-b1946949-f109-43f7-adcd-83df8cf2d256 service nova] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:15.382140 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [req-64d5a047-53a5-4336-8199-e80cea360060 req-b1946949-f109-43f7-adcd-83df8cf2d256 service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:15.382706 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [req-64d5a047-53a5-4336-8199-e80cea360060 req-b1946949-f109-43f7-adcd-83df8cf2d256 service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:15.393821 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.compute.server_external_events [req-64d5a047-53a5-4336-8199-e80cea360060 req-b1946949-f109-43f7-adcd-83df8cf2d256 service nova] Creating event network-vif-plugged:c30f1b51-2afd-425d-956e-dbabf88edac3 for instance bf04b523-cedf-4e68-b77f-f6039d0de59c on hv-cinder-85427 Aug 24 11:43:15.398780 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [req-64d5a047-53a5-4336-8199-e80cea360060 req-b1946949-f109-43f7-adcd-83df8cf2d256 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042073 Aug 24 11:43:15.399395 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 544/1037] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Aug 24 11:43:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:43:15.462558 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-626637c4-074d-4dd8-b045-6de99ab3f825 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Action: 'create', calling method: .version_select at 0x7f0e2a9388b0>, body: {"keypair": {"name": "tempest-keypair-1875491419", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCucqpAn7vkHZQH2uday+1IMm+PQX0+jN31YfvxmXGAcqdFoyL0qzqM9lWhxf2759atzWSRmexSllMhmo9Q33VJ/hFTMUJluP2geO/XDfenfZy0hcZ9Hsro00X6eusoEbw=="}} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:43:15.479225 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.quota [None req-626637c4-074d-4dd8-b045-6de99ab3f825 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Getting quotas for project 4a4159dc366f41bc9e4057a079f6fb5a. Resources: {'key_pairs'} {{(pid=124770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:43:15.483409 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.quota [None req-626637c4-074d-4dd8-b045-6de99ab3f825 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Getting quotas for user 2715cf2a5129439c83a5347bb963f1a9 and project 4a4159dc366f41bc9e4057a079f6fb5a. Resources: {'key_pairs'} {{(pid=124770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:43:15.822555 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-626637c4-074d-4dd8-b045-6de99ab3f825 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.363715 Aug 24 11:43:15.823167 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 494/1038] 10.222.0.84 () {60 vars in 1159 bytes} [Wed Aug 24 11:43:15 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:43:16.204618 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-e2a0fc75-0893-40f2-98f3-f9163e0a96bf tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:43:16.205554 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-e2a0fc75-0893-40f2-98f3-f9163e0a96bf tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: bf04b523-cedf-4e68-b77f-f6039d0de59c] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:43:16.216226 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-e2a0fc75-0893-40f2-98f3-f9163e0a96bf tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:16.216226 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-e2a0fc75-0893-40f2-98f3-f9163e0a96bf tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:16.216226 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-e2a0fc75-0893-40f2-98f3-f9163e0a96bf tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:16.216226 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-e2a0fc75-0893-40f2-98f3-f9163e0a96bf tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:16.216654 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-e2a0fc75-0893-40f2-98f3-f9163e0a96bf tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:16.216765 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-e2a0fc75-0893-40f2-98f3-f9163e0a96bf tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:16.393635 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-e2a0fc75-0893-40f2-98f3-f9163e0a96bf tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:16.404041 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-e2a0fc75-0893-40f2-98f3-f9163e0a96bf tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:16.405572 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-e2a0fc75-0893-40f2-98f3-f9163e0a96bf tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:16.406931 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-e2a0fc75-0893-40f2-98f3-f9163e0a96bf tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c" status: 200 len: 1746 microversion: 2.20 time: 0.207491 Aug 24 11:43:16.407491 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 545/1039] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:43:16 2022] GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c => generated 1746 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 11:43:17.430842 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-8ce93236-e808-4ecc-90ec-03a5b3fb7687 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:43:17.431513 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-8ce93236-e808-4ecc-90ec-03a5b3fb7687 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: bf04b523-cedf-4e68-b77f-f6039d0de59c] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:43:17.438219 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8ce93236-e808-4ecc-90ec-03a5b3fb7687 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:17.438704 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8ce93236-e808-4ecc-90ec-03a5b3fb7687 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:17.439142 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8ce93236-e808-4ecc-90ec-03a5b3fb7687 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:17.439832 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8ce93236-e808-4ecc-90ec-03a5b3fb7687 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:17.440290 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8ce93236-e808-4ecc-90ec-03a5b3fb7687 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:17.440742 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8ce93236-e808-4ecc-90ec-03a5b3fb7687 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:17.586801 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-8ce93236-e808-4ecc-90ec-03a5b3fb7687 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:17.596049 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-8ce93236-e808-4ecc-90ec-03a5b3fb7687 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:17.597572 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-8ce93236-e808-4ecc-90ec-03a5b3fb7687 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:17.598743 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-8ce93236-e808-4ecc-90ec-03a5b3fb7687 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c" status: 200 len: 1746 microversion: 2.20 time: 0.171966 Aug 24 11:43:17.599294 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 495/1040] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:43:17 2022] GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c => generated 1746 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 11:43:18.623346 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-8a1b92c7-bca8-469b-b132-a8813992cd53 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:43:18.624204 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-8a1b92c7-bca8-469b-b132-a8813992cd53 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: bf04b523-cedf-4e68-b77f-f6039d0de59c] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:43:18.631088 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-8a1b92c7-bca8-469b-b132-a8813992cd53 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:18.631570 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-8a1b92c7-bca8-469b-b132-a8813992cd53 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:18.632006 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-8a1b92c7-bca8-469b-b132-a8813992cd53 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:18.632711 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-8a1b92c7-bca8-469b-b132-a8813992cd53 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:18.633187 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-8a1b92c7-bca8-469b-b132-a8813992cd53 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:18.633606 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-8a1b92c7-bca8-469b-b132-a8813992cd53 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:18.864381 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-8a1b92c7-bca8-469b-b132-a8813992cd53 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:18.874050 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-8a1b92c7-bca8-469b-b132-a8813992cd53 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:18.875576 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-8a1b92c7-bca8-469b-b132-a8813992cd53 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:18.877325 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-8a1b92c7-bca8-469b-b132-a8813992cd53 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c" status: 200 len: 1746 microversion: 2.20 time: 0.257890 Aug 24 11:43:18.877674 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 546/1041] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:43:18 2022] GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c => generated 1746 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:43:19.203071 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-e5d505b3-0a12-41e8-a237-9e2206ffeccd tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-218634587", "imageRef": "028cad80-8f50-4139-b345-dfdca694dc6b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1a520e2a-cec7-4c07-8304-e0a7f6eeb34e"}], "security_groups": [{"name": "tempest-securitygroup--558427976"}], "key_name": "tempest-keypair-1875491419", "user_data": "}} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:43:19.318862 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.network.neutron [None req-e5d505b3-0a12-41e8-a237-9e2206ffeccd tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] validate_networks() for [('1a520e2a-cec7-4c07-8304-e0a7f6eeb34e', None, None, None, None, None)] {{(pid=124770) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 11:43:19.799465 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.virt.hardware [None req-e5d505b3-0a12-41e8-a237-9e2206ffeccd tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Flavor limits 0:0:0 {{(pid=124770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 11:43:19.799972 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.virt.hardware [None req-e5d505b3-0a12-41e8-a237-9e2206ffeccd tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Image limits 0:0:0 {{(pid=124770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 11:43:19.800476 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.virt.hardware [None req-e5d505b3-0a12-41e8-a237-9e2206ffeccd tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Flavor pref 0:0:0 {{(pid=124770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 11:43:19.800907 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.virt.hardware [None req-e5d505b3-0a12-41e8-a237-9e2206ffeccd tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Image pref 0:0:0 {{(pid=124770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 11:43:19.804770 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.virt.hardware [None req-e5d505b3-0a12-41e8-a237-9e2206ffeccd tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 11:43:19.811646 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e5d505b3-0a12-41e8-a237-9e2206ffeccd tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:19.812277 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e5d505b3-0a12-41e8-a237-9e2206ffeccd tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:19.812785 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e5d505b3-0a12-41e8-a237-9e2206ffeccd tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:19.813544 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e5d505b3-0a12-41e8-a237-9e2206ffeccd tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:19.814085 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e5d505b3-0a12-41e8-a237-9e2206ffeccd tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:19.816809 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e5d505b3-0a12-41e8-a237-9e2206ffeccd tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:19.833418 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.quota [None req-e5d505b3-0a12-41e8-a237-9e2206ffeccd tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Getting quotas for project 4a4159dc366f41bc9e4057a079f6fb5a. Resources: {'ram', 'cores', 'instances'} {{(pid=124770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:43:19.838845 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.quota [None req-e5d505b3-0a12-41e8-a237-9e2206ffeccd tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Getting quotas for user 2715cf2a5129439c83a5347bb963f1a9 and project 4a4159dc366f41bc9e4057a079f6fb5a. Resources: {'ram', 'cores', 'instances'} {{(pid=124770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:43:19.853018 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-e5d505b3-0a12-41e8-a237-9e2206ffeccd tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Going to run 1 instances... {{(pid=124770) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 11:43:19.856342 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-e5d505b3-0a12-41e8-a237-9e2206ffeccd tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: b86b3db2-2f76-464d-b087-39deddd5a48e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='028cad80-8f50-4139-b345-dfdca694dc6b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124770) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 11:43:19.901694 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-c734b216-ef42-43cc-9f42-5637df12575f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:43:19.902299 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-c734b216-ef42-43cc-9f42-5637df12575f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: bf04b523-cedf-4e68-b77f-f6039d0de59c] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:43:19.910070 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-c734b216-ef42-43cc-9f42-5637df12575f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:19.910613 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-c734b216-ef42-43cc-9f42-5637df12575f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:19.911052 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-c734b216-ef42-43cc-9f42-5637df12575f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:19.911741 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-c734b216-ef42-43cc-9f42-5637df12575f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:19.912194 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-c734b216-ef42-43cc-9f42-5637df12575f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:19.912899 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-c734b216-ef42-43cc-9f42-5637df12575f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:20.062072 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-c734b216-ef42-43cc-9f42-5637df12575f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:20.065057 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-e5d505b3-0a12-41e8-a237-9e2206ffeccd tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.866063 Aug 24 11:43:20.065900 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 496/1042] 10.222.0.84 () {60 vars in 1147 bytes} [Wed Aug 24 11:43:19 2022] POST /compute/v2.1/servers => generated 401 bytes in 868 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 11:43:20.076728 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-ce8199b0-e4c4-4181-9513-2db38c698d27 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:43:20.077571 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-ce8199b0-e4c4-4181-9513-2db38c698d27 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: b86b3db2-2f76-464d-b087-39deddd5a48e] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:43:20.096541 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-c734b216-ef42-43cc-9f42-5637df12575f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:20.100953 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-c734b216-ef42-43cc-9f42-5637df12575f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:20.102189 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-c734b216-ef42-43cc-9f42-5637df12575f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c" status: 200 len: 1741 microversion: 2.20 time: 0.206187 Aug 24 11:43:20.102749 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 547/1043] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:43:19 2022] GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c => generated 1741 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 11:43:20.144820 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-ce8199b0-e4c4-4181-9513-2db38c698d27 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2715cf2a5129439c83a5347bb963f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4159dc366f41bc9e4057a079f6fb5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:20.153482 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-ce8199b0-e4c4-4181-9513-2db38c698d27 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "GET /compute/v2.1/servers/b86b3db2-2f76-464d-b087-39deddd5a48e" status: 200 len: 1241 microversion: 2.1 time: 0.080656 Aug 24 11:43:20.154423 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 497/1044] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:43:20 2022] GET /compute/v2.1/servers/b86b3db2-2f76-464d-b087-39deddd5a48e => generated 1241 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:43:21.127606 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-a926a4cc-1e59-44df-8a2d-a3f5fe79fe3e tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:43:21.128199 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-a926a4cc-1e59-44df-8a2d-a3f5fe79fe3e tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: bf04b523-cedf-4e68-b77f-f6039d0de59c] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:43:21.135390 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-a926a4cc-1e59-44df-8a2d-a3f5fe79fe3e tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:21.136052 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-a926a4cc-1e59-44df-8a2d-a3f5fe79fe3e tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:21.136523 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-a926a4cc-1e59-44df-8a2d-a3f5fe79fe3e tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:21.137334 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-a926a4cc-1e59-44df-8a2d-a3f5fe79fe3e tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:21.137704 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-a926a4cc-1e59-44df-8a2d-a3f5fe79fe3e tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:21.138367 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-a926a4cc-1e59-44df-8a2d-a3f5fe79fe3e tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:21.161086 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG dbcounter [-] [124769] Writing DB stats nova_cell1:SELECT=100 {{(pid=124769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:43:21.180688 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-5ee617be-530e-4e3a-a57a-b351e91a0001 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:43:21.181913 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-5ee617be-530e-4e3a-a57a-b351e91a0001 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: b86b3db2-2f76-464d-b087-39deddd5a48e] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:43:21.249491 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-5ee617be-530e-4e3a-a57a-b351e91a0001 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2715cf2a5129439c83a5347bb963f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4159dc366f41bc9e4057a079f6fb5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:21.273393 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-5ee617be-530e-4e3a-a57a-b351e91a0001 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "GET /compute/v2.1/servers/b86b3db2-2f76-464d-b087-39deddd5a48e" status: 200 len: 1241 microversion: 2.1 time: 0.086074 Aug 24 11:43:21.273393 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 498/1045] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:43:21 2022] GET /compute/v2.1/servers/b86b3db2-2f76-464d-b087-39deddd5a48e => generated 1241 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:43:21.372341 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-a926a4cc-1e59-44df-8a2d-a3f5fe79fe3e tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:21.383451 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-a926a4cc-1e59-44df-8a2d-a3f5fe79fe3e tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:21.385721 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-a926a4cc-1e59-44df-8a2d-a3f5fe79fe3e tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:21.388063 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-a926a4cc-1e59-44df-8a2d-a3f5fe79fe3e tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c" status: 200 len: 1741 microversion: 2.20 time: 0.264664 Aug 24 11:43:21.389179 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 548/1046] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:43:21 2022] GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c => generated 1741 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:43:22.299674 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-ce7bb906-e95b-4a94-9ab6-b3e62fe855ed tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:43:22.300242 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-ce7bb906-e95b-4a94-9ab6-b3e62fe855ed tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: b86b3db2-2f76-464d-b087-39deddd5a48e] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:43:22.309480 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ce7bb906-e95b-4a94-9ab6-b3e62fe855ed tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:22.310391 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ce7bb906-e95b-4a94-9ab6-b3e62fe855ed tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:22.311059 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ce7bb906-e95b-4a94-9ab6-b3e62fe855ed tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:22.312117 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ce7bb906-e95b-4a94-9ab6-b3e62fe855ed tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:22.313152 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ce7bb906-e95b-4a94-9ab6-b3e62fe855ed tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:22.314009 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ce7bb906-e95b-4a94-9ab6-b3e62fe855ed tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:22.390562 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-ce7bb906-e95b-4a94-9ab6-b3e62fe855ed tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2715cf2a5129439c83a5347bb963f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4159dc366f41bc9e4057a079f6fb5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:22.399578 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-ce7bb906-e95b-4a94-9ab6-b3e62fe855ed tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "GET /compute/v2.1/servers/b86b3db2-2f76-464d-b087-39deddd5a48e" status: 200 len: 1293 microversion: 2.1 time: 0.103979 Aug 24 11:43:22.400583 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 499/1047] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:43:22 2022] GET /compute/v2.1/servers/b86b3db2-2f76-464d-b087-39deddd5a48e => generated 1293 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:43:22.416206 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-0cbd2d6a-16d6-41cf-be3d-bf06b27c7788 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:43:22.418154 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-0cbd2d6a-16d6-41cf-be3d-bf06b27c7788 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: bf04b523-cedf-4e68-b77f-f6039d0de59c] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:43:22.428533 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-0cbd2d6a-16d6-41cf-be3d-bf06b27c7788 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:22.429668 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-0cbd2d6a-16d6-41cf-be3d-bf06b27c7788 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:22.432058 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-0cbd2d6a-16d6-41cf-be3d-bf06b27c7788 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:22.432058 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-0cbd2d6a-16d6-41cf-be3d-bf06b27c7788 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:22.432326 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-0cbd2d6a-16d6-41cf-be3d-bf06b27c7788 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:22.432699 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-0cbd2d6a-16d6-41cf-be3d-bf06b27c7788 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:22.616023 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-0cbd2d6a-16d6-41cf-be3d-bf06b27c7788 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:22.626437 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-0cbd2d6a-16d6-41cf-be3d-bf06b27c7788 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:22.628179 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-0cbd2d6a-16d6-41cf-be3d-bf06b27c7788 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:22.629540 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-0cbd2d6a-16d6-41cf-be3d-bf06b27c7788 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c" status: 200 len: 1741 microversion: 2.20 time: 0.219262 Aug 24 11:43:22.630712 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 549/1048] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:43:22 2022] GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c => generated 1741 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:43:23.438568 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-beeaa55a-5620-41e7-b401-770e080a1c01 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:43:23.439994 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-beeaa55a-5620-41e7-b401-770e080a1c01 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: b86b3db2-2f76-464d-b087-39deddd5a48e] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:43:23.450466 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-beeaa55a-5620-41e7-b401-770e080a1c01 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:23.452480 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-beeaa55a-5620-41e7-b401-770e080a1c01 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:23.454647 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-beeaa55a-5620-41e7-b401-770e080a1c01 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:23.455854 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-beeaa55a-5620-41e7-b401-770e080a1c01 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:23.457562 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-beeaa55a-5620-41e7-b401-770e080a1c01 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:23.460239 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-beeaa55a-5620-41e7-b401-770e080a1c01 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:23.567706 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-beeaa55a-5620-41e7-b401-770e080a1c01 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2715cf2a5129439c83a5347bb963f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4159dc366f41bc9e4057a079f6fb5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:23.577262 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-beeaa55a-5620-41e7-b401-770e080a1c01 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "GET /compute/v2.1/servers/b86b3db2-2f76-464d-b087-39deddd5a48e" status: 200 len: 1311 microversion: 2.1 time: 0.142926 Aug 24 11:43:23.578078 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 500/1049] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:43:23 2022] GET /compute/v2.1/servers/b86b3db2-2f76-464d-b087-39deddd5a48e => generated 1311 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:43:23.676147 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-bef1578c-6256-462d-a464-41cef8b95a03 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:43:23.677186 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-bef1578c-6256-462d-a464-41cef8b95a03 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: bf04b523-cedf-4e68-b77f-f6039d0de59c] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:43:23.690240 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-bef1578c-6256-462d-a464-41cef8b95a03 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:23.691026 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-bef1578c-6256-462d-a464-41cef8b95a03 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:23.691822 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-bef1578c-6256-462d-a464-41cef8b95a03 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:23.693169 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-bef1578c-6256-462d-a464-41cef8b95a03 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:23.693940 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-bef1578c-6256-462d-a464-41cef8b95a03 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:23.694651 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-bef1578c-6256-462d-a464-41cef8b95a03 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:23.933336 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-bef1578c-6256-462d-a464-41cef8b95a03 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:23.947481 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-bef1578c-6256-462d-a464-41cef8b95a03 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:23.950076 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-bef1578c-6256-462d-a464-41cef8b95a03 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:23.951644 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-bef1578c-6256-462d-a464-41cef8b95a03 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c" status: 200 len: 1741 microversion: 2.20 time: 0.291719 Aug 24 11:43:23.952546 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 550/1050] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:43:23 2022] GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c => generated 1741 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:43:24.603808 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-fc13efe5-e5a0-4244-8d5f-413aab189eca tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:43:24.604455 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-fc13efe5-e5a0-4244-8d5f-413aab189eca tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: b86b3db2-2f76-464d-b087-39deddd5a48e] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:43:24.611193 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-fc13efe5-e5a0-4244-8d5f-413aab189eca tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:24.611948 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-fc13efe5-e5a0-4244-8d5f-413aab189eca tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:24.612993 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-fc13efe5-e5a0-4244-8d5f-413aab189eca tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:24.614341 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-fc13efe5-e5a0-4244-8d5f-413aab189eca tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:24.614341 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-fc13efe5-e5a0-4244-8d5f-413aab189eca tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:24.614341 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-fc13efe5-e5a0-4244-8d5f-413aab189eca tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:24.866095 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-fc13efe5-e5a0-4244-8d5f-413aab189eca tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2715cf2a5129439c83a5347bb963f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4159dc366f41bc9e4057a079f6fb5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:24.880588 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-fc13efe5-e5a0-4244-8d5f-413aab189eca tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "GET /compute/v2.1/servers/b86b3db2-2f76-464d-b087-39deddd5a48e" status: 200 len: 1366 microversion: 2.1 time: 0.281039 Aug 24 11:43:24.882235 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 501/1051] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:43:24 2022] GET /compute/v2.1/servers/b86b3db2-2f76-464d-b087-39deddd5a48e => generated 1366 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:43:24.980570 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-ac31d50b-6f4c-4fbb-a645-9042d7099fc2 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:43:24.982659 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-ac31d50b-6f4c-4fbb-a645-9042d7099fc2 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: bf04b523-cedf-4e68-b77f-f6039d0de59c] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:43:25.000754 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-ac31d50b-6f4c-4fbb-a645-9042d7099fc2 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:25.001489 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-ac31d50b-6f4c-4fbb-a645-9042d7099fc2 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:25.002142 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-ac31d50b-6f4c-4fbb-a645-9042d7099fc2 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:25.003292 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-ac31d50b-6f4c-4fbb-a645-9042d7099fc2 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:25.003915 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-ac31d50b-6f4c-4fbb-a645-9042d7099fc2 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:25.004537 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-ac31d50b-6f4c-4fbb-a645-9042d7099fc2 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:25.214329 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-ac31d50b-6f4c-4fbb-a645-9042d7099fc2 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:25.226622 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-ac31d50b-6f4c-4fbb-a645-9042d7099fc2 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:25.228713 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-ac31d50b-6f4c-4fbb-a645-9042d7099fc2 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:25.230083 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-ac31d50b-6f4c-4fbb-a645-9042d7099fc2 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c" status: 200 len: 1741 microversion: 2.20 time: 0.257239 Aug 24 11:43:25.230874 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 551/1052] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:43:24 2022] GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c => generated 1741 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:43:25.898317 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [req-ed74aa2d-5445-4f73-8b7c-1e6732088607 req-2102c519-756f-445a-aad1-65e443d82443 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b86b3db2-2f76-464d-b087-39deddd5a48e", "tag": "73a82f8e-4955-4b47-9cb6-a410213182dc"}]} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:43:25.920370 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-329dbf25-c55f-4855-9ad5-70a7f77a3b19 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:43:25.920664 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-ed74aa2d-5445-4f73-8b7c-1e6732088607 req-2102c519-756f-445a-aad1-65e443d82443 service nova] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:25.921216 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-ed74aa2d-5445-4f73-8b7c-1e6732088607 req-2102c519-756f-445a-aad1-65e443d82443 service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:25.921408 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-329dbf25-c55f-4855-9ad5-70a7f77a3b19 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: b86b3db2-2f76-464d-b087-39deddd5a48e] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:43:25.922214 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-ed74aa2d-5445-4f73-8b7c-1e6732088607 req-2102c519-756f-445a-aad1-65e443d82443 service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:25.935664 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-329dbf25-c55f-4855-9ad5-70a7f77a3b19 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:25.936327 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-329dbf25-c55f-4855-9ad5-70a7f77a3b19 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:25.937406 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-329dbf25-c55f-4855-9ad5-70a7f77a3b19 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:25.938174 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-329dbf25-c55f-4855-9ad5-70a7f77a3b19 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:25.938640 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-329dbf25-c55f-4855-9ad5-70a7f77a3b19 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:25.939102 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-329dbf25-c55f-4855-9ad5-70a7f77a3b19 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:25.945103 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.compute.server_external_events [req-ed74aa2d-5445-4f73-8b7c-1e6732088607 req-2102c519-756f-445a-aad1-65e443d82443 service nova] Creating event network-changed:73a82f8e-4955-4b47-9cb6-a410213182dc for instance b86b3db2-2f76-464d-b087-39deddd5a48e on hv-cinder-85427 Aug 24 11:43:25.956078 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [req-ed74aa2d-5445-4f73-8b7c-1e6732088607 req-2102c519-756f-445a-aad1-65e443d82443 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065589 Aug 24 11:43:25.958031 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 502/1053] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Aug 24 11:43:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:43:26.197619 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-329dbf25-c55f-4855-9ad5-70a7f77a3b19 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2715cf2a5129439c83a5347bb963f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4159dc366f41bc9e4057a079f6fb5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:26.209439 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-329dbf25-c55f-4855-9ad5-70a7f77a3b19 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "GET /compute/v2.1/servers/b86b3db2-2f76-464d-b087-39deddd5a48e" status: 200 len: 1366 microversion: 2.1 time: 0.296866 Aug 24 11:43:26.224837 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 552/1054] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:43:25 2022] GET /compute/v2.1/servers/b86b3db2-2f76-464d-b087-39deddd5a48e => generated 1366 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:43:26.257264 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-5e9f3f70-d916-4cea-9811-013ea2524c9a tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:43:26.257264 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-5e9f3f70-d916-4cea-9811-013ea2524c9a tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: bf04b523-cedf-4e68-b77f-f6039d0de59c] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:43:26.268425 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5e9f3f70-d916-4cea-9811-013ea2524c9a tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:26.274111 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5e9f3f70-d916-4cea-9811-013ea2524c9a tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:26.275995 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5e9f3f70-d916-4cea-9811-013ea2524c9a tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:26.276292 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5e9f3f70-d916-4cea-9811-013ea2524c9a tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:26.276907 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5e9f3f70-d916-4cea-9811-013ea2524c9a tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:26.277442 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5e9f3f70-d916-4cea-9811-013ea2524c9a tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:26.522620 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-5e9f3f70-d916-4cea-9811-013ea2524c9a tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:26.536445 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-5e9f3f70-d916-4cea-9811-013ea2524c9a tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:26.538312 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-5e9f3f70-d916-4cea-9811-013ea2524c9a tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:26.539698 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-5e9f3f70-d916-4cea-9811-013ea2524c9a tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c" status: 200 len: 1741 microversion: 2.20 time: 0.288389 Aug 24 11:43:26.551760 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 503/1055] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:43:26 2022] GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c => generated 1741 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 11:43:27.240575 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-b19398dd-dc67-4e70-916c-591e1699b9e0 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:43:27.241501 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-b19398dd-dc67-4e70-916c-591e1699b9e0 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: b86b3db2-2f76-464d-b087-39deddd5a48e] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:43:27.251209 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-b19398dd-dc67-4e70-916c-591e1699b9e0 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:27.251716 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-b19398dd-dc67-4e70-916c-591e1699b9e0 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:27.252190 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-b19398dd-dc67-4e70-916c-591e1699b9e0 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:27.252929 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-b19398dd-dc67-4e70-916c-591e1699b9e0 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:27.253389 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-b19398dd-dc67-4e70-916c-591e1699b9e0 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:27.253852 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-b19398dd-dc67-4e70-916c-591e1699b9e0 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:27.413568 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-b19398dd-dc67-4e70-916c-591e1699b9e0 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2715cf2a5129439c83a5347bb963f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4159dc366f41bc9e4057a079f6fb5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:27.423160 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-b19398dd-dc67-4e70-916c-591e1699b9e0 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "GET /compute/v2.1/servers/b86b3db2-2f76-464d-b087-39deddd5a48e" status: 200 len: 1366 microversion: 2.1 time: 0.189818 Aug 24 11:43:27.423922 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 553/1056] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:43:27 2022] GET /compute/v2.1/servers/b86b3db2-2f76-464d-b087-39deddd5a48e => generated 1366 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:43:27.563686 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-00f17d30-87ed-4dce-927d-de730de1425f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:43:27.564517 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-00f17d30-87ed-4dce-927d-de730de1425f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: bf04b523-cedf-4e68-b77f-f6039d0de59c] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:43:27.571021 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-00f17d30-87ed-4dce-927d-de730de1425f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:27.571681 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-00f17d30-87ed-4dce-927d-de730de1425f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:27.572423 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-00f17d30-87ed-4dce-927d-de730de1425f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:27.573492 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-00f17d30-87ed-4dce-927d-de730de1425f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:27.574127 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-00f17d30-87ed-4dce-927d-de730de1425f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:27.574717 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-00f17d30-87ed-4dce-927d-de730de1425f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:27.754315 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-00f17d30-87ed-4dce-927d-de730de1425f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:27.767380 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-00f17d30-87ed-4dce-927d-de730de1425f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:27.770146 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-00f17d30-87ed-4dce-927d-de730de1425f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:27.771895 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-00f17d30-87ed-4dce-927d-de730de1425f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c" status: 200 len: 1741 microversion: 2.20 time: 0.212105 Aug 24 11:43:27.772898 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 504/1057] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:43:27 2022] GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c => generated 1741 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:43:28.448494 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-fc41cffd-4398-47e4-82c9-ad7fd6333e63 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:43:28.448494 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-fc41cffd-4398-47e4-82c9-ad7fd6333e63 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: b86b3db2-2f76-464d-b087-39deddd5a48e] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:43:28.454034 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG dbcounter [-] [124769] Writing DB stats nova_api:SELECT=49,nova_api:DELETE=1 {{(pid=124769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:43:28.460070 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-fc41cffd-4398-47e4-82c9-ad7fd6333e63 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:28.461503 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-fc41cffd-4398-47e4-82c9-ad7fd6333e63 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:28.462548 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-fc41cffd-4398-47e4-82c9-ad7fd6333e63 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:28.463750 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-fc41cffd-4398-47e4-82c9-ad7fd6333e63 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:28.464542 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-fc41cffd-4398-47e4-82c9-ad7fd6333e63 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:28.465518 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-fc41cffd-4398-47e4-82c9-ad7fd6333e63 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:28.640543 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-fc41cffd-4398-47e4-82c9-ad7fd6333e63 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2715cf2a5129439c83a5347bb963f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4159dc366f41bc9e4057a079f6fb5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:28.663289 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-fc41cffd-4398-47e4-82c9-ad7fd6333e63 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "GET /compute/v2.1/servers/b86b3db2-2f76-464d-b087-39deddd5a48e" status: 200 len: 1366 microversion: 2.1 time: 0.222593 Aug 24 11:43:28.671247 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 554/1058] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:43:28 2022] GET /compute/v2.1/servers/b86b3db2-2f76-464d-b087-39deddd5a48e => generated 1366 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:43:28.800876 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-42f3efe6-988b-4307-a35f-f121402fb5d5 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:43:28.801868 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-42f3efe6-988b-4307-a35f-f121402fb5d5 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: bf04b523-cedf-4e68-b77f-f6039d0de59c] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:43:28.809849 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-42f3efe6-988b-4307-a35f-f121402fb5d5 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:28.810448 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-42f3efe6-988b-4307-a35f-f121402fb5d5 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:28.810983 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-42f3efe6-988b-4307-a35f-f121402fb5d5 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:28.812093 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-42f3efe6-988b-4307-a35f-f121402fb5d5 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:28.812554 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-42f3efe6-988b-4307-a35f-f121402fb5d5 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:28.813081 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-42f3efe6-988b-4307-a35f-f121402fb5d5 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:28.818178 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:43:28.992905 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-42f3efe6-988b-4307-a35f-f121402fb5d5 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:29.007334 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-42f3efe6-988b-4307-a35f-f121402fb5d5 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:29.011357 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-42f3efe6-988b-4307-a35f-f121402fb5d5 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:29.012342 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-42f3efe6-988b-4307-a35f-f121402fb5d5 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c" status: 200 len: 1741 microversion: 2.20 time: 0.217173 Aug 24 11:43:29.029212 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 505/1059] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:43:28 2022] GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c => generated 1741 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:43:29.692178 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-c9fc7490-470e-4a1b-93ff-d0f5a056daca tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:43:29.692787 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-c9fc7490-470e-4a1b-93ff-d0f5a056daca tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: b86b3db2-2f76-464d-b087-39deddd5a48e] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:43:29.700407 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-c9fc7490-470e-4a1b-93ff-d0f5a056daca tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:29.701408 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-c9fc7490-470e-4a1b-93ff-d0f5a056daca tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:29.701858 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-c9fc7490-470e-4a1b-93ff-d0f5a056daca tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:29.702847 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-c9fc7490-470e-4a1b-93ff-d0f5a056daca tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:29.703323 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-c9fc7490-470e-4a1b-93ff-d0f5a056daca tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:29.704015 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-c9fc7490-470e-4a1b-93ff-d0f5a056daca tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:29.868177 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-c9fc7490-470e-4a1b-93ff-d0f5a056daca tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2715cf2a5129439c83a5347bb963f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4159dc366f41bc9e4057a079f6fb5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:29.877076 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-c9fc7490-470e-4a1b-93ff-d0f5a056daca tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "GET /compute/v2.1/servers/b86b3db2-2f76-464d-b087-39deddd5a48e" status: 200 len: 1366 microversion: 2.1 time: 0.189358 Aug 24 11:43:29.877660 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 555/1060] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:43:29 2022] GET /compute/v2.1/servers/b86b3db2-2f76-464d-b087-39deddd5a48e => generated 1366 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:43:30.050175 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-5458398f-816c-47cb-ad23-1b3cbc9379e1 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:43:30.050733 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-5458398f-816c-47cb-ad23-1b3cbc9379e1 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: bf04b523-cedf-4e68-b77f-f6039d0de59c] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:43:30.053024 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_cell0:SELECT=2 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:43:30.053723 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:43:30.058802 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5458398f-816c-47cb-ad23-1b3cbc9379e1 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:30.059284 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5458398f-816c-47cb-ad23-1b3cbc9379e1 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:30.059718 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5458398f-816c-47cb-ad23-1b3cbc9379e1 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:30.060441 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5458398f-816c-47cb-ad23-1b3cbc9379e1 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:30.060922 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5458398f-816c-47cb-ad23-1b3cbc9379e1 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:30.061344 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5458398f-816c-47cb-ad23-1b3cbc9379e1 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:30.215181 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-5458398f-816c-47cb-ad23-1b3cbc9379e1 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:30.223464 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-5458398f-816c-47cb-ad23-1b3cbc9379e1 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:30.225056 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-5458398f-816c-47cb-ad23-1b3cbc9379e1 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:30.270497 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-5458398f-816c-47cb-ad23-1b3cbc9379e1 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c" status: 200 len: 1741 microversion: 2.20 time: 0.180780 Aug 24 11:43:30.270497 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 506/1061] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:43:30 2022] GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c => generated 1741 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:43:30.900978 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-dbfe965a-dc54-4371-9f3b-9e956f8e3a6d tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:43:30.901599 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-dbfe965a-dc54-4371-9f3b-9e956f8e3a6d tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: b86b3db2-2f76-464d-b087-39deddd5a48e] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:43:30.910848 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-dbfe965a-dc54-4371-9f3b-9e956f8e3a6d tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:30.911451 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-dbfe965a-dc54-4371-9f3b-9e956f8e3a6d tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:30.911750 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-dbfe965a-dc54-4371-9f3b-9e956f8e3a6d tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:30.912467 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-dbfe965a-dc54-4371-9f3b-9e956f8e3a6d tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:30.912978 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-dbfe965a-dc54-4371-9f3b-9e956f8e3a6d tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:30.913402 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-dbfe965a-dc54-4371-9f3b-9e956f8e3a6d tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:31.084890 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-dbfe965a-dc54-4371-9f3b-9e956f8e3a6d tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2715cf2a5129439c83a5347bb963f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4159dc366f41bc9e4057a079f6fb5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:31.096698 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-dbfe965a-dc54-4371-9f3b-9e956f8e3a6d tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "GET /compute/v2.1/servers/b86b3db2-2f76-464d-b087-39deddd5a48e" status: 200 len: 1366 microversion: 2.1 time: 0.200657 Aug 24 11:43:31.097580 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 556/1062] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:43:30 2022] GET /compute/v2.1/servers/b86b3db2-2f76-464d-b087-39deddd5a48e => generated 1366 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:43:31.252151 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-caf7a3fe-6fcf-4048-b2a1-4941765809e3 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:43:31.252786 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-caf7a3fe-6fcf-4048-b2a1-4941765809e3 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: bf04b523-cedf-4e68-b77f-f6039d0de59c] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:43:31.256898 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_cell0:SELECT=14 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:43:31.261116 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-caf7a3fe-6fcf-4048-b2a1-4941765809e3 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:31.261611 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-caf7a3fe-6fcf-4048-b2a1-4941765809e3 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:31.262062 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-caf7a3fe-6fcf-4048-b2a1-4941765809e3 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:31.262780 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-caf7a3fe-6fcf-4048-b2a1-4941765809e3 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:31.263337 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-caf7a3fe-6fcf-4048-b2a1-4941765809e3 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:31.263943 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-caf7a3fe-6fcf-4048-b2a1-4941765809e3 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:31.460720 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-caf7a3fe-6fcf-4048-b2a1-4941765809e3 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:31.470794 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-caf7a3fe-6fcf-4048-b2a1-4941765809e3 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:31.478110 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-caf7a3fe-6fcf-4048-b2a1-4941765809e3 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:31.478110 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-caf7a3fe-6fcf-4048-b2a1-4941765809e3 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c" status: 200 len: 1741 microversion: 2.20 time: 0.226296 Aug 24 11:43:31.478110 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 507/1063] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:43:31 2022] GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c => generated 1741 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:43:32.131481 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-0605c210-dcf3-4d2e-82c2-4ab5c058b3c2 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:43:32.134973 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-0605c210-dcf3-4d2e-82c2-4ab5c058b3c2 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: b86b3db2-2f76-464d-b087-39deddd5a48e] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:43:32.154162 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-0605c210-dcf3-4d2e-82c2-4ab5c058b3c2 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:32.155013 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-0605c210-dcf3-4d2e-82c2-4ab5c058b3c2 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:32.155493 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-0605c210-dcf3-4d2e-82c2-4ab5c058b3c2 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:32.157875 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-0605c210-dcf3-4d2e-82c2-4ab5c058b3c2 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:32.158576 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-0605c210-dcf3-4d2e-82c2-4ab5c058b3c2 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:32.159052 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-0605c210-dcf3-4d2e-82c2-4ab5c058b3c2 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:32.338887 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-0605c210-dcf3-4d2e-82c2-4ab5c058b3c2 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2715cf2a5129439c83a5347bb963f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4159dc366f41bc9e4057a079f6fb5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:32.348026 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-0605c210-dcf3-4d2e-82c2-4ab5c058b3c2 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "GET /compute/v2.1/servers/b86b3db2-2f76-464d-b087-39deddd5a48e" status: 200 len: 1366 microversion: 2.1 time: 0.229643 Aug 24 11:43:32.348880 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 557/1064] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:43:32 2022] GET /compute/v2.1/servers/b86b3db2-2f76-464d-b087-39deddd5a48e => generated 1366 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:43:32.500146 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-62f6b830-5fe5-4e64-922b-ab84d4d3a1f7 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:43:32.500762 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-62f6b830-5fe5-4e64-922b-ab84d4d3a1f7 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: bf04b523-cedf-4e68-b77f-f6039d0de59c] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:43:32.507927 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-62f6b830-5fe5-4e64-922b-ab84d4d3a1f7 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:32.509325 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-62f6b830-5fe5-4e64-922b-ab84d4d3a1f7 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:32.509956 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-62f6b830-5fe5-4e64-922b-ab84d4d3a1f7 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:32.510957 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-62f6b830-5fe5-4e64-922b-ab84d4d3a1f7 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:32.511604 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-62f6b830-5fe5-4e64-922b-ab84d4d3a1f7 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:32.512197 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-62f6b830-5fe5-4e64-922b-ab84d4d3a1f7 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:32.719848 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-62f6b830-5fe5-4e64-922b-ab84d4d3a1f7 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:32.737963 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-62f6b830-5fe5-4e64-922b-ab84d4d3a1f7 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:32.739958 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-62f6b830-5fe5-4e64-922b-ab84d4d3a1f7 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:32.741356 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-62f6b830-5fe5-4e64-922b-ab84d4d3a1f7 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c" status: 200 len: 1741 microversion: 2.20 time: 0.247143 Aug 24 11:43:32.757384 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 508/1065] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:43:32 2022] GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c => generated 1741 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:43:33.390251 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-b95ff812-8db5-4ffc-92bb-c8c272bb77f5 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:43:33.390878 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-b95ff812-8db5-4ffc-92bb-c8c272bb77f5 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: b86b3db2-2f76-464d-b087-39deddd5a48e] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:43:33.400543 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-b95ff812-8db5-4ffc-92bb-c8c272bb77f5 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:33.401192 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-b95ff812-8db5-4ffc-92bb-c8c272bb77f5 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:33.401860 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-b95ff812-8db5-4ffc-92bb-c8c272bb77f5 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:33.402949 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-b95ff812-8db5-4ffc-92bb-c8c272bb77f5 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:33.403201 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-b95ff812-8db5-4ffc-92bb-c8c272bb77f5 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:33.403855 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-b95ff812-8db5-4ffc-92bb-c8c272bb77f5 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:33.611533 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-b95ff812-8db5-4ffc-92bb-c8c272bb77f5 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2715cf2a5129439c83a5347bb963f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4159dc366f41bc9e4057a079f6fb5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:33.620617 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-b95ff812-8db5-4ffc-92bb-c8c272bb77f5 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "GET /compute/v2.1/servers/b86b3db2-2f76-464d-b087-39deddd5a48e" status: 200 len: 1366 microversion: 2.1 time: 0.234798 Aug 24 11:43:33.627264 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 558/1066] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:43:33 2022] GET /compute/v2.1/servers/b86b3db2-2f76-464d-b087-39deddd5a48e => generated 1366 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:43:33.767715 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-5e2af4b1-7544-4d87-ade2-a8f43be1f9ca tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:43:33.768338 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-5e2af4b1-7544-4d87-ade2-a8f43be1f9ca tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: bf04b523-cedf-4e68-b77f-f6039d0de59c] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:43:33.779371 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5e2af4b1-7544-4d87-ade2-a8f43be1f9ca tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:33.780501 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5e2af4b1-7544-4d87-ade2-a8f43be1f9ca tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:33.781342 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5e2af4b1-7544-4d87-ade2-a8f43be1f9ca tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:33.782865 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5e2af4b1-7544-4d87-ade2-a8f43be1f9ca tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:33.784066 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5e2af4b1-7544-4d87-ade2-a8f43be1f9ca tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:33.785285 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5e2af4b1-7544-4d87-ade2-a8f43be1f9ca tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:33.985217 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-5e2af4b1-7544-4d87-ade2-a8f43be1f9ca tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:33.996734 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-5e2af4b1-7544-4d87-ade2-a8f43be1f9ca tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:33.998386 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-5e2af4b1-7544-4d87-ade2-a8f43be1f9ca tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:33.999878 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-5e2af4b1-7544-4d87-ade2-a8f43be1f9ca tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c" status: 200 len: 1741 microversion: 2.20 time: 0.236627 Aug 24 11:43:34.000436 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 509/1067] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:43:33 2022] GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c => generated 1741 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:43:34.284429 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [req-2809f46a-4a40-4582-b3a6-0051a671658d req-386cb9cf-d1f2-42c5-b702-8ee507c6d96e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b86b3db2-2f76-464d-b087-39deddd5a48e", "name": "network-vif-plugged", "status": "completed", "tag": "73a82f8e-4955-4b47-9cb6-a410213182dc"}]} {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:43:34.297298 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [req-2809f46a-4a40-4582-b3a6-0051a671658d req-386cb9cf-d1f2-42c5-b702-8ee507c6d96e service nova] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:34.297799 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [req-2809f46a-4a40-4582-b3a6-0051a671658d req-386cb9cf-d1f2-42c5-b702-8ee507c6d96e service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:34.298236 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [req-2809f46a-4a40-4582-b3a6-0051a671658d req-386cb9cf-d1f2-42c5-b702-8ee507c6d96e service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:34.314515 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.compute.server_external_events [req-2809f46a-4a40-4582-b3a6-0051a671658d req-386cb9cf-d1f2-42c5-b702-8ee507c6d96e service nova] Creating event network-vif-plugged:73a82f8e-4955-4b47-9cb6-a410213182dc for instance b86b3db2-2f76-464d-b087-39deddd5a48e on hv-cinder-85427 Aug 24 11:43:34.331719 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [req-2809f46a-4a40-4582-b3a6-0051a671658d req-386cb9cf-d1f2-42c5-b702-8ee507c6d96e service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051122 Aug 24 11:43:34.332674 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 559/1068] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Aug 24 11:43:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:43:34.642286 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-3b3e0bc8-e8a0-4812-a9d6-324327e4b3f5 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:43:34.642888 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-3b3e0bc8-e8a0-4812-a9d6-324327e4b3f5 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: b86b3db2-2f76-464d-b087-39deddd5a48e] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:43:34.649453 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-3b3e0bc8-e8a0-4812-a9d6-324327e4b3f5 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:34.649997 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-3b3e0bc8-e8a0-4812-a9d6-324327e4b3f5 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:34.650477 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-3b3e0bc8-e8a0-4812-a9d6-324327e4b3f5 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:34.651209 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-3b3e0bc8-e8a0-4812-a9d6-324327e4b3f5 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:34.651662 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-3b3e0bc8-e8a0-4812-a9d6-324327e4b3f5 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:34.652081 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-3b3e0bc8-e8a0-4812-a9d6-324327e4b3f5 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:34.807269 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-3b3e0bc8-e8a0-4812-a9d6-324327e4b3f5 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2715cf2a5129439c83a5347bb963f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4159dc366f41bc9e4057a079f6fb5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:34.815382 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-3b3e0bc8-e8a0-4812-a9d6-324327e4b3f5 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "GET /compute/v2.1/servers/b86b3db2-2f76-464d-b087-39deddd5a48e" status: 200 len: 1366 microversion: 2.1 time: 0.177013 Aug 24 11:43:34.815946 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 510/1069] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:43:34 2022] GET /compute/v2.1/servers/b86b3db2-2f76-464d-b087-39deddd5a48e => generated 1366 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:43:35.036975 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-9620152c-6de2-47a3-9907-78bab3843b47 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:43:35.037655 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-9620152c-6de2-47a3-9907-78bab3843b47 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: bf04b523-cedf-4e68-b77f-f6039d0de59c] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:43:35.044656 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-9620152c-6de2-47a3-9907-78bab3843b47 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:35.045167 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-9620152c-6de2-47a3-9907-78bab3843b47 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:35.045806 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-9620152c-6de2-47a3-9907-78bab3843b47 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:35.046980 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-9620152c-6de2-47a3-9907-78bab3843b47 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:35.046980 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-9620152c-6de2-47a3-9907-78bab3843b47 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:35.047424 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-9620152c-6de2-47a3-9907-78bab3843b47 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:35.457880 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-9620152c-6de2-47a3-9907-78bab3843b47 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:35.474621 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-9620152c-6de2-47a3-9907-78bab3843b47 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:35.476221 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-9620152c-6de2-47a3-9907-78bab3843b47 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:35.477539 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-9620152c-6de2-47a3-9907-78bab3843b47 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c" status: 200 len: 1741 microversion: 2.20 time: 0.445613 Aug 24 11:43:35.478683 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 560/1070] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:43:35 2022] GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c => generated 1741 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:43:35.836372 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-d49224ca-5ce8-442a-ae32-9da971a14ed8 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:43:35.836980 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-d49224ca-5ce8-442a-ae32-9da971a14ed8 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: b86b3db2-2f76-464d-b087-39deddd5a48e] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:43:35.845891 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d49224ca-5ce8-442a-ae32-9da971a14ed8 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:35.846172 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d49224ca-5ce8-442a-ae32-9da971a14ed8 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:35.846483 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d49224ca-5ce8-442a-ae32-9da971a14ed8 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:35.847194 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d49224ca-5ce8-442a-ae32-9da971a14ed8 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:35.847648 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d49224ca-5ce8-442a-ae32-9da971a14ed8 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:35.848069 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d49224ca-5ce8-442a-ae32-9da971a14ed8 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:35.988669 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-d49224ca-5ce8-442a-ae32-9da971a14ed8 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2715cf2a5129439c83a5347bb963f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4159dc366f41bc9e4057a079f6fb5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:35.996835 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-d49224ca-5ce8-442a-ae32-9da971a14ed8 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "GET /compute/v2.1/servers/b86b3db2-2f76-464d-b087-39deddd5a48e" status: 200 len: 1366 microversion: 2.1 time: 0.164592 Aug 24 11:43:35.997412 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 511/1071] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:43:35 2022] GET /compute/v2.1/servers/b86b3db2-2f76-464d-b087-39deddd5a48e => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:43:36.503596 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-5d868378-5441-4c04-9ef4-9986af4a361e tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:43:36.504284 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-5d868378-5441-4c04-9ef4-9986af4a361e tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: bf04b523-cedf-4e68-b77f-f6039d0de59c] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:43:36.511585 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-5d868378-5441-4c04-9ef4-9986af4a361e tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:36.511893 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-5d868378-5441-4c04-9ef4-9986af4a361e tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:36.512339 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-5d868378-5441-4c04-9ef4-9986af4a361e tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:36.513082 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-5d868378-5441-4c04-9ef4-9986af4a361e tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:36.513536 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-5d868378-5441-4c04-9ef4-9986af4a361e tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:36.513964 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-5d868378-5441-4c04-9ef4-9986af4a361e tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:36.650193 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-5d868378-5441-4c04-9ef4-9986af4a361e tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:36.661422 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-5d868378-5441-4c04-9ef4-9986af4a361e tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:36.664347 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-5d868378-5441-4c04-9ef4-9986af4a361e tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:36.665824 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-5d868378-5441-4c04-9ef4-9986af4a361e tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c" status: 200 len: 1741 microversion: 2.20 time: 0.166170 Aug 24 11:43:36.667254 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 561/1072] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:43:36 2022] GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c => generated 1741 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:43:37.018267 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-bad8dfcc-3770-437a-8f9c-c1a9d6dad6b3 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:43:37.018877 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-bad8dfcc-3770-437a-8f9c-c1a9d6dad6b3 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: b86b3db2-2f76-464d-b087-39deddd5a48e] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:43:37.026371 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-bad8dfcc-3770-437a-8f9c-c1a9d6dad6b3 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:37.026865 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-bad8dfcc-3770-437a-8f9c-c1a9d6dad6b3 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:37.027301 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-bad8dfcc-3770-437a-8f9c-c1a9d6dad6b3 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:37.028026 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-bad8dfcc-3770-437a-8f9c-c1a9d6dad6b3 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:37.028482 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-bad8dfcc-3770-437a-8f9c-c1a9d6dad6b3 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:37.028936 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-bad8dfcc-3770-437a-8f9c-c1a9d6dad6b3 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:37.168895 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-bad8dfcc-3770-437a-8f9c-c1a9d6dad6b3 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2715cf2a5129439c83a5347bb963f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4159dc366f41bc9e4057a079f6fb5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:37.177111 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-bad8dfcc-3770-437a-8f9c-c1a9d6dad6b3 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "GET /compute/v2.1/servers/b86b3db2-2f76-464d-b087-39deddd5a48e" status: 200 len: 1366 microversion: 2.1 time: 0.163153 Aug 24 11:43:37.178010 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 512/1073] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:43:37 2022] GET /compute/v2.1/servers/b86b3db2-2f76-464d-b087-39deddd5a48e => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:43:37.689321 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-751b0229-5698-43c3-b5a2-5bc3065d61ad tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:43:37.689965 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-751b0229-5698-43c3-b5a2-5bc3065d61ad tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: bf04b523-cedf-4e68-b77f-f6039d0de59c] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:43:37.698978 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-751b0229-5698-43c3-b5a2-5bc3065d61ad tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:37.699583 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-751b0229-5698-43c3-b5a2-5bc3065d61ad tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:37.700031 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-751b0229-5698-43c3-b5a2-5bc3065d61ad tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:37.700742 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-751b0229-5698-43c3-b5a2-5bc3065d61ad tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:37.701227 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-751b0229-5698-43c3-b5a2-5bc3065d61ad tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:37.701651 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-751b0229-5698-43c3-b5a2-5bc3065d61ad tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:37.854067 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-751b0229-5698-43c3-b5a2-5bc3065d61ad tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:37.865602 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-751b0229-5698-43c3-b5a2-5bc3065d61ad tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:37.867219 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-751b0229-5698-43c3-b5a2-5bc3065d61ad tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:37.868409 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-751b0229-5698-43c3-b5a2-5bc3065d61ad tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c" status: 200 len: 1741 microversion: 2.20 time: 0.183078 Aug 24 11:43:37.870034 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 562/1074] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:43:37 2022] GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c => generated 1741 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:43:38.199358 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-bb82da38-8ca9-4e0b-b62d-2f7df734e702 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:43:38.200001 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-bb82da38-8ca9-4e0b-b62d-2f7df734e702 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: b86b3db2-2f76-464d-b087-39deddd5a48e] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:43:38.206484 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-bb82da38-8ca9-4e0b-b62d-2f7df734e702 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:38.206981 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-bb82da38-8ca9-4e0b-b62d-2f7df734e702 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:38.207447 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-bb82da38-8ca9-4e0b-b62d-2f7df734e702 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:38.208152 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-bb82da38-8ca9-4e0b-b62d-2f7df734e702 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:38.208616 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-bb82da38-8ca9-4e0b-b62d-2f7df734e702 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:38.209069 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-bb82da38-8ca9-4e0b-b62d-2f7df734e702 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:38.363649 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-bb82da38-8ca9-4e0b-b62d-2f7df734e702 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2715cf2a5129439c83a5347bb963f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4159dc366f41bc9e4057a079f6fb5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:38.374508 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-bb82da38-8ca9-4e0b-b62d-2f7df734e702 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "GET /compute/v2.1/servers/b86b3db2-2f76-464d-b087-39deddd5a48e" status: 200 len: 1556 microversion: 2.1 time: 0.179507 Aug 24 11:43:38.389167 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 513/1075] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:43:38 2022] GET /compute/v2.1/servers/b86b3db2-2f76-464d-b087-39deddd5a48e => generated 1556 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:43:38.397653 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-f2bcc947-d1de-4f43-8477-0aa620bf3a22 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:43:38.398149 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-f2bcc947-d1de-4f43-8477-0aa620bf3a22 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: b86b3db2-2f76-464d-b087-39deddd5a48e] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:43:38.404742 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f2bcc947-d1de-4f43-8477-0aa620bf3a22 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:38.405404 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f2bcc947-d1de-4f43-8477-0aa620bf3a22 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:38.405404 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f2bcc947-d1de-4f43-8477-0aa620bf3a22 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:38.406057 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f2bcc947-d1de-4f43-8477-0aa620bf3a22 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:38.406519 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f2bcc947-d1de-4f43-8477-0aa620bf3a22 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:38.407059 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f2bcc947-d1de-4f43-8477-0aa620bf3a22 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:38.497228 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-f2bcc947-d1de-4f43-8477-0aa620bf3a22 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "GET /compute/v2.1/servers/b86b3db2-2f76-464d-b087-39deddd5a48e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.103242 Aug 24 11:43:38.498144 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 563/1076] 10.222.0.84 () {58 vars in 1275 bytes} [Wed Aug 24 11:43:38 2022] GET /compute/v2.1/servers/b86b3db2-2f76-464d-b087-39deddd5a48e/os-interface => generated 284 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:43:38.896878 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-cb8f9b59-3bdb-4f1f-ba27-c128047130c3 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:43:38.898128 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-cb8f9b59-3bdb-4f1f-ba27-c128047130c3 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: bf04b523-cedf-4e68-b77f-f6039d0de59c] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:43:38.906964 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-cb8f9b59-3bdb-4f1f-ba27-c128047130c3 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:38.907782 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-cb8f9b59-3bdb-4f1f-ba27-c128047130c3 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:38.908518 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-cb8f9b59-3bdb-4f1f-ba27-c128047130c3 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:38.909871 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-cb8f9b59-3bdb-4f1f-ba27-c128047130c3 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:38.910510 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-cb8f9b59-3bdb-4f1f-ba27-c128047130c3 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:38.911122 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-cb8f9b59-3bdb-4f1f-ba27-c128047130c3 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:39.071904 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-cb8f9b59-3bdb-4f1f-ba27-c128047130c3 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:39.080814 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-cb8f9b59-3bdb-4f1f-ba27-c128047130c3 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:39.082404 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-cb8f9b59-3bdb-4f1f-ba27-c128047130c3 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:39.083567 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-cb8f9b59-3bdb-4f1f-ba27-c128047130c3 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c" status: 200 len: 1723 microversion: 2.20 time: 0.191911 Aug 24 11:43:39.084135 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 514/1077] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:43:38 2022] GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c => generated 1723 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:43:39.723249 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [req-17124711-4a1d-4564-ad59-5913a6779972 req-617c89d2-137f-4550-9c32-d498a87d7dec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b86b3db2-2f76-464d-b087-39deddd5a48e", "tag": "73a82f8e-4955-4b47-9cb6-a410213182dc"}]} {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:43:39.733820 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [req-17124711-4a1d-4564-ad59-5913a6779972 req-617c89d2-137f-4550-9c32-d498a87d7dec service nova] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:39.734313 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [req-17124711-4a1d-4564-ad59-5913a6779972 req-617c89d2-137f-4550-9c32-d498a87d7dec service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:39.734743 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [req-17124711-4a1d-4564-ad59-5913a6779972 req-617c89d2-137f-4550-9c32-d498a87d7dec service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:39.748040 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.compute.server_external_events [req-17124711-4a1d-4564-ad59-5913a6779972 req-617c89d2-137f-4550-9c32-d498a87d7dec service nova] Creating event network-changed:73a82f8e-4955-4b47-9cb6-a410213182dc for instance b86b3db2-2f76-464d-b087-39deddd5a48e on hv-cinder-85427 Aug 24 11:43:39.753816 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [req-17124711-4a1d-4564-ad59-5913a6779972 req-617c89d2-137f-4550-9c32-d498a87d7dec service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108976 Aug 24 11:43:39.754429 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 564/1078] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Aug 24 11:43:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:43:40.108540 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-3455f7bb-a8ca-4080-a250-9754968c7b82 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:43:40.109383 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-3455f7bb-a8ca-4080-a250-9754968c7b82 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: bf04b523-cedf-4e68-b77f-f6039d0de59c] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:43:40.116218 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-3455f7bb-a8ca-4080-a250-9754968c7b82 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:40.116712 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-3455f7bb-a8ca-4080-a250-9754968c7b82 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:40.117494 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-3455f7bb-a8ca-4080-a250-9754968c7b82 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:40.121208 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-3455f7bb-a8ca-4080-a250-9754968c7b82 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:40.121208 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-3455f7bb-a8ca-4080-a250-9754968c7b82 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:40.121208 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-3455f7bb-a8ca-4080-a250-9754968c7b82 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:40.282767 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-3455f7bb-a8ca-4080-a250-9754968c7b82 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:40.292607 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-3455f7bb-a8ca-4080-a250-9754968c7b82 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:40.294169 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-3455f7bb-a8ca-4080-a250-9754968c7b82 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:40.295550 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-3455f7bb-a8ca-4080-a250-9754968c7b82 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c" status: 200 len: 1723 microversion: 2.20 time: 0.190959 Aug 24 11:43:40.296125 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 515/1079] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:43:40 2022] GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c => generated 1723 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:43:41.323114 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-cdddfeb1-638d-47fe-9f4f-73f79f8ae7d8 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:43:41.324745 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-cdddfeb1-638d-47fe-9f4f-73f79f8ae7d8 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: bf04b523-cedf-4e68-b77f-f6039d0de59c] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:43:41.333803 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-cdddfeb1-638d-47fe-9f4f-73f79f8ae7d8 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:41.334340 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-cdddfeb1-638d-47fe-9f4f-73f79f8ae7d8 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:41.334792 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-cdddfeb1-638d-47fe-9f4f-73f79f8ae7d8 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:41.335500 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-cdddfeb1-638d-47fe-9f4f-73f79f8ae7d8 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:41.335967 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-cdddfeb1-638d-47fe-9f4f-73f79f8ae7d8 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:41.336391 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-cdddfeb1-638d-47fe-9f4f-73f79f8ae7d8 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:41.492899 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-cdddfeb1-638d-47fe-9f4f-73f79f8ae7d8 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:41.500955 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-cdddfeb1-638d-47fe-9f4f-73f79f8ae7d8 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:41.503651 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-cdddfeb1-638d-47fe-9f4f-73f79f8ae7d8 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:41.505961 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-cdddfeb1-638d-47fe-9f4f-73f79f8ae7d8 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c" status: 200 len: 1723 microversion: 2.20 time: 0.188624 Aug 24 11:43:41.506951 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 565/1080] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:43:41 2022] GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c => generated 1723 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:43:42.139831 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [req-19f1d25c-0281-4f72-ba63-db57d25ec63c req-21a3e0fb-2392-499b-96fc-1404b7686196 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf04b523-cedf-4e68-b77f-f6039d0de59c", "name": "network-vif-unplugged", "status": "completed", "tag": "c30f1b51-2afd-425d-956e-dbabf88edac3"}]} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:43:42.150220 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-19f1d25c-0281-4f72-ba63-db57d25ec63c req-21a3e0fb-2392-499b-96fc-1404b7686196 service nova] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:42.150698 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-19f1d25c-0281-4f72-ba63-db57d25ec63c req-21a3e0fb-2392-499b-96fc-1404b7686196 service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:42.151290 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-19f1d25c-0281-4f72-ba63-db57d25ec63c req-21a3e0fb-2392-499b-96fc-1404b7686196 service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:42.166722 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.compute.server_external_events [req-19f1d25c-0281-4f72-ba63-db57d25ec63c req-21a3e0fb-2392-499b-96fc-1404b7686196 service nova] Creating event network-vif-unplugged:c30f1b51-2afd-425d-956e-dbabf88edac3 for instance bf04b523-cedf-4e68-b77f-f6039d0de59c on hv-cinder-85427 Aug 24 11:43:42.172129 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [req-19f1d25c-0281-4f72-ba63-db57d25ec63c req-21a3e0fb-2392-499b-96fc-1404b7686196 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037363 Aug 24 11:43:42.173049 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 516/1081] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Aug 24 11:43:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:43:42.530965 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-97cac51a-f700-4072-aa86-35f6723acfcc tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:43:42.532617 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-97cac51a-f700-4072-aa86-35f6723acfcc tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: bf04b523-cedf-4e68-b77f-f6039d0de59c] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:43:42.538452 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-97cac51a-f700-4072-aa86-35f6723acfcc tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:42.545493 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-97cac51a-f700-4072-aa86-35f6723acfcc tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:42.545493 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-97cac51a-f700-4072-aa86-35f6723acfcc tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:42.545493 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-97cac51a-f700-4072-aa86-35f6723acfcc tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:42.545493 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-97cac51a-f700-4072-aa86-35f6723acfcc tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:42.546198 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-97cac51a-f700-4072-aa86-35f6723acfcc tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:42.704893 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-97cac51a-f700-4072-aa86-35f6723acfcc tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:42.707558 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG dbcounter [-] [124769] Writing DB stats nova_cell1:SELECT=100 {{(pid=124769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:43:42.715488 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-97cac51a-f700-4072-aa86-35f6723acfcc tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:42.717008 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-97cac51a-f700-4072-aa86-35f6723acfcc tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:42.729100 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-97cac51a-f700-4072-aa86-35f6723acfcc tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c" status: 200 len: 1666 microversion: 2.20 time: 0.191519 Aug 24 11:43:42.729100 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 566/1082] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:43:42 2022] GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c => generated 1666 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:43:42.742953 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-2abe5265-9b19-46f7-8759-8bafd9c87447 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8e1d3b42-3098-4ab6-853d-841ece7c0ebe"}} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:43:42.746035 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-2abe5265-9b19-46f7-8759-8bafd9c87447 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: bf04b523-cedf-4e68-b77f-f6039d0de59c] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:43:42.753775 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-2abe5265-9b19-46f7-8759-8bafd9c87447 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:42.754263 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-2abe5265-9b19-46f7-8759-8bafd9c87447 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:42.754710 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-2abe5265-9b19-46f7-8759-8bafd9c87447 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:42.755412 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-2abe5265-9b19-46f7-8759-8bafd9c87447 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:42.755872 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-2abe5265-9b19-46f7-8759-8bafd9c87447 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:42.756295 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-2abe5265-9b19-46f7-8759-8bafd9c87447 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:44.038361 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-2abe5265-9b19-46f7-8759-8bafd9c87447 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "POST /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.300676 Aug 24 11:43:44.039138 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 517/1083] 10.222.0.84 () {62 vars in 1364 bytes} [Wed Aug 24 11:43:42 2022] POST /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c/os-volume_attachments => generated 188 bytes in 1302 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 11:43:44.183284 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-c039a467-e4f5-432b-9efa-7831f22ede9b tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:43:44.183854 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-c039a467-e4f5-432b-9efa-7831f22ede9b tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: bf04b523-cedf-4e68-b77f-f6039d0de59c] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:43:44.190696 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-c039a467-e4f5-432b-9efa-7831f22ede9b tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:44.191172 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-c039a467-e4f5-432b-9efa-7831f22ede9b tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:44.191602 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-c039a467-e4f5-432b-9efa-7831f22ede9b tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:44.192286 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-c039a467-e4f5-432b-9efa-7831f22ede9b tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:44.192730 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-c039a467-e4f5-432b-9efa-7831f22ede9b tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:44.193176 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-c039a467-e4f5-432b-9efa-7831f22ede9b tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:44.951335 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-c039a467-e4f5-432b-9efa-7831f22ede9b tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "DELETE /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c/os-volume_attachments/8e1d3b42-3098-4ab6-853d-841ece7c0ebe" status: 202 len: 0 microversion: 2.20 time: 0.772327 Aug 24 11:43:44.951987 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 567/1084] 10.222.0.84 () {60 vars in 1457 bytes} [Wed Aug 24 11:43:44 2022] DELETE /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c/os-volume_attachments/8e1d3b42-3098-4ab6-853d-841ece7c0ebe => generated 0 bytes in 774 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 11:43:45.016141 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-6598ca79-04e2-483e-aa62-0325f728cbc7 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:43:45.016742 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-6598ca79-04e2-483e-aa62-0325f728cbc7 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: bf04b523-cedf-4e68-b77f-f6039d0de59c] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:43:45.023614 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6598ca79-04e2-483e-aa62-0325f728cbc7 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:45.024108 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6598ca79-04e2-483e-aa62-0325f728cbc7 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:45.024578 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6598ca79-04e2-483e-aa62-0325f728cbc7 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:45.025995 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6598ca79-04e2-483e-aa62-0325f728cbc7 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:45.026463 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6598ca79-04e2-483e-aa62-0325f728cbc7 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:45.026898 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6598ca79-04e2-483e-aa62-0325f728cbc7 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:45.059463 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-6598ca79-04e2-483e-aa62-0325f728cbc7 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: bf04b523-cedf-4e68-b77f-f6039d0de59c] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=124770) unshelve /opt/stack/nova/nova/compute/api.py:4578}} Aug 24 11:43:45.316581 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:43:45.429022 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-6598ca79-04e2-483e-aa62-0325f728cbc7 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "POST /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c/action" status: 202 len: 0 microversion: 2.20 time: 0.416837 Aug 24 11:43:45.429620 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 518/1085] 10.222.0.84 () {62 vars in 1319 bytes} [Wed Aug 24 11:43:45 2022] POST /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c/action => generated 0 bytes in 418 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 24 11:43:45.438756 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-85239bca-7d1c-4e32-b132-802825058bc2 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:43:45.439388 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-85239bca-7d1c-4e32-b132-802825058bc2 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: bf04b523-cedf-4e68-b77f-f6039d0de59c] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:43:45.446439 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-85239bca-7d1c-4e32-b132-802825058bc2 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:45.447020 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-85239bca-7d1c-4e32-b132-802825058bc2 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:45.447481 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-85239bca-7d1c-4e32-b132-802825058bc2 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:45.448170 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-85239bca-7d1c-4e32-b132-802825058bc2 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:45.448621 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-85239bca-7d1c-4e32-b132-802825058bc2 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:45.449188 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-85239bca-7d1c-4e32-b132-802825058bc2 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:45.592996 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-85239bca-7d1c-4e32-b132-802825058bc2 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:45.601308 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-85239bca-7d1c-4e32-b132-802825058bc2 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:45.603466 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-85239bca-7d1c-4e32-b132-802825058bc2 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:45.605386 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-85239bca-7d1c-4e32-b132-802825058bc2 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c" status: 200 len: 1674 microversion: 2.20 time: 0.170808 Aug 24 11:43:45.606026 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 568/1086] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:43:45 2022] GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c => generated 1674 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:43:46.630845 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-dd136c15-66f5-424e-a84a-ca9e0ce3586d tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:43:46.631566 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-dd136c15-66f5-424e-a84a-ca9e0ce3586d tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: bf04b523-cedf-4e68-b77f-f6039d0de59c] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:43:46.640324 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-dd136c15-66f5-424e-a84a-ca9e0ce3586d tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:46.640853 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-dd136c15-66f5-424e-a84a-ca9e0ce3586d tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:46.641272 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-dd136c15-66f5-424e-a84a-ca9e0ce3586d tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:46.641975 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-dd136c15-66f5-424e-a84a-ca9e0ce3586d tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:46.643240 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-dd136c15-66f5-424e-a84a-ca9e0ce3586d tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:46.643240 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-dd136c15-66f5-424e-a84a-ca9e0ce3586d tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:46.784749 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-dd136c15-66f5-424e-a84a-ca9e0ce3586d tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:46.792984 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-dd136c15-66f5-424e-a84a-ca9e0ce3586d tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:46.794495 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-dd136c15-66f5-424e-a84a-ca9e0ce3586d tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:46.795650 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-dd136c15-66f5-424e-a84a-ca9e0ce3586d tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c" status: 200 len: 1674 microversion: 2.20 time: 0.169707 Aug 24 11:43:46.796298 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 519/1087] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:43:46 2022] GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c => generated 1674 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:43:47.820302 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-85cd004c-d729-4635-9dfb-1689cba14a7f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:43:47.820938 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-85cd004c-d729-4635-9dfb-1689cba14a7f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: bf04b523-cedf-4e68-b77f-f6039d0de59c] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:43:47.827695 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-85cd004c-d729-4635-9dfb-1689cba14a7f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:47.828178 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-85cd004c-d729-4635-9dfb-1689cba14a7f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:47.828611 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-85cd004c-d729-4635-9dfb-1689cba14a7f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:47.829328 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-85cd004c-d729-4635-9dfb-1689cba14a7f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:47.830883 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-85cd004c-d729-4635-9dfb-1689cba14a7f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:47.830883 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-85cd004c-d729-4635-9dfb-1689cba14a7f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:48.002785 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-85cd004c-d729-4635-9dfb-1689cba14a7f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:48.011604 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-85cd004c-d729-4635-9dfb-1689cba14a7f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:48.013102 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-85cd004c-d729-4635-9dfb-1689cba14a7f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:48.014456 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-85cd004c-d729-4635-9dfb-1689cba14a7f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c" status: 200 len: 1732 microversion: 2.20 time: 0.199117 Aug 24 11:43:48.015180 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 569/1088] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:43:47 2022] GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c => generated 1732 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:43:48.277837 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-c2a5803a-2e64-443d-9d6d-d02d024d33df tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:43:48.278787 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-c2a5803a-2e64-443d-9d6d-d02d024d33df tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] [instance: 29619526-3255-4729-81c6-53db060e7426] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:43:48.286608 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c2a5803a-2e64-443d-9d6d-d02d024d33df tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:48.287130 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c2a5803a-2e64-443d-9d6d-d02d024d33df tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:48.287750 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c2a5803a-2e64-443d-9d6d-d02d024d33df tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:48.288423 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c2a5803a-2e64-443d-9d6d-d02d024d33df tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:48.288898 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c2a5803a-2e64-443d-9d6d-d02d024d33df tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:48.289320 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c2a5803a-2e64-443d-9d6d-d02d024d33df tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:48.317505 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-c2a5803a-2e64-443d-9d6d-d02d024d33df tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] 10.222.0.84 "GET /compute/v2.1/servers/29619526-3255-4729-81c6-53db060e7426/ips" status: 200 len: 144 microversion: 2.1 time: 0.204707 Aug 24 11:43:48.318064 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 520/1089] 10.222.0.84 () {58 vars in 1248 bytes} [Wed Aug 24 11:43:48 2022] GET /compute/v2.1/servers/29619526-3255-4729-81c6-53db060e7426/ips => generated 144 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:43:49.039792 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-79a7c0b6-8bf2-4c23-8976-2046431a58d8 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:43:49.040447 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-79a7c0b6-8bf2-4c23-8976-2046431a58d8 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: bf04b523-cedf-4e68-b77f-f6039d0de59c] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:43:49.048315 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-79a7c0b6-8bf2-4c23-8976-2046431a58d8 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:49.049262 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-79a7c0b6-8bf2-4c23-8976-2046431a58d8 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:49.049996 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-79a7c0b6-8bf2-4c23-8976-2046431a58d8 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:49.051092 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-79a7c0b6-8bf2-4c23-8976-2046431a58d8 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:49.051810 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-79a7c0b6-8bf2-4c23-8976-2046431a58d8 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:49.052469 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-79a7c0b6-8bf2-4c23-8976-2046431a58d8 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:49.214735 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-79a7c0b6-8bf2-4c23-8976-2046431a58d8 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:49.223801 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-79a7c0b6-8bf2-4c23-8976-2046431a58d8 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:49.225339 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-79a7c0b6-8bf2-4c23-8976-2046431a58d8 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:49.226514 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-79a7c0b6-8bf2-4c23-8976-2046431a58d8 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c" status: 200 len: 1732 microversion: 2.20 time: 0.190898 Aug 24 11:43:49.227070 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 570/1090] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:43:49 2022] GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c => generated 1732 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:43:50.254214 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-df7c770b-f987-4dc2-85bb-9eeab147cedd tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:43:50.254744 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-df7c770b-f987-4dc2-85bb-9eeab147cedd tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: bf04b523-cedf-4e68-b77f-f6039d0de59c] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:43:50.262667 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-df7c770b-f987-4dc2-85bb-9eeab147cedd tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:50.263198 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-df7c770b-f987-4dc2-85bb-9eeab147cedd tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:50.263635 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-df7c770b-f987-4dc2-85bb-9eeab147cedd tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:50.264340 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-df7c770b-f987-4dc2-85bb-9eeab147cedd tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:50.264811 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-df7c770b-f987-4dc2-85bb-9eeab147cedd tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:50.265245 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-df7c770b-f987-4dc2-85bb-9eeab147cedd tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:50.413365 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-df7c770b-f987-4dc2-85bb-9eeab147cedd tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:50.423149 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-df7c770b-f987-4dc2-85bb-9eeab147cedd tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:50.424901 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-df7c770b-f987-4dc2-85bb-9eeab147cedd tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:50.426067 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-df7c770b-f987-4dc2-85bb-9eeab147cedd tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c" status: 200 len: 1732 microversion: 2.20 time: 0.176117 Aug 24 11:43:50.426714 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 521/1091] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:43:50 2022] GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c => generated 1732 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:43:51.323832 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-18e6cad3-ddde-4418-b4e5-e5c3278d5fec tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1b6cf03f-8282-4125-bd90-93cd5d4b6102"}} {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:43:51.331539 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-18e6cad3-ddde-4418-b4e5-e5c3278d5fec tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] [instance: 29619526-3255-4729-81c6-53db060e7426] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:43:51.343140 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-18e6cad3-ddde-4418-b4e5-e5c3278d5fec tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:51.343648 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-18e6cad3-ddde-4418-b4e5-e5c3278d5fec tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:51.344091 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-18e6cad3-ddde-4418-b4e5-e5c3278d5fec tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:51.344834 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-18e6cad3-ddde-4418-b4e5-e5c3278d5fec tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:51.345281 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-18e6cad3-ddde-4418-b4e5-e5c3278d5fec tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:51.345714 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-18e6cad3-ddde-4418-b4e5-e5c3278d5fec tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:51.457153 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-52f068b9-bab7-4138-84bf-116ff78fa627 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:43:51.458315 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-52f068b9-bab7-4138-84bf-116ff78fa627 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: bf04b523-cedf-4e68-b77f-f6039d0de59c] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:43:51.466080 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-52f068b9-bab7-4138-84bf-116ff78fa627 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:51.466664 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-52f068b9-bab7-4138-84bf-116ff78fa627 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:51.467183 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-52f068b9-bab7-4138-84bf-116ff78fa627 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:51.467999 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-52f068b9-bab7-4138-84bf-116ff78fa627 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:51.468524 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-52f068b9-bab7-4138-84bf-116ff78fa627 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:51.469049 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-52f068b9-bab7-4138-84bf-116ff78fa627 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:51.634527 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-52f068b9-bab7-4138-84bf-116ff78fa627 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:51.643393 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-52f068b9-bab7-4138-84bf-116ff78fa627 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:51.644899 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-52f068b9-bab7-4138-84bf-116ff78fa627 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:51.646080 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-52f068b9-bab7-4138-84bf-116ff78fa627 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c" status: 200 len: 1732 microversion: 2.20 time: 0.193373 Aug 24 11:43:51.646644 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 522/1092] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:43:51 2022] GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c => generated 1732 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 11:43:52.677804 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-35611ca1-28f6-4bab-9efa-246e98b32f49 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:43:52.678964 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-35611ca1-28f6-4bab-9efa-246e98b32f49 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: bf04b523-cedf-4e68-b77f-f6039d0de59c] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:43:52.688866 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-35611ca1-28f6-4bab-9efa-246e98b32f49 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:52.690597 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-35611ca1-28f6-4bab-9efa-246e98b32f49 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:52.691730 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-35611ca1-28f6-4bab-9efa-246e98b32f49 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:52.693113 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-35611ca1-28f6-4bab-9efa-246e98b32f49 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:52.693811 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-35611ca1-28f6-4bab-9efa-246e98b32f49 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:52.694478 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-35611ca1-28f6-4bab-9efa-246e98b32f49 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:52.876952 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-35611ca1-28f6-4bab-9efa-246e98b32f49 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:52.887303 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-35611ca1-28f6-4bab-9efa-246e98b32f49 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:52.888823 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-35611ca1-28f6-4bab-9efa-246e98b32f49 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:52.890081 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-35611ca1-28f6-4bab-9efa-246e98b32f49 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c" status: 200 len: 1732 microversion: 2.20 time: 0.219107 Aug 24 11:43:52.890612 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 523/1093] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:43:52 2022] GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c => generated 1732 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:43:53.920271 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-fa1ad051-4039-42d5-8fef-3e6d1a864fe9 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:43:53.921279 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-fa1ad051-4039-42d5-8fef-3e6d1a864fe9 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: bf04b523-cedf-4e68-b77f-f6039d0de59c] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:43:53.928630 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-fa1ad051-4039-42d5-8fef-3e6d1a864fe9 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:53.929156 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-fa1ad051-4039-42d5-8fef-3e6d1a864fe9 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:53.929589 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-fa1ad051-4039-42d5-8fef-3e6d1a864fe9 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:53.930274 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-fa1ad051-4039-42d5-8fef-3e6d1a864fe9 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:53.930831 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-fa1ad051-4039-42d5-8fef-3e6d1a864fe9 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:53.931167 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-fa1ad051-4039-42d5-8fef-3e6d1a864fe9 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:54.115006 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-fa1ad051-4039-42d5-8fef-3e6d1a864fe9 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:54.130229 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-fa1ad051-4039-42d5-8fef-3e6d1a864fe9 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:54.131975 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-fa1ad051-4039-42d5-8fef-3e6d1a864fe9 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:54.133711 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-fa1ad051-4039-42d5-8fef-3e6d1a864fe9 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c" status: 200 len: 1732 microversion: 2.20 time: 0.220914 Aug 24 11:43:54.136486 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 524/1094] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:43:53 2022] GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c => generated 1732 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 11:43:55.173775 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-78ad73f3-919d-4ffb-aba6-226aae0b8218 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:43:55.175781 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-78ad73f3-919d-4ffb-aba6-226aae0b8218 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: bf04b523-cedf-4e68-b77f-f6039d0de59c] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:43:55.184280 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-78ad73f3-919d-4ffb-aba6-226aae0b8218 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:55.186434 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-78ad73f3-919d-4ffb-aba6-226aae0b8218 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:55.187453 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-78ad73f3-919d-4ffb-aba6-226aae0b8218 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:55.188022 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-78ad73f3-919d-4ffb-aba6-226aae0b8218 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:55.188627 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-78ad73f3-919d-4ffb-aba6-226aae0b8218 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:55.189162 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-78ad73f3-919d-4ffb-aba6-226aae0b8218 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:55.346660 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-78ad73f3-919d-4ffb-aba6-226aae0b8218 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:55.365296 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-78ad73f3-919d-4ffb-aba6-226aae0b8218 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:55.367254 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-78ad73f3-919d-4ffb-aba6-226aae0b8218 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:55.369537 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-78ad73f3-919d-4ffb-aba6-226aae0b8218 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c" status: 200 len: 1732 microversion: 2.20 time: 0.200369 Aug 24 11:43:55.370222 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 525/1095] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:43:55 2022] GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c => generated 1732 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 11:43:56.395481 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-efbebec7-9d74-40aa-9a3f-0e1e5b3692ff tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:43:56.396217 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-efbebec7-9d74-40aa-9a3f-0e1e5b3692ff tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: bf04b523-cedf-4e68-b77f-f6039d0de59c] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:43:56.404501 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-efbebec7-9d74-40aa-9a3f-0e1e5b3692ff tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:56.405424 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-efbebec7-9d74-40aa-9a3f-0e1e5b3692ff tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:56.406149 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-efbebec7-9d74-40aa-9a3f-0e1e5b3692ff tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:56.407396 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-efbebec7-9d74-40aa-9a3f-0e1e5b3692ff tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:56.408191 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-efbebec7-9d74-40aa-9a3f-0e1e5b3692ff tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:56.408902 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-efbebec7-9d74-40aa-9a3f-0e1e5b3692ff tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:56.577225 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-efbebec7-9d74-40aa-9a3f-0e1e5b3692ff tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:56.585788 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-efbebec7-9d74-40aa-9a3f-0e1e5b3692ff tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:56.592109 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-efbebec7-9d74-40aa-9a3f-0e1e5b3692ff tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:56.592109 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-efbebec7-9d74-40aa-9a3f-0e1e5b3692ff tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c" status: 200 len: 1732 microversion: 2.20 time: 0.199960 Aug 24 11:43:56.592109 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 526/1096] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:43:56 2022] GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c => generated 1732 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:43:57.613030 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-90b9a064-5036-41f1-958d-b32b79a8a5ad tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:43:57.613742 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-90b9a064-5036-41f1-958d-b32b79a8a5ad tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: bf04b523-cedf-4e68-b77f-f6039d0de59c] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:43:57.622209 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-90b9a064-5036-41f1-958d-b32b79a8a5ad tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:57.622751 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-90b9a064-5036-41f1-958d-b32b79a8a5ad tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:57.623291 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-90b9a064-5036-41f1-958d-b32b79a8a5ad tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:57.624345 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-90b9a064-5036-41f1-958d-b32b79a8a5ad tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:57.624970 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-90b9a064-5036-41f1-958d-b32b79a8a5ad tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:57.625485 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-90b9a064-5036-41f1-958d-b32b79a8a5ad tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:57.793126 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-90b9a064-5036-41f1-958d-b32b79a8a5ad tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:57.804438 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-90b9a064-5036-41f1-958d-b32b79a8a5ad tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:57.807000 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-90b9a064-5036-41f1-958d-b32b79a8a5ad tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:57.808516 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-90b9a064-5036-41f1-958d-b32b79a8a5ad tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c" status: 200 len: 1732 microversion: 2.20 time: 0.199631 Aug 24 11:43:57.809161 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 527/1097] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:43:57 2022] GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c => generated 1732 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 11:43:58.835843 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-adff7a80-3fad-49e1-b952-a919e1aac9d3 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:43:58.876036 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-adff7a80-3fad-49e1-b952-a919e1aac9d3 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: bf04b523-cedf-4e68-b77f-f6039d0de59c] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:43:58.876036 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-adff7a80-3fad-49e1-b952-a919e1aac9d3 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:58.876036 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-adff7a80-3fad-49e1-b952-a919e1aac9d3 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:58.876036 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-adff7a80-3fad-49e1-b952-a919e1aac9d3 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:58.876447 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-adff7a80-3fad-49e1-b952-a919e1aac9d3 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:58.876447 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-adff7a80-3fad-49e1-b952-a919e1aac9d3 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:58.876447 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-adff7a80-3fad-49e1-b952-a919e1aac9d3 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:59.002593 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-adff7a80-3fad-49e1-b952-a919e1aac9d3 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:59.011766 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-adff7a80-3fad-49e1-b952-a919e1aac9d3 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:59.013312 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-adff7a80-3fad-49e1-b952-a919e1aac9d3 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:59.014636 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-adff7a80-3fad-49e1-b952-a919e1aac9d3 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c" status: 200 len: 1732 microversion: 2.20 time: 0.182989 Aug 24 11:43:59.015231 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 528/1098] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:43:58 2022] GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c => generated 1732 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 11:44:00.043221 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-ee6f2321-2f7b-4306-b248-93c2ed9dd42d tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:44:00.049839 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-ee6f2321-2f7b-4306-b248-93c2ed9dd42d tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: bf04b523-cedf-4e68-b77f-f6039d0de59c] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:44:00.058211 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ee6f2321-2f7b-4306-b248-93c2ed9dd42d tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:00.059054 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ee6f2321-2f7b-4306-b248-93c2ed9dd42d tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:00.059689 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ee6f2321-2f7b-4306-b248-93c2ed9dd42d tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:00.060834 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ee6f2321-2f7b-4306-b248-93c2ed9dd42d tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:00.061543 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ee6f2321-2f7b-4306-b248-93c2ed9dd42d tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:00.062157 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ee6f2321-2f7b-4306-b248-93c2ed9dd42d tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:00.238927 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-ee6f2321-2f7b-4306-b248-93c2ed9dd42d tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:44:00.241080 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-ee6f2321-2f7b-4306-b248-93c2ed9dd42d tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:44:00.242610 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-ee6f2321-2f7b-4306-b248-93c2ed9dd42d tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:44:00.244090 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-ee6f2321-2f7b-4306-b248-93c2ed9dd42d tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c" status: 200 len: 1732 microversion: 2.20 time: 0.207120 Aug 24 11:44:00.244647 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 529/1099] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:44:00 2022] GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c => generated 1732 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:44:01.268135 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-6085c4d8-ca7a-444a-96fe-81e659d2f44a tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:44:01.268943 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-6085c4d8-ca7a-444a-96fe-81e659d2f44a tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: bf04b523-cedf-4e68-b77f-f6039d0de59c] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:44:01.275962 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6085c4d8-ca7a-444a-96fe-81e659d2f44a tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:01.276448 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6085c4d8-ca7a-444a-96fe-81e659d2f44a tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:01.276961 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6085c4d8-ca7a-444a-96fe-81e659d2f44a tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:01.277706 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6085c4d8-ca7a-444a-96fe-81e659d2f44a tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:01.278203 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6085c4d8-ca7a-444a-96fe-81e659d2f44a tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:01.278629 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6085c4d8-ca7a-444a-96fe-81e659d2f44a tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:01.338102 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG dbcounter [-] [124769] Writing DB stats nova_api:SELECT=35 {{(pid=124769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:44:01.423889 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG dbcounter [-] [124769] Writing DB stats nova_cell1:SELECT=40,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=124769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:44:01.432855 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-6085c4d8-ca7a-444a-96fe-81e659d2f44a tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:44:01.442590 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-6085c4d8-ca7a-444a-96fe-81e659d2f44a tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:44:01.445529 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-6085c4d8-ca7a-444a-96fe-81e659d2f44a tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:44:01.447888 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-6085c4d8-ca7a-444a-96fe-81e659d2f44a tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c" status: 200 len: 1732 microversion: 2.20 time: 0.183786 Aug 24 11:44:01.448907 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 530/1100] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:44:01 2022] GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c => generated 1732 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 11:44:02.474388 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-1944e4ac-389e-4f8e-be66-298ccd6680b9 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:44:02.475743 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-1944e4ac-389e-4f8e-be66-298ccd6680b9 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: bf04b523-cedf-4e68-b77f-f6039d0de59c] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:44:02.483939 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1944e4ac-389e-4f8e-be66-298ccd6680b9 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:02.484440 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1944e4ac-389e-4f8e-be66-298ccd6680b9 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:02.484900 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1944e4ac-389e-4f8e-be66-298ccd6680b9 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:02.485628 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1944e4ac-389e-4f8e-be66-298ccd6680b9 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:02.486080 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1944e4ac-389e-4f8e-be66-298ccd6680b9 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:02.486495 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1944e4ac-389e-4f8e-be66-298ccd6680b9 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:02.633085 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-1944e4ac-389e-4f8e-be66-298ccd6680b9 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:44:02.641361 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-1944e4ac-389e-4f8e-be66-298ccd6680b9 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:44:02.642839 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-1944e4ac-389e-4f8e-be66-298ccd6680b9 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:44:02.643986 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-1944e4ac-389e-4f8e-be66-298ccd6680b9 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c" status: 200 len: 1732 microversion: 2.20 time: 0.174183 Aug 24 11:44:02.644563 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 531/1101] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:44:02 2022] GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c => generated 1732 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 11:44:03.666151 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-b3e5b12c-3c0f-4334-9a63-82bd13c7eb57 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:44:03.666844 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-b3e5b12c-3c0f-4334-9a63-82bd13c7eb57 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: bf04b523-cedf-4e68-b77f-f6039d0de59c] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:44:03.669876 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:44:03.674692 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b3e5b12c-3c0f-4334-9a63-82bd13c7eb57 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:03.675183 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b3e5b12c-3c0f-4334-9a63-82bd13c7eb57 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:03.676084 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b3e5b12c-3c0f-4334-9a63-82bd13c7eb57 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:03.676302 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b3e5b12c-3c0f-4334-9a63-82bd13c7eb57 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:03.676754 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b3e5b12c-3c0f-4334-9a63-82bd13c7eb57 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:03.683895 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b3e5b12c-3c0f-4334-9a63-82bd13c7eb57 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:03.828311 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-b3e5b12c-3c0f-4334-9a63-82bd13c7eb57 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:44:03.837202 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-b3e5b12c-3c0f-4334-9a63-82bd13c7eb57 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:44:03.839121 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-b3e5b12c-3c0f-4334-9a63-82bd13c7eb57 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:44:03.840375 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-b3e5b12c-3c0f-4334-9a63-82bd13c7eb57 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c" status: 200 len: 1732 microversion: 2.20 time: 0.178229 Aug 24 11:44:03.840961 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 532/1102] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:44:03 2022] GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c => generated 1732 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 11:44:04.868309 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-5c3ffe3c-41a8-4d57-a2a7-5657b1cd7108 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:44:04.869252 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-5c3ffe3c-41a8-4d57-a2a7-5657b1cd7108 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: bf04b523-cedf-4e68-b77f-f6039d0de59c] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:44:04.876094 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5c3ffe3c-41a8-4d57-a2a7-5657b1cd7108 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:04.876582 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5c3ffe3c-41a8-4d57-a2a7-5657b1cd7108 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:04.877059 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5c3ffe3c-41a8-4d57-a2a7-5657b1cd7108 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:04.877762 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5c3ffe3c-41a8-4d57-a2a7-5657b1cd7108 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:04.878216 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5c3ffe3c-41a8-4d57-a2a7-5657b1cd7108 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:04.878645 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5c3ffe3c-41a8-4d57-a2a7-5657b1cd7108 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:05.033479 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-5c3ffe3c-41a8-4d57-a2a7-5657b1cd7108 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:44:05.042225 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-5c3ffe3c-41a8-4d57-a2a7-5657b1cd7108 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:44:05.043719 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-5c3ffe3c-41a8-4d57-a2a7-5657b1cd7108 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:44:05.044899 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-5c3ffe3c-41a8-4d57-a2a7-5657b1cd7108 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c" status: 200 len: 1732 microversion: 2.20 time: 0.180806 Aug 24 11:44:05.045492 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 533/1103] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:44:04 2022] GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c => generated 1732 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 11:44:06.067861 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-3ac1d419-ef93-47b8-965f-fee9ac094026 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:44:06.069147 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-3ac1d419-ef93-47b8-965f-fee9ac094026 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: bf04b523-cedf-4e68-b77f-f6039d0de59c] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:44:06.075918 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-3ac1d419-ef93-47b8-965f-fee9ac094026 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:06.076406 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-3ac1d419-ef93-47b8-965f-fee9ac094026 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:06.076881 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-3ac1d419-ef93-47b8-965f-fee9ac094026 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:06.077589 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-3ac1d419-ef93-47b8-965f-fee9ac094026 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:06.078045 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-3ac1d419-ef93-47b8-965f-fee9ac094026 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:06.078472 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-3ac1d419-ef93-47b8-965f-fee9ac094026 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:06.218151 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-3ac1d419-ef93-47b8-965f-fee9ac094026 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:44:06.226655 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-3ac1d419-ef93-47b8-965f-fee9ac094026 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:44:06.228385 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-3ac1d419-ef93-47b8-965f-fee9ac094026 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:44:06.229601 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-3ac1d419-ef93-47b8-965f-fee9ac094026 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c" status: 200 len: 1732 microversion: 2.20 time: 0.165869 Aug 24 11:44:06.232018 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 534/1104] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:44:06 2022] GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c => generated 1732 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 11:44:07.258142 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-1a266d6d-6197-4920-baa3-efbf04fa9503 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:44:07.258829 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-1a266d6d-6197-4920-baa3-efbf04fa9503 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: bf04b523-cedf-4e68-b77f-f6039d0de59c] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:44:07.265961 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1a266d6d-6197-4920-baa3-efbf04fa9503 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:07.266446 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1a266d6d-6197-4920-baa3-efbf04fa9503 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:07.266886 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1a266d6d-6197-4920-baa3-efbf04fa9503 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:07.267588 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1a266d6d-6197-4920-baa3-efbf04fa9503 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:07.268035 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1a266d6d-6197-4920-baa3-efbf04fa9503 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:07.268452 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1a266d6d-6197-4920-baa3-efbf04fa9503 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:07.410708 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-1a266d6d-6197-4920-baa3-efbf04fa9503 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:44:07.412984 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:44:07.420646 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-1a266d6d-6197-4920-baa3-efbf04fa9503 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:44:07.422191 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-1a266d6d-6197-4920-baa3-efbf04fa9503 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:44:07.423357 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-1a266d6d-6197-4920-baa3-efbf04fa9503 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c" status: 200 len: 1732 microversion: 2.20 time: 0.169248 Aug 24 11:44:07.423912 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 535/1105] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:44:07 2022] GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c => generated 1732 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 11:44:08.447816 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-8df59ebc-058c-445e-a482-dfab88739ca7 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:44:08.448546 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-8df59ebc-058c-445e-a482-dfab88739ca7 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: bf04b523-cedf-4e68-b77f-f6039d0de59c] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:44:08.455827 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8df59ebc-058c-445e-a482-dfab88739ca7 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:08.456303 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8df59ebc-058c-445e-a482-dfab88739ca7 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:08.456735 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8df59ebc-058c-445e-a482-dfab88739ca7 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:08.457442 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8df59ebc-058c-445e-a482-dfab88739ca7 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:08.457944 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8df59ebc-058c-445e-a482-dfab88739ca7 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:08.458308 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8df59ebc-058c-445e-a482-dfab88739ca7 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:08.598394 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-8df59ebc-058c-445e-a482-dfab88739ca7 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:44:08.607861 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-8df59ebc-058c-445e-a482-dfab88739ca7 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:44:08.609557 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-8df59ebc-058c-445e-a482-dfab88739ca7 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:44:08.610716 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-8df59ebc-058c-445e-a482-dfab88739ca7 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c" status: 200 len: 1732 microversion: 2.20 time: 0.166872 Aug 24 11:44:08.611271 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 536/1106] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:44:08 2022] GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c => generated 1732 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 11:44:09.464438 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-18e6cad3-ddde-4418-b4e5-e5c3278d5fec tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] 10.222.0.84 "POST /compute/v2.1/servers/29619526-3255-4729-81c6-53db060e7426/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 18.147879 Aug 24 11:44:09.465307 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 571/1107] 10.222.0.84 () {60 vars in 1323 bytes} [Wed Aug 24 11:43:51 2022] POST /compute/v2.1/servers/29619526-3255-4729-81c6-53db060e7426/os-volume_attachments => generated 194 bytes in 18150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:44:09.635518 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-7fcc465c-caf5-4bee-aca2-0b7ab381ab8b tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:44:09.636244 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-7fcc465c-caf5-4bee-aca2-0b7ab381ab8b tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: bf04b523-cedf-4e68-b77f-f6039d0de59c] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:44:09.643334 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-7fcc465c-caf5-4bee-aca2-0b7ab381ab8b tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:09.643908 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-7fcc465c-caf5-4bee-aca2-0b7ab381ab8b tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:09.644357 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-7fcc465c-caf5-4bee-aca2-0b7ab381ab8b tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:09.645140 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-7fcc465c-caf5-4bee-aca2-0b7ab381ab8b tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:09.645628 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-7fcc465c-caf5-4bee-aca2-0b7ab381ab8b tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:09.646043 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-7fcc465c-caf5-4bee-aca2-0b7ab381ab8b tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:09.799387 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-7fcc465c-caf5-4bee-aca2-0b7ab381ab8b tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:44:09.809084 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-7fcc465c-caf5-4bee-aca2-0b7ab381ab8b tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:44:09.810593 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-7fcc465c-caf5-4bee-aca2-0b7ab381ab8b tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:44:09.811764 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-7fcc465c-caf5-4bee-aca2-0b7ab381ab8b tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c" status: 200 len: 1732 microversion: 2.20 time: 0.180387 Aug 24 11:44:09.812322 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 537/1108] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:44:09 2022] GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c => generated 1732 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 11:44:10.835433 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-bc7ee1e9-32fb-4fac-859c-272190345fa8 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:44:10.836127 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-bc7ee1e9-32fb-4fac-859c-272190345fa8 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: bf04b523-cedf-4e68-b77f-f6039d0de59c] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:44:10.843690 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-bc7ee1e9-32fb-4fac-859c-272190345fa8 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:10.850599 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-bc7ee1e9-32fb-4fac-859c-272190345fa8 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:10.850599 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-bc7ee1e9-32fb-4fac-859c-272190345fa8 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:10.850599 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-bc7ee1e9-32fb-4fac-859c-272190345fa8 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:10.850599 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-bc7ee1e9-32fb-4fac-859c-272190345fa8 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:10.851005 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-bc7ee1e9-32fb-4fac-859c-272190345fa8 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:10.993675 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-bc7ee1e9-32fb-4fac-859c-272190345fa8 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:44:11.000015 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-bc7ee1e9-32fb-4fac-859c-272190345fa8 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:44:11.001557 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-bc7ee1e9-32fb-4fac-859c-272190345fa8 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:44:11.002783 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-bc7ee1e9-32fb-4fac-859c-272190345fa8 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c" status: 200 len: 1732 microversion: 2.20 time: 0.171898 Aug 24 11:44:11.003387 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 572/1109] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:44:10 2022] GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c => generated 1732 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:44:12.027379 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-e196ed95-3bb2-42c3-9332-30fd3c626498 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:44:12.027907 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-e196ed95-3bb2-42c3-9332-30fd3c626498 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: bf04b523-cedf-4e68-b77f-f6039d0de59c] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:44:12.034429 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e196ed95-3bb2-42c3-9332-30fd3c626498 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:12.034911 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e196ed95-3bb2-42c3-9332-30fd3c626498 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:12.035345 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e196ed95-3bb2-42c3-9332-30fd3c626498 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:12.036024 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e196ed95-3bb2-42c3-9332-30fd3c626498 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:12.036572 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e196ed95-3bb2-42c3-9332-30fd3c626498 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:12.037030 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e196ed95-3bb2-42c3-9332-30fd3c626498 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:12.180259 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-e196ed95-3bb2-42c3-9332-30fd3c626498 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:44:12.189986 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-e196ed95-3bb2-42c3-9332-30fd3c626498 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:44:12.191488 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-e196ed95-3bb2-42c3-9332-30fd3c626498 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:44:12.192666 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-e196ed95-3bb2-42c3-9332-30fd3c626498 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c" status: 200 len: 1732 microversion: 2.20 time: 0.169286 Aug 24 11:44:12.193271 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 538/1110] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:44:12 2022] GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c => generated 1732 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:44:12.307736 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [req-37b6b497-8bc7-4141-98b5-f70de151f8b2 req-2591fedc-9f8a-40dc-b499-cf90b341c34e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf04b523-cedf-4e68-b77f-f6039d0de59c", "name": "network-vif-plugged", "status": "completed", "tag": "c30f1b51-2afd-425d-956e-dbabf88edac3"}]} {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:44:12.318211 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [req-37b6b497-8bc7-4141-98b5-f70de151f8b2 req-2591fedc-9f8a-40dc-b499-cf90b341c34e service nova] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:12.318696 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [req-37b6b497-8bc7-4141-98b5-f70de151f8b2 req-2591fedc-9f8a-40dc-b499-cf90b341c34e service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:12.319206 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [req-37b6b497-8bc7-4141-98b5-f70de151f8b2 req-2591fedc-9f8a-40dc-b499-cf90b341c34e service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:12.330779 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.compute.server_external_events [req-37b6b497-8bc7-4141-98b5-f70de151f8b2 req-2591fedc-9f8a-40dc-b499-cf90b341c34e service nova] Creating event network-vif-plugged:c30f1b51-2afd-425d-956e-dbabf88edac3 for instance bf04b523-cedf-4e68-b77f-f6039d0de59c on hv-cinder-85427 Aug 24 11:44:12.336008 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [req-37b6b497-8bc7-4141-98b5-f70de151f8b2 req-2591fedc-9f8a-40dc-b499-cf90b341c34e service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032041 Aug 24 11:44:12.336612 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 573/1111] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Aug 24 11:44:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:44:13.217971 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-b4260645-1f0c-4f0f-8ca5-4e18bceddd9f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:44:13.218610 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-b4260645-1f0c-4f0f-8ca5-4e18bceddd9f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: bf04b523-cedf-4e68-b77f-f6039d0de59c] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:44:13.225124 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b4260645-1f0c-4f0f-8ca5-4e18bceddd9f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:13.225606 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b4260645-1f0c-4f0f-8ca5-4e18bceddd9f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:13.226039 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b4260645-1f0c-4f0f-8ca5-4e18bceddd9f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:13.226727 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b4260645-1f0c-4f0f-8ca5-4e18bceddd9f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:13.227176 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b4260645-1f0c-4f0f-8ca5-4e18bceddd9f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:13.227593 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b4260645-1f0c-4f0f-8ca5-4e18bceddd9f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:13.363715 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-b4260645-1f0c-4f0f-8ca5-4e18bceddd9f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:44:13.372367 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-b4260645-1f0c-4f0f-8ca5-4e18bceddd9f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:44:13.373893 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-b4260645-1f0c-4f0f-8ca5-4e18bceddd9f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:44:13.375314 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-b4260645-1f0c-4f0f-8ca5-4e18bceddd9f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c" status: 200 len: 1732 microversion: 2.20 time: 0.162165 Aug 24 11:44:13.375870 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 539/1112] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:44:13 2022] GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c => generated 1732 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:44:14.399780 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-d695741e-f215-41be-8700-dd92a55827e1 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:44:14.400500 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-d695741e-f215-41be-8700-dd92a55827e1 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: bf04b523-cedf-4e68-b77f-f6039d0de59c] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:44:14.408208 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-d695741e-f215-41be-8700-dd92a55827e1 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:14.408690 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-d695741e-f215-41be-8700-dd92a55827e1 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:14.409156 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-d695741e-f215-41be-8700-dd92a55827e1 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:14.409947 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-d695741e-f215-41be-8700-dd92a55827e1 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:14.410405 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-d695741e-f215-41be-8700-dd92a55827e1 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:14.410826 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-d695741e-f215-41be-8700-dd92a55827e1 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:14.560711 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-d695741e-f215-41be-8700-dd92a55827e1 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:44:14.569265 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-d695741e-f215-41be-8700-dd92a55827e1 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:44:14.570771 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-d695741e-f215-41be-8700-dd92a55827e1 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:44:14.571975 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-d695741e-f215-41be-8700-dd92a55827e1 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c" status: 200 len: 1732 microversion: 2.20 time: 0.176518 Aug 24 11:44:14.577996 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 574/1113] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:44:14 2022] GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c => generated 1732 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:44:15.596046 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-397131fd-549e-4575-b194-da01b5981d54 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:44:15.596686 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-397131fd-549e-4575-b194-da01b5981d54 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: bf04b523-cedf-4e68-b77f-f6039d0de59c] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:44:15.603521 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-397131fd-549e-4575-b194-da01b5981d54 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:15.604016 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-397131fd-549e-4575-b194-da01b5981d54 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:15.605215 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-397131fd-549e-4575-b194-da01b5981d54 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:15.606046 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-397131fd-549e-4575-b194-da01b5981d54 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:15.606517 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-397131fd-549e-4575-b194-da01b5981d54 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:15.607018 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-397131fd-549e-4575-b194-da01b5981d54 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:15.785453 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-397131fd-549e-4575-b194-da01b5981d54 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:44:15.797744 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-397131fd-549e-4575-b194-da01b5981d54 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:44:15.799294 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-397131fd-549e-4575-b194-da01b5981d54 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:44:15.800502 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-397131fd-549e-4575-b194-da01b5981d54 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c" status: 200 len: 1732 microversion: 2.20 time: 0.208452 Aug 24 11:44:15.801183 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 540/1114] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:44:15 2022] GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c => generated 1732 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:44:16.825938 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-832e9a20-4c97-4bd1-a525-d245b21405e7 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:44:16.826603 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-832e9a20-4c97-4bd1-a525-d245b21405e7 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: bf04b523-cedf-4e68-b77f-f6039d0de59c] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:44:16.833117 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-832e9a20-4c97-4bd1-a525-d245b21405e7 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:16.833639 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-832e9a20-4c97-4bd1-a525-d245b21405e7 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:16.834074 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-832e9a20-4c97-4bd1-a525-d245b21405e7 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:16.834792 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-832e9a20-4c97-4bd1-a525-d245b21405e7 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:16.835246 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-832e9a20-4c97-4bd1-a525-d245b21405e7 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:16.835668 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-832e9a20-4c97-4bd1-a525-d245b21405e7 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:16.974234 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-832e9a20-4c97-4bd1-a525-d245b21405e7 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:44:16.986578 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-832e9a20-4c97-4bd1-a525-d245b21405e7 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:44:16.986578 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-832e9a20-4c97-4bd1-a525-d245b21405e7 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:44:16.986578 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-832e9a20-4c97-4bd1-a525-d245b21405e7 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c" status: 200 len: 1719 microversion: 2.20 time: 0.164041 Aug 24 11:44:16.987027 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 575/1115] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:44:16 2022] GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c => generated 1719 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:44:22.367617 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-88431bb2-df6d-4a74-a8a4-06c054cc3807 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:44:22.370714 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-88431bb2-df6d-4a74-a8a4-06c054cc3807 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] [instance: 29619526-3255-4729-81c6-53db060e7426] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:44:22.377830 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-88431bb2-df6d-4a74-a8a4-06c054cc3807 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:22.378344 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-88431bb2-df6d-4a74-a8a4-06c054cc3807 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:22.378791 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-88431bb2-df6d-4a74-a8a4-06c054cc3807 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:22.379492 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-88431bb2-df6d-4a74-a8a4-06c054cc3807 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:22.379956 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-88431bb2-df6d-4a74-a8a4-06c054cc3807 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:22.380388 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-88431bb2-df6d-4a74-a8a4-06c054cc3807 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:22.416517 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-88431bb2-df6d-4a74-a8a4-06c054cc3807 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] 10.222.0.84 "GET /compute/v2.1/servers/29619526-3255-4729-81c6-53db060e7426/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052612 Aug 24 11:44:22.417597 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 541/1116] 10.222.0.84 () {58 vars in 1302 bytes} [Wed Aug 24 11:44:22 2022] GET /compute/v2.1/servers/29619526-3255-4729-81c6-53db060e7426/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:44:22.428122 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-05d52443-cb6a-4c4d-9df5-993ae26c430f tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:44:22.428609 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-05d52443-cb6a-4c4d-9df5-993ae26c430f tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] [instance: 29619526-3255-4729-81c6-53db060e7426] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:44:22.436852 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-05d52443-cb6a-4c4d-9df5-993ae26c430f tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:22.437418 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-05d52443-cb6a-4c4d-9df5-993ae26c430f tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:22.437936 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-05d52443-cb6a-4c4d-9df5-993ae26c430f tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:22.438719 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-05d52443-cb6a-4c4d-9df5-993ae26c430f tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:22.439250 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-05d52443-cb6a-4c4d-9df5-993ae26c430f tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:22.439750 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-05d52443-cb6a-4c4d-9df5-993ae26c430f tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:22.472078 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-05d52443-cb6a-4c4d-9df5-993ae26c430f tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] 10.222.0.84 "GET /compute/v2.1/servers/29619526-3255-4729-81c6-53db060e7426/os-volume_attachments/1b6cf03f-8282-4125-bd90-93cd5d4b6102" status: 200 len: 194 microversion: 2.1 time: 0.047819 Aug 24 11:44:22.472683 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 576/1117] 10.222.0.84 () {58 vars in 1413 bytes} [Wed Aug 24 11:44:22 2022] GET /compute/v2.1/servers/29619526-3255-4729-81c6-53db060e7426/os-volume_attachments/1b6cf03f-8282-4125-bd90-93cd5d4b6102 => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:44:25.268059 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-e5ca1638-da54-450a-bfe4-af9740962225 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "436cdf4c-11e9-40a2-869c-a6f8aa17d96a"}} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:44:25.270605 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-e5ca1638-da54-450a-bfe4-af9740962225 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] [instance: 29619526-3255-4729-81c6-53db060e7426] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:44:25.276717 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e5ca1638-da54-450a-bfe4-af9740962225 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:25.277235 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e5ca1638-da54-450a-bfe4-af9740962225 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:25.278470 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e5ca1638-da54-450a-bfe4-af9740962225 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:25.279208 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e5ca1638-da54-450a-bfe4-af9740962225 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:25.279634 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e5ca1638-da54-450a-bfe4-af9740962225 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:25.280056 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e5ca1638-da54-450a-bfe4-af9740962225 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:26.362510 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-e5ca1638-da54-450a-bfe4-af9740962225 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] 10.222.0.84 "POST /compute/v2.1/servers/29619526-3255-4729-81c6-53db060e7426/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.098515 Aug 24 11:44:26.363294 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 542/1118] 10.222.0.84 () {60 vars in 1323 bytes} [Wed Aug 24 11:44:25 2022] POST /compute/v2.1/servers/29619526-3255-4729-81c6-53db060e7426/os-volume_attachments => generated 194 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:44:29.849401 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-94e8b314-db82-4ff7-9500-617ab0c98c24 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-82534480", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1852951757", "security_groups": [{"name": "tempest-secgroup-smoke-1129237839"}], "block_device_mapping_v2": [{"uuid": "5b67d656-0b7b-487b-b184-8e5edd63950c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "2124b453-c0e5-4e4a-8217-6cdc2b930758"}]}} {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:44:29.969044 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.network.neutron [None req-94e8b314-db82-4ff7-9500-617ab0c98c24 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] validate_networks() for [('2124b453-c0e5-4e4a-8217-6cdc2b930758', None, None, None, None, None)] {{(pid=124769) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 11:44:30.443073 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.virt.hardware [None req-94e8b314-db82-4ff7-9500-617ab0c98c24 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Flavor limits 0:0:0 {{(pid=124769) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 11:44:30.443486 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.virt.hardware [None req-94e8b314-db82-4ff7-9500-617ab0c98c24 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Image limits 0:0:0 {{(pid=124769) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 11:44:30.443955 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.virt.hardware [None req-94e8b314-db82-4ff7-9500-617ab0c98c24 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Flavor pref 0:0:0 {{(pid=124769) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 11:44:30.444356 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.virt.hardware [None req-94e8b314-db82-4ff7-9500-617ab0c98c24 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Image pref 0:0:0 {{(pid=124769) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 11:44:30.444758 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.virt.hardware [None req-94e8b314-db82-4ff7-9500-617ab0c98c24 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124769) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 11:44:30.454197 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-94e8b314-db82-4ff7-9500-617ab0c98c24 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:30.454676 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-94e8b314-db82-4ff7-9500-617ab0c98c24 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:30.455107 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-94e8b314-db82-4ff7-9500-617ab0c98c24 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:30.455820 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-94e8b314-db82-4ff7-9500-617ab0c98c24 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:30.456264 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-94e8b314-db82-4ff7-9500-617ab0c98c24 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:30.456682 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-94e8b314-db82-4ff7-9500-617ab0c98c24 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:30.474670 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.quota [None req-94e8b314-db82-4ff7-9500-617ab0c98c24 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Getting quotas for project c4ef3fc15a0147e39228729d2b5b2631. Resources: {'ram', 'cores', 'instances'} {{(pid=124769) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:44:30.481757 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.quota [None req-94e8b314-db82-4ff7-9500-617ab0c98c24 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Getting quotas for user 0b82b6f568bd41fa9d6b44facb766e0b and project c4ef3fc15a0147e39228729d2b5b2631. Resources: {'ram', 'cores', 'instances'} {{(pid=124769) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:44:30.544228 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-94e8b314-db82-4ff7-9500-617ab0c98c24 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Going to run 1 instances... {{(pid=124769) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 11:44:30.546507 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-94e8b314-db82-4ff7-9500-617ab0c98c24 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] [instance: 6f3cd4ee-8f91-4184-8488-a9b249a6b468] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5b67d656-0b7b-487b-b184-8e5edd63950c',volume_size=None,volume_type=None)] {{(pid=124769) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 11:44:31.001614 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-94e8b314-db82-4ff7-9500-617ab0c98c24 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] 10.222.0.84 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.156155 Aug 24 11:44:31.002290 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 577/1119] 10.222.0.84 () {60 vars in 1147 bytes} [Wed Aug 24 11:44:29 2022] POST /compute/v2.1/servers => generated 406 bytes in 1158 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 11:44:31.014667 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-2c0b0685-10f6-4e39-952a-9d83f12a7708 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:44:31.015372 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-2c0b0685-10f6-4e39-952a-9d83f12a7708 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] [instance: 6f3cd4ee-8f91-4184-8488-a9b249a6b468] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:44:31.072765 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-2c0b0685-10f6-4e39-952a-9d83f12a7708 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b82b6f568bd41fa9d6b44facb766e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ef3fc15a0147e39228729d2b5b2631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:44:31.081556 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-2c0b0685-10f6-4e39-952a-9d83f12a7708 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] 10.222.0.84 "GET /compute/v2.1/servers/6f3cd4ee-8f91-4184-8488-a9b249a6b468" status: 200 len: 1093 microversion: 2.1 time: 0.071975 Aug 24 11:44:31.082136 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 543/1120] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:44:31 2022] GET /compute/v2.1/servers/6f3cd4ee-8f91-4184-8488-a9b249a6b468 => generated 1093 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:44:32.102844 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-6e0ed324-12ee-44b3-872a-ad214fa879ef tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:44:32.103637 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-6e0ed324-12ee-44b3-872a-ad214fa879ef tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] [instance: 6f3cd4ee-8f91-4184-8488-a9b249a6b468] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:44:32.105828 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG dbcounter [-] [124769] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=3 {{(pid=124769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:44:32.110960 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-6e0ed324-12ee-44b3-872a-ad214fa879ef tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:32.111456 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-6e0ed324-12ee-44b3-872a-ad214fa879ef tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:32.111891 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-6e0ed324-12ee-44b3-872a-ad214fa879ef tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:32.112617 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-6e0ed324-12ee-44b3-872a-ad214fa879ef tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:32.113100 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-6e0ed324-12ee-44b3-872a-ad214fa879ef tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:32.113597 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-6e0ed324-12ee-44b3-872a-ad214fa879ef tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:32.118588 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG dbcounter [-] [124769] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:44:32.176982 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-6e0ed324-12ee-44b3-872a-ad214fa879ef tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b82b6f568bd41fa9d6b44facb766e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ef3fc15a0147e39228729d2b5b2631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:44:32.184960 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-6e0ed324-12ee-44b3-872a-ad214fa879ef tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] 10.222.0.84 "GET /compute/v2.1/servers/6f3cd4ee-8f91-4184-8488-a9b249a6b468" status: 200 len: 1143 microversion: 2.1 time: 0.085960 Aug 24 11:44:32.185673 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 578/1121] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:44:32 2022] GET /compute/v2.1/servers/6f3cd4ee-8f91-4184-8488-a9b249a6b468 => generated 1143 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:44:33.208214 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-7edde262-6be6-4fe6-b7e1-ecc5617e14dc tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:44:33.209007 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-7edde262-6be6-4fe6-b7e1-ecc5617e14dc tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] [instance: 6f3cd4ee-8f91-4184-8488-a9b249a6b468] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:44:33.218114 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-7edde262-6be6-4fe6-b7e1-ecc5617e14dc tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:33.218815 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-7edde262-6be6-4fe6-b7e1-ecc5617e14dc tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:33.219273 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-7edde262-6be6-4fe6-b7e1-ecc5617e14dc tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:33.219985 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-7edde262-6be6-4fe6-b7e1-ecc5617e14dc tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:33.220524 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-7edde262-6be6-4fe6-b7e1-ecc5617e14dc tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:33.221009 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-7edde262-6be6-4fe6-b7e1-ecc5617e14dc tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:33.312132 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-7edde262-6be6-4fe6-b7e1-ecc5617e14dc tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b82b6f568bd41fa9d6b44facb766e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ef3fc15a0147e39228729d2b5b2631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:44:33.320206 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-7edde262-6be6-4fe6-b7e1-ecc5617e14dc tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] 10.222.0.84 "GET /compute/v2.1/servers/6f3cd4ee-8f91-4184-8488-a9b249a6b468" status: 200 len: 1199 microversion: 2.1 time: 0.117196 Aug 24 11:44:33.320788 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 544/1122] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:44:33 2022] GET /compute/v2.1/servers/6f3cd4ee-8f91-4184-8488-a9b249a6b468 => generated 1199 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:44:34.344625 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-38c3876a-b0d8-4fde-aaee-4db6015f8e07 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:44:34.345299 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-38c3876a-b0d8-4fde-aaee-4db6015f8e07 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] [instance: 6f3cd4ee-8f91-4184-8488-a9b249a6b468] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:44:34.354890 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-38c3876a-b0d8-4fde-aaee-4db6015f8e07 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:34.354890 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-38c3876a-b0d8-4fde-aaee-4db6015f8e07 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:34.355335 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-38c3876a-b0d8-4fde-aaee-4db6015f8e07 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:34.356133 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-38c3876a-b0d8-4fde-aaee-4db6015f8e07 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:34.357980 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-38c3876a-b0d8-4fde-aaee-4db6015f8e07 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:34.358436 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-38c3876a-b0d8-4fde-aaee-4db6015f8e07 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:34.507074 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-38c3876a-b0d8-4fde-aaee-4db6015f8e07 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b82b6f568bd41fa9d6b44facb766e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ef3fc15a0147e39228729d2b5b2631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:44:34.523329 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-38c3876a-b0d8-4fde-aaee-4db6015f8e07 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] 10.222.0.84 "GET /compute/v2.1/servers/6f3cd4ee-8f91-4184-8488-a9b249a6b468" status: 200 len: 1277 microversion: 2.1 time: 0.184089 Aug 24 11:44:34.525015 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 579/1123] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:44:34 2022] GET /compute/v2.1/servers/6f3cd4ee-8f91-4184-8488-a9b249a6b468 => generated 1277 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:44:35.083696 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [req-4425d905-0243-47b4-813b-84f727a1fb79 req-1c0454f5-478e-4a45-a854-c2095eb7a511 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f3cd4ee-8f91-4184-8488-a9b249a6b468", "tag": "1be776cf-2b6b-4565-97c5-cf42d0be6f9c"}]} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:44:35.089300 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_api:SELECT=28 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:44:35.095046 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-4425d905-0243-47b4-813b-84f727a1fb79 req-1c0454f5-478e-4a45-a854-c2095eb7a511 service nova] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:35.095531 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-4425d905-0243-47b4-813b-84f727a1fb79 req-1c0454f5-478e-4a45-a854-c2095eb7a511 service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:35.095968 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-4425d905-0243-47b4-813b-84f727a1fb79 req-1c0454f5-478e-4a45-a854-c2095eb7a511 service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:35.111538 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.compute.server_external_events [req-4425d905-0243-47b4-813b-84f727a1fb79 req-1c0454f5-478e-4a45-a854-c2095eb7a511 service nova] Creating event network-changed:1be776cf-2b6b-4565-97c5-cf42d0be6f9c for instance 6f3cd4ee-8f91-4184-8488-a9b249a6b468 on hv-cinder-85427 Aug 24 11:44:35.116980 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [req-4425d905-0243-47b4-813b-84f727a1fb79 req-1c0454f5-478e-4a45-a854-c2095eb7a511 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037955 Aug 24 11:44:35.117746 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 545/1124] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Aug 24 11:44:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:44:35.545968 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-55bfa09b-0d1e-430a-8a63-cee3ba6a43a7 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:44:35.546702 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-55bfa09b-0d1e-430a-8a63-cee3ba6a43a7 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] [instance: 6f3cd4ee-8f91-4184-8488-a9b249a6b468] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:44:35.553327 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-55bfa09b-0d1e-430a-8a63-cee3ba6a43a7 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:35.553801 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-55bfa09b-0d1e-430a-8a63-cee3ba6a43a7 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:35.554233 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-55bfa09b-0d1e-430a-8a63-cee3ba6a43a7 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:35.554910 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-55bfa09b-0d1e-430a-8a63-cee3ba6a43a7 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:35.555356 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-55bfa09b-0d1e-430a-8a63-cee3ba6a43a7 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:35.555775 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-55bfa09b-0d1e-430a-8a63-cee3ba6a43a7 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:35.728768 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-55bfa09b-0d1e-430a-8a63-cee3ba6a43a7 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b82b6f568bd41fa9d6b44facb766e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ef3fc15a0147e39228729d2b5b2631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:44:35.738668 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-55bfa09b-0d1e-430a-8a63-cee3ba6a43a7 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] 10.222.0.84 "GET /compute/v2.1/servers/6f3cd4ee-8f91-4184-8488-a9b249a6b468" status: 200 len: 1277 microversion: 2.1 time: 0.197668 Aug 24 11:44:35.739459 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 580/1125] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:44:35 2022] GET /compute/v2.1/servers/6f3cd4ee-8f91-4184-8488-a9b249a6b468 => generated 1277 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:44:36.762558 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-c238fb26-5ec1-4f1d-91be-a6af75fbde74 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:44:36.764010 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-c238fb26-5ec1-4f1d-91be-a6af75fbde74 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] [instance: 6f3cd4ee-8f91-4184-8488-a9b249a6b468] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:44:36.770931 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c238fb26-5ec1-4f1d-91be-a6af75fbde74 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:36.771511 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c238fb26-5ec1-4f1d-91be-a6af75fbde74 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:36.771852 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c238fb26-5ec1-4f1d-91be-a6af75fbde74 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:36.772591 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c238fb26-5ec1-4f1d-91be-a6af75fbde74 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:36.773180 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c238fb26-5ec1-4f1d-91be-a6af75fbde74 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:36.773606 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c238fb26-5ec1-4f1d-91be-a6af75fbde74 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:37.011293 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-c238fb26-5ec1-4f1d-91be-a6af75fbde74 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b82b6f568bd41fa9d6b44facb766e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ef3fc15a0147e39228729d2b5b2631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:44:37.022347 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-c238fb26-5ec1-4f1d-91be-a6af75fbde74 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] 10.222.0.84 "GET /compute/v2.1/servers/6f3cd4ee-8f91-4184-8488-a9b249a6b468" status: 200 len: 1277 microversion: 2.1 time: 0.265054 Aug 24 11:44:37.036756 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 546/1126] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:44:36 2022] GET /compute/v2.1/servers/6f3cd4ee-8f91-4184-8488-a9b249a6b468 => generated 1277 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:44:38.043598 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-2275204c-eed7-4269-8084-26ed0d18b9fc tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:44:38.044162 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-2275204c-eed7-4269-8084-26ed0d18b9fc tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] [instance: 6f3cd4ee-8f91-4184-8488-a9b249a6b468] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:44:38.050616 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-2275204c-eed7-4269-8084-26ed0d18b9fc tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:38.051149 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-2275204c-eed7-4269-8084-26ed0d18b9fc tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:38.051581 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-2275204c-eed7-4269-8084-26ed0d18b9fc tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:38.052271 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-2275204c-eed7-4269-8084-26ed0d18b9fc tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:38.052721 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-2275204c-eed7-4269-8084-26ed0d18b9fc tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:38.053164 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-2275204c-eed7-4269-8084-26ed0d18b9fc tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:38.193476 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-2275204c-eed7-4269-8084-26ed0d18b9fc tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b82b6f568bd41fa9d6b44facb766e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ef3fc15a0147e39228729d2b5b2631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:44:38.202917 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-2275204c-eed7-4269-8084-26ed0d18b9fc tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] 10.222.0.84 "GET /compute/v2.1/servers/6f3cd4ee-8f91-4184-8488-a9b249a6b468" status: 200 len: 1277 microversion: 2.1 time: 0.162805 Aug 24 11:44:38.203499 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 581/1127] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:44:38 2022] GET /compute/v2.1/servers/6f3cd4ee-8f91-4184-8488-a9b249a6b468 => generated 1277 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:44:38.221847 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-074a6fc8-c0bf-48eb-ae11-ad206ac61e1e tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:44:38.224249 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-074a6fc8-c0bf-48eb-ae11-ad206ac61e1e tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] [instance: 29619526-3255-4729-81c6-53db060e7426] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:44:38.231110 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-074a6fc8-c0bf-48eb-ae11-ad206ac61e1e tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:38.231728 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-074a6fc8-c0bf-48eb-ae11-ad206ac61e1e tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:38.232362 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-074a6fc8-c0bf-48eb-ae11-ad206ac61e1e tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:38.233084 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-074a6fc8-c0bf-48eb-ae11-ad206ac61e1e tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:38.233560 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-074a6fc8-c0bf-48eb-ae11-ad206ac61e1e tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:38.233977 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-074a6fc8-c0bf-48eb-ae11-ad206ac61e1e tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:38.266358 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-074a6fc8-c0bf-48eb-ae11-ad206ac61e1e tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] 10.222.0.84 "GET /compute/v2.1/servers/29619526-3255-4729-81c6-53db060e7426/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048443 Aug 24 11:44:38.266930 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 547/1128] 10.222.0.84 () {58 vars in 1302 bytes} [Wed Aug 24 11:44:38 2022] GET /compute/v2.1/servers/29619526-3255-4729-81c6-53db060e7426/os-volume_attachments => generated 371 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:44:38.407454 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-85369baf-8c40-4fd3-b082-99942c622460 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:44:38.407859 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-85369baf-8c40-4fd3-b082-99942c622460 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] [instance: 29619526-3255-4729-81c6-53db060e7426] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:44:38.414329 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-85369baf-8c40-4fd3-b082-99942c622460 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:38.414820 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-85369baf-8c40-4fd3-b082-99942c622460 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:38.415270 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-85369baf-8c40-4fd3-b082-99942c622460 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:38.415982 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-85369baf-8c40-4fd3-b082-99942c622460 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:38.416441 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-85369baf-8c40-4fd3-b082-99942c622460 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:38.416922 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-85369baf-8c40-4fd3-b082-99942c622460 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:38.449011 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-85369baf-8c40-4fd3-b082-99942c622460 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] 10.222.0.84 "GET /compute/v2.1/servers/29619526-3255-4729-81c6-53db060e7426/os-volume_attachments/1b6cf03f-8282-4125-bd90-93cd5d4b6102" status: 200 len: 194 microversion: 2.1 time: 0.046902 Aug 24 11:44:38.449614 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 582/1129] 10.222.0.84 () {58 vars in 1413 bytes} [Wed Aug 24 11:44:38 2022] GET /compute/v2.1/servers/29619526-3255-4729-81c6-53db060e7426/os-volume_attachments/1b6cf03f-8282-4125-bd90-93cd5d4b6102 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:44:38.460473 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-bb044338-0dfe-49ef-aac5-8c7ed3fd9e46 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:44:38.461010 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-bb044338-0dfe-49ef-aac5-8c7ed3fd9e46 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] [instance: 29619526-3255-4729-81c6-53db060e7426] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:44:38.467723 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-bb044338-0dfe-49ef-aac5-8c7ed3fd9e46 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:38.468215 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-bb044338-0dfe-49ef-aac5-8c7ed3fd9e46 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:38.468714 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-bb044338-0dfe-49ef-aac5-8c7ed3fd9e46 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:38.469633 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-bb044338-0dfe-49ef-aac5-8c7ed3fd9e46 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:38.470091 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-bb044338-0dfe-49ef-aac5-8c7ed3fd9e46 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:38.470520 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-bb044338-0dfe-49ef-aac5-8c7ed3fd9e46 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:38.560939 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:44:38.572062 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.objects.instance [None req-bb044338-0dfe-49ef-aac5-8c7ed3fd9e46 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lazy-loading 'services' on Instance uuid 29619526-3255-4729-81c6-53db060e7426 {{(pid=124770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:44:38.912345 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-bb044338-0dfe-49ef-aac5-8c7ed3fd9e46 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] 10.222.0.84 "DELETE /compute/v2.1/servers/29619526-3255-4729-81c6-53db060e7426/os-volume_attachments/1b6cf03f-8282-4125-bd90-93cd5d4b6102" status: 202 len: 0 microversion: 2.1 time: 0.455676 Aug 24 11:44:38.913124 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 548/1130] 10.222.0.84 () {58 vars in 1416 bytes} [Wed Aug 24 11:44:38 2022] DELETE /compute/v2.1/servers/29619526-3255-4729-81c6-53db060e7426/os-volume_attachments/1b6cf03f-8282-4125-bd90-93cd5d4b6102 => generated 0 bytes in 457 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:44:39.224514 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-30ba6c1f-cdb0-484d-aa93-67fdac954f4d tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:44:39.225170 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-30ba6c1f-cdb0-484d-aa93-67fdac954f4d tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] [instance: 6f3cd4ee-8f91-4184-8488-a9b249a6b468] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:44:39.231723 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-30ba6c1f-cdb0-484d-aa93-67fdac954f4d tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:39.232222 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-30ba6c1f-cdb0-484d-aa93-67fdac954f4d tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:39.232655 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-30ba6c1f-cdb0-484d-aa93-67fdac954f4d tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:39.233383 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-30ba6c1f-cdb0-484d-aa93-67fdac954f4d tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:39.233847 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-30ba6c1f-cdb0-484d-aa93-67fdac954f4d tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:39.234274 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-30ba6c1f-cdb0-484d-aa93-67fdac954f4d tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:39.373128 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-30ba6c1f-cdb0-484d-aa93-67fdac954f4d tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b82b6f568bd41fa9d6b44facb766e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ef3fc15a0147e39228729d2b5b2631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:44:39.381296 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-30ba6c1f-cdb0-484d-aa93-67fdac954f4d tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] 10.222.0.84 "GET /compute/v2.1/servers/6f3cd4ee-8f91-4184-8488-a9b249a6b468" status: 200 len: 1265 microversion: 2.1 time: 0.160479 Aug 24 11:44:39.381862 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 583/1131] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:44:39 2022] GET /compute/v2.1/servers/6f3cd4ee-8f91-4184-8488-a9b249a6b468 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:44:40.405518 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-a7f201ff-13dc-40e7-a6d4-093463c109d7 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:44:40.406623 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-a7f201ff-13dc-40e7-a6d4-093463c109d7 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] [instance: 6f3cd4ee-8f91-4184-8488-a9b249a6b468] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:44:40.413476 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a7f201ff-13dc-40e7-a6d4-093463c109d7 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:40.413960 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a7f201ff-13dc-40e7-a6d4-093463c109d7 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:40.414403 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a7f201ff-13dc-40e7-a6d4-093463c109d7 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:40.415104 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a7f201ff-13dc-40e7-a6d4-093463c109d7 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:40.415559 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a7f201ff-13dc-40e7-a6d4-093463c109d7 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:40.415983 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a7f201ff-13dc-40e7-a6d4-093463c109d7 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:40.567222 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-a7f201ff-13dc-40e7-a6d4-093463c109d7 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b82b6f568bd41fa9d6b44facb766e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ef3fc15a0147e39228729d2b5b2631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:44:40.574821 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-a7f201ff-13dc-40e7-a6d4-093463c109d7 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] 10.222.0.84 "GET /compute/v2.1/servers/6f3cd4ee-8f91-4184-8488-a9b249a6b468" status: 200 len: 1265 microversion: 2.1 time: 0.175516 Aug 24 11:44:40.575430 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 549/1132] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:44:40 2022] GET /compute/v2.1/servers/6f3cd4ee-8f91-4184-8488-a9b249a6b468 => generated 1265 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:44:41.597567 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-6cc754c9-03ec-4371-b8b9-aada1027ee58 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:44:41.598183 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-6cc754c9-03ec-4371-b8b9-aada1027ee58 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] [instance: 6f3cd4ee-8f91-4184-8488-a9b249a6b468] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:44:41.600503 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG dbcounter [-] [124769] Writing DB stats nova_cell0:SELECT=2 {{(pid=124769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:44:41.601208 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG dbcounter [-] [124769] Writing DB stats nova_cell0:SELECT=6 {{(pid=124769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:44:41.605980 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-6cc754c9-03ec-4371-b8b9-aada1027ee58 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:41.606471 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-6cc754c9-03ec-4371-b8b9-aada1027ee58 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:41.606917 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-6cc754c9-03ec-4371-b8b9-aada1027ee58 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:41.607614 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-6cc754c9-03ec-4371-b8b9-aada1027ee58 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:41.608070 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-6cc754c9-03ec-4371-b8b9-aada1027ee58 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:41.608493 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-6cc754c9-03ec-4371-b8b9-aada1027ee58 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:41.758624 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-6cc754c9-03ec-4371-b8b9-aada1027ee58 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b82b6f568bd41fa9d6b44facb766e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ef3fc15a0147e39228729d2b5b2631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:44:41.767667 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-6cc754c9-03ec-4371-b8b9-aada1027ee58 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] 10.222.0.84 "GET /compute/v2.1/servers/6f3cd4ee-8f91-4184-8488-a9b249a6b468" status: 200 len: 1265 microversion: 2.1 time: 0.174577 Aug 24 11:44:41.768248 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 584/1133] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:44:41 2022] GET /compute/v2.1/servers/6f3cd4ee-8f91-4184-8488-a9b249a6b468 => generated 1265 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:44:42.155855 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-a02eb4d4-5050-4593-a91a-4ee38dc6dd35 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:44:42.156417 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-a02eb4d4-5050-4593-a91a-4ee38dc6dd35 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] [instance: 29619526-3255-4729-81c6-53db060e7426] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:44:42.158300 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_cell0:SELECT=2 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:44:42.163615 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a02eb4d4-5050-4593-a91a-4ee38dc6dd35 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:42.164102 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a02eb4d4-5050-4593-a91a-4ee38dc6dd35 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:42.164540 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a02eb4d4-5050-4593-a91a-4ee38dc6dd35 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:42.165270 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a02eb4d4-5050-4593-a91a-4ee38dc6dd35 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:42.165720 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a02eb4d4-5050-4593-a91a-4ee38dc6dd35 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:42.166145 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a02eb4d4-5050-4593-a91a-4ee38dc6dd35 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:42.196253 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-a02eb4d4-5050-4593-a91a-4ee38dc6dd35 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] 10.222.0.84 "GET /compute/v2.1/servers/29619526-3255-4729-81c6-53db060e7426/os-volume_attachments/436cdf4c-11e9-40a2-869c-a6f8aa17d96a" status: 200 len: 194 microversion: 2.1 time: 0.044740 Aug 24 11:44:42.196857 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 550/1134] 10.222.0.84 () {58 vars in 1413 bytes} [Wed Aug 24 11:44:42 2022] GET /compute/v2.1/servers/29619526-3255-4729-81c6-53db060e7426/os-volume_attachments/436cdf4c-11e9-40a2-869c-a6f8aa17d96a => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:44:42.207623 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-4a550e05-aa76-444c-b962-8e72b4ffc74b tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:44:42.208201 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-4a550e05-aa76-444c-b962-8e72b4ffc74b tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] [instance: 29619526-3255-4729-81c6-53db060e7426] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:44:42.214429 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-4a550e05-aa76-444c-b962-8e72b4ffc74b tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:42.214919 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-4a550e05-aa76-444c-b962-8e72b4ffc74b tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:42.215361 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-4a550e05-aa76-444c-b962-8e72b4ffc74b tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:42.216075 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-4a550e05-aa76-444c-b962-8e72b4ffc74b tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:42.216533 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-4a550e05-aa76-444c-b962-8e72b4ffc74b tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:42.217024 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-4a550e05-aa76-444c-b962-8e72b4ffc74b tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:42.298968 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.objects.instance [None req-4a550e05-aa76-444c-b962-8e72b4ffc74b tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lazy-loading 'services' on Instance uuid 29619526-3255-4729-81c6-53db060e7426 {{(pid=124769) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:44:42.556916 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-4a550e05-aa76-444c-b962-8e72b4ffc74b tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] 10.222.0.84 "DELETE /compute/v2.1/servers/29619526-3255-4729-81c6-53db060e7426/os-volume_attachments/436cdf4c-11e9-40a2-869c-a6f8aa17d96a" status: 202 len: 0 microversion: 2.1 time: 0.353166 Aug 24 11:44:42.557569 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 585/1135] 10.222.0.84 () {58 vars in 1416 bytes} [Wed Aug 24 11:44:42 2022] DELETE /compute/v2.1/servers/29619526-3255-4729-81c6-53db060e7426/os-volume_attachments/436cdf4c-11e9-40a2-869c-a6f8aa17d96a => generated 0 bytes in 355 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:44:42.790606 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-112560bd-61c5-4252-9c7a-26a739d01f2e tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:44:42.791214 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-112560bd-61c5-4252-9c7a-26a739d01f2e tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] [instance: 6f3cd4ee-8f91-4184-8488-a9b249a6b468] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:44:42.797920 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-112560bd-61c5-4252-9c7a-26a739d01f2e tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:42.798408 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-112560bd-61c5-4252-9c7a-26a739d01f2e tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:42.798845 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-112560bd-61c5-4252-9c7a-26a739d01f2e tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:42.799544 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-112560bd-61c5-4252-9c7a-26a739d01f2e tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:42.799998 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-112560bd-61c5-4252-9c7a-26a739d01f2e tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:42.800418 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-112560bd-61c5-4252-9c7a-26a739d01f2e tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:42.944327 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-112560bd-61c5-4252-9c7a-26a739d01f2e tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b82b6f568bd41fa9d6b44facb766e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ef3fc15a0147e39228729d2b5b2631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:44:42.952901 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-112560bd-61c5-4252-9c7a-26a739d01f2e tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] 10.222.0.84 "GET /compute/v2.1/servers/6f3cd4ee-8f91-4184-8488-a9b249a6b468" status: 200 len: 1265 microversion: 2.1 time: 0.167371 Aug 24 11:44:42.953764 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 551/1136] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:44:42 2022] GET /compute/v2.1/servers/6f3cd4ee-8f91-4184-8488-a9b249a6b468 => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:44:43.983151 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-c4a2fc58-7fd4-49fa-88c9-4dabd0f2ebd2 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:44:43.984541 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-c4a2fc58-7fd4-49fa-88c9-4dabd0f2ebd2 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] [instance: 6f3cd4ee-8f91-4184-8488-a9b249a6b468] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:44:43.994331 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-c4a2fc58-7fd4-49fa-88c9-4dabd0f2ebd2 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:43.995074 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-c4a2fc58-7fd4-49fa-88c9-4dabd0f2ebd2 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:43.995544 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-c4a2fc58-7fd4-49fa-88c9-4dabd0f2ebd2 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:43.996424 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-c4a2fc58-7fd4-49fa-88c9-4dabd0f2ebd2 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:43.996923 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-c4a2fc58-7fd4-49fa-88c9-4dabd0f2ebd2 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:43.997388 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-c4a2fc58-7fd4-49fa-88c9-4dabd0f2ebd2 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:44.142151 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-c4a2fc58-7fd4-49fa-88c9-4dabd0f2ebd2 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b82b6f568bd41fa9d6b44facb766e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ef3fc15a0147e39228729d2b5b2631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:44:44.150375 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-c4a2fc58-7fd4-49fa-88c9-4dabd0f2ebd2 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] 10.222.0.84 "GET /compute/v2.1/servers/6f3cd4ee-8f91-4184-8488-a9b249a6b468" status: 200 len: 1265 microversion: 2.1 time: 0.175520 Aug 24 11:44:44.151185 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 586/1137] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:44:43 2022] GET /compute/v2.1/servers/6f3cd4ee-8f91-4184-8488-a9b249a6b468 => generated 1265 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:44:44.798524 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-4782b44a-ad93-4535-bb0d-37574ef11c2c tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:44:44.800702 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-4782b44a-ad93-4535-bb0d-37574ef11c2c tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] [instance: 29619526-3255-4729-81c6-53db060e7426] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:44:44.806676 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4782b44a-ad93-4535-bb0d-37574ef11c2c tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:44.807168 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4782b44a-ad93-4535-bb0d-37574ef11c2c tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:44.807594 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4782b44a-ad93-4535-bb0d-37574ef11c2c tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:44.808283 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4782b44a-ad93-4535-bb0d-37574ef11c2c tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:44.808741 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4782b44a-ad93-4535-bb0d-37574ef11c2c tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:44.809221 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4782b44a-ad93-4535-bb0d-37574ef11c2c tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:44.837526 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-4782b44a-ad93-4535-bb0d-37574ef11c2c tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] 10.222.0.84 "GET /compute/v2.1/servers/29619526-3255-4729-81c6-53db060e7426/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044294 Aug 24 11:44:44.838070 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 552/1138] 10.222.0.84 () {58 vars in 1302 bytes} [Wed Aug 24 11:44:44 2022] GET /compute/v2.1/servers/29619526-3255-4729-81c6-53db060e7426/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 11:44:44.951473 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-42bfb79e-f265-4540-911a-a4a89d6a16c3 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:44:44.954327 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-42bfb79e-f265-4540-911a-a4a89d6a16c3 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] [instance: 29619526-3255-4729-81c6-53db060e7426] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:44:44.960565 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-42bfb79e-f265-4540-911a-a4a89d6a16c3 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:44.961091 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-42bfb79e-f265-4540-911a-a4a89d6a16c3 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:44.961537 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-42bfb79e-f265-4540-911a-a4a89d6a16c3 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:44.962249 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-42bfb79e-f265-4540-911a-a4a89d6a16c3 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:44.962705 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-42bfb79e-f265-4540-911a-a4a89d6a16c3 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:44.963135 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-42bfb79e-f265-4540-911a-a4a89d6a16c3 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:44.994563 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-42bfb79e-f265-4540-911a-a4a89d6a16c3 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] 10.222.0.84 "GET /compute/v2.1/servers/29619526-3255-4729-81c6-53db060e7426/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047055 Aug 24 11:44:44.995457 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 587/1139] 10.222.0.84 () {58 vars in 1302 bytes} [Wed Aug 24 11:44:44 2022] GET /compute/v2.1/servers/29619526-3255-4729-81c6-53db060e7426/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 11:44:45.062336 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-d1fbbf76-4960-483b-a601-6d3f8f3a7b19 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:44:45.062834 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-d1fbbf76-4960-483b-a601-6d3f8f3a7b19 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] [instance: 29619526-3255-4729-81c6-53db060e7426] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:44:45.069327 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d1fbbf76-4960-483b-a601-6d3f8f3a7b19 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:45.069486 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d1fbbf76-4960-483b-a601-6d3f8f3a7b19 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:45.069861 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d1fbbf76-4960-483b-a601-6d3f8f3a7b19 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:45.076287 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d1fbbf76-4960-483b-a601-6d3f8f3a7b19 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:45.076287 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d1fbbf76-4960-483b-a601-6d3f8f3a7b19 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:45.076287 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d1fbbf76-4960-483b-a601-6d3f8f3a7b19 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:45.111793 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-d1fbbf76-4960-483b-a601-6d3f8f3a7b19 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] [instance: 29619526-3255-4729-81c6-53db060e7426] Going to try to terminate instance {{(pid=124770) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 11:44:45.173064 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-39c7481f-a236-47e6-b9b3-33d8a72c962f tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:44:45.173064 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-39c7481f-a236-47e6-b9b3-33d8a72c962f tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] [instance: 6f3cd4ee-8f91-4184-8488-a9b249a6b468] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:44:45.179009 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-39c7481f-a236-47e6-b9b3-33d8a72c962f tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:45.179483 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-39c7481f-a236-47e6-b9b3-33d8a72c962f tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:45.179986 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-39c7481f-a236-47e6-b9b3-33d8a72c962f tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:45.180709 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-39c7481f-a236-47e6-b9b3-33d8a72c962f tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:45.181196 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-39c7481f-a236-47e6-b9b3-33d8a72c962f tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:45.181652 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-39c7481f-a236-47e6-b9b3-33d8a72c962f tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:45.323774 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-39c7481f-a236-47e6-b9b3-33d8a72c962f tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b82b6f568bd41fa9d6b44facb766e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ef3fc15a0147e39228729d2b5b2631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:44:45.332343 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-39c7481f-a236-47e6-b9b3-33d8a72c962f tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] 10.222.0.84 "GET /compute/v2.1/servers/6f3cd4ee-8f91-4184-8488-a9b249a6b468" status: 200 len: 1265 microversion: 2.1 time: 0.164600 Aug 24 11:44:45.332950 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 588/1140] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:44:45 2022] GET /compute/v2.1/servers/6f3cd4ee-8f91-4184-8488-a9b249a6b468 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:44:45.530681 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-d1fbbf76-4960-483b-a601-6d3f8f3a7b19 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] 10.222.0.84 "DELETE /compute/v2.1/servers/29619526-3255-4729-81c6-53db060e7426" status: 204 len: 0 microversion: 2.1 time: 0.471384 Aug 24 11:44:45.531300 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 553/1141] 10.222.0.84 () {58 vars in 1239 bytes} [Wed Aug 24 11:44:45 2022] DELETE /compute/v2.1/servers/29619526-3255-4729-81c6-53db060e7426 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 11:44:45.540182 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-6e0a3c33-f5ef-408b-b62c-0c35c03842bd tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:44:45.540790 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-6e0a3c33-f5ef-408b-b62c-0c35c03842bd tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] [instance: 29619526-3255-4729-81c6-53db060e7426] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:44:45.547599 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-6e0a3c33-f5ef-408b-b62c-0c35c03842bd tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:45.548083 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-6e0a3c33-f5ef-408b-b62c-0c35c03842bd tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:45.548515 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-6e0a3c33-f5ef-408b-b62c-0c35c03842bd tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:45.549232 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-6e0a3c33-f5ef-408b-b62c-0c35c03842bd tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:45.549677 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-6e0a3c33-f5ef-408b-b62c-0c35c03842bd tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:45.550238 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-6e0a3c33-f5ef-408b-b62c-0c35c03842bd tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:45.696381 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-6e0a3c33-f5ef-408b-b62c-0c35c03842bd tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031939e16194f63b99e6f27f700fa8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecec6d0c155f4d658197c4779ab9ffce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:44:45.704320 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-6e0a3c33-f5ef-408b-b62c-0c35c03842bd tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] 10.222.0.84 "GET /compute/v2.1/servers/29619526-3255-4729-81c6-53db060e7426" status: 200 len: 1673 microversion: 2.1 time: 0.167958 Aug 24 11:44:45.704898 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 589/1142] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:44:45 2022] GET /compute/v2.1/servers/29619526-3255-4729-81c6-53db060e7426 => generated 1673 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:44:46.355882 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-894268e6-1817-4626-bdf4-2ab559eea172 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:44:46.356586 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-894268e6-1817-4626-bdf4-2ab559eea172 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] [instance: 6f3cd4ee-8f91-4184-8488-a9b249a6b468] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:44:46.364183 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-894268e6-1817-4626-bdf4-2ab559eea172 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:46.364675 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-894268e6-1817-4626-bdf4-2ab559eea172 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:46.365146 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-894268e6-1817-4626-bdf4-2ab559eea172 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:46.365838 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-894268e6-1817-4626-bdf4-2ab559eea172 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:46.366294 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-894268e6-1817-4626-bdf4-2ab559eea172 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:46.366720 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-894268e6-1817-4626-bdf4-2ab559eea172 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:46.509366 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-894268e6-1817-4626-bdf4-2ab559eea172 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b82b6f568bd41fa9d6b44facb766e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ef3fc15a0147e39228729d2b5b2631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:44:46.517673 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-894268e6-1817-4626-bdf4-2ab559eea172 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] 10.222.0.84 "GET /compute/v2.1/servers/6f3cd4ee-8f91-4184-8488-a9b249a6b468" status: 200 len: 1265 microversion: 2.1 time: 0.165929 Aug 24 11:44:46.518257 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 554/1143] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:44:46 2022] GET /compute/v2.1/servers/6f3cd4ee-8f91-4184-8488-a9b249a6b468 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:44:46.726579 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-3bd0f0e2-5a8f-4f04-b043-363011b038e6 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:44:46.727182 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-3bd0f0e2-5a8f-4f04-b043-363011b038e6 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] [instance: 29619526-3255-4729-81c6-53db060e7426] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:44:46.733839 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-3bd0f0e2-5a8f-4f04-b043-363011b038e6 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:46.734320 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-3bd0f0e2-5a8f-4f04-b043-363011b038e6 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:46.734753 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-3bd0f0e2-5a8f-4f04-b043-363011b038e6 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:46.735440 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-3bd0f0e2-5a8f-4f04-b043-363011b038e6 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:46.735891 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-3bd0f0e2-5a8f-4f04-b043-363011b038e6 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:46.736307 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-3bd0f0e2-5a8f-4f04-b043-363011b038e6 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:46.885407 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-3bd0f0e2-5a8f-4f04-b043-363011b038e6 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031939e16194f63b99e6f27f700fa8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecec6d0c155f4d658197c4779ab9ffce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:44:46.896246 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-3bd0f0e2-5a8f-4f04-b043-363011b038e6 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] 10.222.0.84 "GET /compute/v2.1/servers/29619526-3255-4729-81c6-53db060e7426" status: 200 len: 1673 microversion: 2.1 time: 0.173551 Aug 24 11:44:46.896846 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 590/1144] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:44:46 2022] GET /compute/v2.1/servers/29619526-3255-4729-81c6-53db060e7426 => generated 1673 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:44:47.539087 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-fa5ba97c-1c1b-499f-8348-4a2cc7a275a3 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:44:47.539765 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-fa5ba97c-1c1b-499f-8348-4a2cc7a275a3 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] [instance: 6f3cd4ee-8f91-4184-8488-a9b249a6b468] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:44:47.547229 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-fa5ba97c-1c1b-499f-8348-4a2cc7a275a3 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:47.547716 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-fa5ba97c-1c1b-499f-8348-4a2cc7a275a3 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:47.548147 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-fa5ba97c-1c1b-499f-8348-4a2cc7a275a3 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:47.548885 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-fa5ba97c-1c1b-499f-8348-4a2cc7a275a3 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:47.549334 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-fa5ba97c-1c1b-499f-8348-4a2cc7a275a3 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:47.549759 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-fa5ba97c-1c1b-499f-8348-4a2cc7a275a3 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:47.698388 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-fa5ba97c-1c1b-499f-8348-4a2cc7a275a3 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b82b6f568bd41fa9d6b44facb766e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ef3fc15a0147e39228729d2b5b2631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:44:47.706535 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-fa5ba97c-1c1b-499f-8348-4a2cc7a275a3 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] 10.222.0.84 "GET /compute/v2.1/servers/6f3cd4ee-8f91-4184-8488-a9b249a6b468" status: 200 len: 1265 microversion: 2.1 time: 0.171332 Aug 24 11:44:47.707147 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 555/1145] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:44:47 2022] GET /compute/v2.1/servers/6f3cd4ee-8f91-4184-8488-a9b249a6b468 => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:44:47.918910 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-f3679b8a-479e-4d84-8a4f-56593e927e42 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:44:47.923507 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-f3679b8a-479e-4d84-8a4f-56593e927e42 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] [instance: 29619526-3255-4729-81c6-53db060e7426] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:44:47.926952 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f3679b8a-479e-4d84-8a4f-56593e927e42 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:47.927441 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f3679b8a-479e-4d84-8a4f-56593e927e42 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:47.927873 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f3679b8a-479e-4d84-8a4f-56593e927e42 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:47.928564 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f3679b8a-479e-4d84-8a4f-56593e927e42 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:47.929045 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f3679b8a-479e-4d84-8a4f-56593e927e42 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:47.929464 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f3679b8a-479e-4d84-8a4f-56593e927e42 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:48.071928 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-f3679b8a-479e-4d84-8a4f-56593e927e42 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031939e16194f63b99e6f27f700fa8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecec6d0c155f4d658197c4779ab9ffce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:44:48.079883 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-f3679b8a-479e-4d84-8a4f-56593e927e42 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] 10.222.0.84 "GET /compute/v2.1/servers/29619526-3255-4729-81c6-53db060e7426" status: 200 len: 1673 microversion: 2.1 time: 0.165445 Aug 24 11:44:48.080451 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 591/1146] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:44:47 2022] GET /compute/v2.1/servers/29619526-3255-4729-81c6-53db060e7426 => generated 1673 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:44:48.726632 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-ac203d8a-4001-4448-81dc-0220b471122b tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:44:48.727251 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-ac203d8a-4001-4448-81dc-0220b471122b tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] [instance: 6f3cd4ee-8f91-4184-8488-a9b249a6b468] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:44:48.734460 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ac203d8a-4001-4448-81dc-0220b471122b tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:48.734962 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ac203d8a-4001-4448-81dc-0220b471122b tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:48.735402 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ac203d8a-4001-4448-81dc-0220b471122b tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:48.736246 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ac203d8a-4001-4448-81dc-0220b471122b tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:48.737553 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ac203d8a-4001-4448-81dc-0220b471122b tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:48.737553 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ac203d8a-4001-4448-81dc-0220b471122b tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:48.903479 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-ac203d8a-4001-4448-81dc-0220b471122b tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b82b6f568bd41fa9d6b44facb766e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ef3fc15a0147e39228729d2b5b2631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:44:48.911955 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-ac203d8a-4001-4448-81dc-0220b471122b tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] 10.222.0.84 "GET /compute/v2.1/servers/6f3cd4ee-8f91-4184-8488-a9b249a6b468" status: 200 len: 1265 microversion: 2.1 time: 0.189130 Aug 24 11:44:48.912536 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 556/1147] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:44:48 2022] GET /compute/v2.1/servers/6f3cd4ee-8f91-4184-8488-a9b249a6b468 => generated 1265 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:44:49.105157 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-07872d7d-155a-499c-a09c-45d431b25e2b tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:44:49.106153 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-07872d7d-155a-499c-a09c-45d431b25e2b tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] [instance: 29619526-3255-4729-81c6-53db060e7426] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:44:49.115663 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-07872d7d-155a-499c-a09c-45d431b25e2b tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:49.116163 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-07872d7d-155a-499c-a09c-45d431b25e2b tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:49.116596 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-07872d7d-155a-499c-a09c-45d431b25e2b tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:49.117546 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-07872d7d-155a-499c-a09c-45d431b25e2b tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:49.118003 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-07872d7d-155a-499c-a09c-45d431b25e2b tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:49.118428 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-07872d7d-155a-499c-a09c-45d431b25e2b tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:49.271757 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-07872d7d-155a-499c-a09c-45d431b25e2b tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031939e16194f63b99e6f27f700fa8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecec6d0c155f4d658197c4779ab9ffce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:44:49.280125 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-07872d7d-155a-499c-a09c-45d431b25e2b tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] 10.222.0.84 "GET /compute/v2.1/servers/29619526-3255-4729-81c6-53db060e7426" status: 200 len: 1673 microversion: 2.1 time: 0.181160 Aug 24 11:44:49.280768 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 592/1148] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:44:49 2022] GET /compute/v2.1/servers/29619526-3255-4729-81c6-53db060e7426 => generated 1673 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:44:49.933898 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-d1f11f8a-3ac1-4af7-a2ec-6490e2a9ad0a tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:44:49.934513 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-d1f11f8a-3ac1-4af7-a2ec-6490e2a9ad0a tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] [instance: 6f3cd4ee-8f91-4184-8488-a9b249a6b468] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:44:49.941612 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d1f11f8a-3ac1-4af7-a2ec-6490e2a9ad0a tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:49.942105 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d1f11f8a-3ac1-4af7-a2ec-6490e2a9ad0a tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:49.942651 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d1f11f8a-3ac1-4af7-a2ec-6490e2a9ad0a tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:49.943352 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d1f11f8a-3ac1-4af7-a2ec-6490e2a9ad0a tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:49.943803 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d1f11f8a-3ac1-4af7-a2ec-6490e2a9ad0a tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:49.944224 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d1f11f8a-3ac1-4af7-a2ec-6490e2a9ad0a tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:50.304673 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-dbf0d181-15da-4a95-8762-00deca7f9f74 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:44:50.311302 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-dbf0d181-15da-4a95-8762-00deca7f9f74 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] [instance: 29619526-3255-4729-81c6-53db060e7426] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:44:50.314810 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-dbf0d181-15da-4a95-8762-00deca7f9f74 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:50.315341 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-dbf0d181-15da-4a95-8762-00deca7f9f74 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:50.315793 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-dbf0d181-15da-4a95-8762-00deca7f9f74 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:50.316495 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-dbf0d181-15da-4a95-8762-00deca7f9f74 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:50.317153 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-dbf0d181-15da-4a95-8762-00deca7f9f74 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:50.317583 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-dbf0d181-15da-4a95-8762-00deca7f9f74 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:50.397563 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-d1f11f8a-3ac1-4af7-a2ec-6490e2a9ad0a tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b82b6f568bd41fa9d6b44facb766e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ef3fc15a0147e39228729d2b5b2631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:44:50.406975 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-d1f11f8a-3ac1-4af7-a2ec-6490e2a9ad0a tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] 10.222.0.84 "GET /compute/v2.1/servers/6f3cd4ee-8f91-4184-8488-a9b249a6b468" status: 200 len: 1265 microversion: 2.1 time: 0.477293 Aug 24 11:44:50.412340 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 557/1149] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:44:49 2022] GET /compute/v2.1/servers/6f3cd4ee-8f91-4184-8488-a9b249a6b468 => generated 1265 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:44:50.483961 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-dbf0d181-15da-4a95-8762-00deca7f9f74 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031939e16194f63b99e6f27f700fa8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecec6d0c155f4d658197c4779ab9ffce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:44:50.495313 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-dbf0d181-15da-4a95-8762-00deca7f9f74 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] 10.222.0.84 "GET /compute/v2.1/servers/29619526-3255-4729-81c6-53db060e7426" status: 200 len: 1673 microversion: 2.1 time: 0.197358 Aug 24 11:44:50.496242 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 593/1150] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:44:50 2022] GET /compute/v2.1/servers/29619526-3255-4729-81c6-53db060e7426 => generated 1673 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:44:51.162411 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [req-01adb59b-ad5b-4e8d-822c-6c4919565f31 req-ca3c3ff2-4708-475d-ae3a-8a3c40f2a7d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29619526-3255-4729-81c6-53db060e7426", "name": "network-vif-deleted", "tag": "f9cbcf81-59b4-42ee-b9fb-05ef5f045b65"}]} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:44:51.174893 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-01adb59b-ad5b-4e8d-822c-6c4919565f31 req-ca3c3ff2-4708-475d-ae3a-8a3c40f2a7d5 service nova] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:51.175477 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-01adb59b-ad5b-4e8d-822c-6c4919565f31 req-ca3c3ff2-4708-475d-ae3a-8a3c40f2a7d5 service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:51.175977 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-01adb59b-ad5b-4e8d-822c-6c4919565f31 req-ca3c3ff2-4708-475d-ae3a-8a3c40f2a7d5 service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:51.188781 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.compute.server_external_events [req-01adb59b-ad5b-4e8d-822c-6c4919565f31 req-ca3c3ff2-4708-475d-ae3a-8a3c40f2a7d5 service nova] Creating event network-vif-deleted:f9cbcf81-59b4-42ee-b9fb-05ef5f045b65 for instance 29619526-3255-4729-81c6-53db060e7426 on hv-cinder-85427 Aug 24 11:44:51.202390 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [req-01adb59b-ad5b-4e8d-822c-6c4919565f31 req-ca3c3ff2-4708-475d-ae3a-8a3c40f2a7d5 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038916 Aug 24 11:44:51.202390 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 558/1151] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Aug 24 11:44:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:44:51.299521 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [req-34850bee-ca4f-4846-a0a7-5bfdf8c5cd92 req-27300160-0b0e-4823-a62f-e98b65cb57a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f3cd4ee-8f91-4184-8488-a9b249a6b468", "name": "network-vif-plugged", "status": "completed", "tag": "1be776cf-2b6b-4565-97c5-cf42d0be6f9c"}]} {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:44:51.312791 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [req-34850bee-ca4f-4846-a0a7-5bfdf8c5cd92 req-27300160-0b0e-4823-a62f-e98b65cb57a2 service nova] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:51.318875 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [req-34850bee-ca4f-4846-a0a7-5bfdf8c5cd92 req-27300160-0b0e-4823-a62f-e98b65cb57a2 service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:51.318875 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [req-34850bee-ca4f-4846-a0a7-5bfdf8c5cd92 req-27300160-0b0e-4823-a62f-e98b65cb57a2 service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:51.318875 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG dbcounter [-] [124769] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:44:51.327389 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.compute.server_external_events [req-34850bee-ca4f-4846-a0a7-5bfdf8c5cd92 req-27300160-0b0e-4823-a62f-e98b65cb57a2 service nova] Creating event network-vif-plugged:1be776cf-2b6b-4565-97c5-cf42d0be6f9c for instance 6f3cd4ee-8f91-4184-8488-a9b249a6b468 on hv-cinder-85427 Aug 24 11:44:51.333191 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [req-34850bee-ca4f-4846-a0a7-5bfdf8c5cd92 req-27300160-0b0e-4823-a62f-e98b65cb57a2 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039011 Aug 24 11:44:51.334229 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 594/1152] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Aug 24 11:44:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:44:51.429307 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-efcb6d72-0255-418e-9473-f02884305eac tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:44:51.430013 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-efcb6d72-0255-418e-9473-f02884305eac tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] [instance: 6f3cd4ee-8f91-4184-8488-a9b249a6b468] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:44:51.437496 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-efcb6d72-0255-418e-9473-f02884305eac tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:51.437990 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-efcb6d72-0255-418e-9473-f02884305eac tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:51.438430 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-efcb6d72-0255-418e-9473-f02884305eac tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:51.439401 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-efcb6d72-0255-418e-9473-f02884305eac tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:51.439878 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-efcb6d72-0255-418e-9473-f02884305eac tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:51.440306 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-efcb6d72-0255-418e-9473-f02884305eac tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:51.522531 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-547cbc35-bafc-4c86-9560-163100030b52 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:44:51.523660 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-547cbc35-bafc-4c86-9560-163100030b52 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] [instance: 29619526-3255-4729-81c6-53db060e7426] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:44:51.531802 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-547cbc35-bafc-4c86-9560-163100030b52 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:51.532597 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-547cbc35-bafc-4c86-9560-163100030b52 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:51.533138 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-547cbc35-bafc-4c86-9560-163100030b52 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:51.533868 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-547cbc35-bafc-4c86-9560-163100030b52 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:51.534387 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-547cbc35-bafc-4c86-9560-163100030b52 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:51.535206 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-547cbc35-bafc-4c86-9560-163100030b52 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:51.615131 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-efcb6d72-0255-418e-9473-f02884305eac tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b82b6f568bd41fa9d6b44facb766e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ef3fc15a0147e39228729d2b5b2631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:44:51.626413 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-efcb6d72-0255-418e-9473-f02884305eac tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] 10.222.0.84 "GET /compute/v2.1/servers/6f3cd4ee-8f91-4184-8488-a9b249a6b468" status: 200 len: 1265 microversion: 2.1 time: 0.201486 Aug 24 11:44:51.627018 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 559/1153] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:44:51 2022] GET /compute/v2.1/servers/6f3cd4ee-8f91-4184-8488-a9b249a6b468 => generated 1265 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:44:51.636951 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-547cbc35-bafc-4c86-9560-163100030b52 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031939e16194f63b99e6f27f700fa8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecec6d0c155f4d658197c4779ab9ffce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:44:51.646350 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-547cbc35-bafc-4c86-9560-163100030b52 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] 10.222.0.84 "GET /compute/v2.1/servers/29619526-3255-4729-81c6-53db060e7426" status: 200 len: 1323 microversion: 2.1 time: 0.129220 Aug 24 11:44:51.650818 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 595/1154] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:44:51 2022] GET /compute/v2.1/servers/29619526-3255-4729-81c6-53db060e7426 => generated 1323 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:44:52.648250 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-cd25420d-f810-460c-b555-948f17179e3d tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:44:52.649095 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-cd25420d-f810-460c-b555-948f17179e3d tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] [instance: 6f3cd4ee-8f91-4184-8488-a9b249a6b468] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:44:52.656729 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-cd25420d-f810-460c-b555-948f17179e3d tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:52.657245 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-cd25420d-f810-460c-b555-948f17179e3d tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:52.657676 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-cd25420d-f810-460c-b555-948f17179e3d tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:52.658431 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-cd25420d-f810-460c-b555-948f17179e3d tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:52.658934 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-cd25420d-f810-460c-b555-948f17179e3d tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:52.659363 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-cd25420d-f810-460c-b555-948f17179e3d tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:52.671352 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-031fb69c-736b-4125-a8da-df44b70ba630 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:44:52.672020 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-031fb69c-736b-4125-a8da-df44b70ba630 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] [instance: 29619526-3255-4729-81c6-53db060e7426] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:44:52.679928 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-031fb69c-736b-4125-a8da-df44b70ba630 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:52.680418 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-031fb69c-736b-4125-a8da-df44b70ba630 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:52.680883 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-031fb69c-736b-4125-a8da-df44b70ba630 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:52.681613 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-031fb69c-736b-4125-a8da-df44b70ba630 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:52.682070 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-031fb69c-736b-4125-a8da-df44b70ba630 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:52.682497 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-031fb69c-736b-4125-a8da-df44b70ba630 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:52.721724 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-031fb69c-736b-4125-a8da-df44b70ba630 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:52.722128 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-031fb69c-736b-4125-a8da-df44b70ba630 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:52.722576 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-031fb69c-736b-4125-a8da-df44b70ba630 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:52.723090 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.objects.instance [None req-031fb69c-736b-4125-a8da-df44b70ba630 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lazy-loading 'fault' on Instance uuid 29619526-3255-4729-81c6-53db060e7426 {{(pid=124769) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:44:52.766269 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-031fb69c-736b-4125-a8da-df44b70ba630 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031939e16194f63b99e6f27f700fa8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecec6d0c155f4d658197c4779ab9ffce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:44:52.774326 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-031fb69c-736b-4125-a8da-df44b70ba630 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] 10.222.0.84 "GET /compute/v2.1/servers/29619526-3255-4729-81c6-53db060e7426" status: 200 len: 1328 microversion: 2.1 time: 0.107147 Aug 24 11:44:52.775021 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 596/1155] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:44:52 2022] GET /compute/v2.1/servers/29619526-3255-4729-81c6-53db060e7426 => generated 1328 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:44:52.816555 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-cd25420d-f810-460c-b555-948f17179e3d tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b82b6f568bd41fa9d6b44facb766e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ef3fc15a0147e39228729d2b5b2631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:44:52.821458 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-cd25420d-f810-460c-b555-948f17179e3d tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] 10.222.0.84 "GET /compute/v2.1/servers/6f3cd4ee-8f91-4184-8488-a9b249a6b468" status: 200 len: 1265 microversion: 2.1 time: 0.177569 Aug 24 11:44:52.822119 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 560/1156] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:44:52 2022] GET /compute/v2.1/servers/6f3cd4ee-8f91-4184-8488-a9b249a6b468 => generated 1265 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:44:53.798054 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-101701af-d58c-48dd-a9f1-05320238fb22 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:44:53.798658 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-101701af-d58c-48dd-a9f1-05320238fb22 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] [instance: 29619526-3255-4729-81c6-53db060e7426] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:44:53.805571 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-101701af-d58c-48dd-a9f1-05320238fb22 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:53.806049 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-101701af-d58c-48dd-a9f1-05320238fb22 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:53.806490 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-101701af-d58c-48dd-a9f1-05320238fb22 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:53.807184 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-101701af-d58c-48dd-a9f1-05320238fb22 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:53.807633 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-101701af-d58c-48dd-a9f1-05320238fb22 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:53.808043 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-101701af-d58c-48dd-a9f1-05320238fb22 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:53.822364 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.wsgi [None req-101701af-d58c-48dd-a9f1-05320238fb22 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] HTTP exception thrown: Instance 29619526-3255-4729-81c6-53db060e7426 could not be found. Aug 24 11:44:53.824023 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-101701af-d58c-48dd-a9f1-05320238fb22 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Request method failure captured: Aug 24 11:44:53.824023 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: request: GET /compute/v2.1/servers/29619526-3255-4729-81c6-53db060e7426 HTTP/1.1 Aug 24 11:44:53.824023 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Accept: application/json Aug 24 11:44:53.824023 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Accept-Encoding: identity Aug 24 11:44:53.824023 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Connection: close Aug 24 11:44:53.824023 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Content-Length: 0 Aug 24 11:44:53.824023 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Content-Type: application/json Aug 24 11:44:53.824023 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Host: 10.222.0.84 Aug 24 11:44:53.824023 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Openstack-System-Scope: None Aug 24 11:44:53.824023 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: User-Agent: python-urllib3/1.26.11 Aug 24 11:44:53.824023 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Auth-Token: gAAAAABjBgwhMRA2cc0ufptdwp2_h4V9wxgyG8HRbsXs7voMg4kkNvxs16qRO7dqeMBpzWdJlNOxoL6pRb4rQbp4bL_LJMOsmXfsJ9Cn4wHtcwCJR4buyH1_orEHcIHlFzsC1aopD-eGByxqvTpBRnq6aVvXi5uMcj80D-MqlnO_9B15eXvtaFs Aug 24 11:44:53.824023 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Domain-Id: None Aug 24 11:44:53.824023 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Domain-Name: None Aug 24 11:44:53.824023 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Identity-Status: Confirmed Aug 24 11:44:53.824023 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Is-Admin-Project: True Aug 24 11:44:53.824023 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Project-Domain-Id: default Aug 24 11:44:53.824023 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Project-Domain-Name: Default Aug 24 11:44:53.824023 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Project-Id: ecec6d0c155f4d658197c4779ab9ffce Aug 24 11:44:53.824023 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Project-Name: tempest-AttachVolumeTestJSON-1126541934 Aug 24 11:44:53.824023 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Role: reader,member Aug 24 11:44:53.824023 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Roles: reader,member Aug 24 11:44:53.826611 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/volume/v3/ecec6d0c155f4d658197c4779ab9ffce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/volume/v3/ecec6d0c155f4d658197c4779ab9ffce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/compute/v2/ecec6d0c155f4d658197c4779ab9ffce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84:8080/v1/AUTH_ecec6d0c155f4d658197c4779ab9ffce", "adminURL": "http://10.222.0.84:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/placement"}]}] Aug 24 11:44:53.826611 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Tenant: tempest-AttachVolumeTestJSON-1126541934 Aug 24 11:44:53.826611 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Tenant-Id: ecec6d0c155f4d658197c4779ab9ffce Aug 24 11:44:53.826611 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1126541934 Aug 24 11:44:53.826611 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-User: tempest-AttachVolumeTestJSON-1126541934-project Aug 24 11:44:53.826611 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-User-Domain-Id: default Aug 24 11:44:53.826611 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-User-Domain-Name: Default Aug 24 11:44:53.826611 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-User-Id: 0031939e16194f63b99e6f27f700fa8c Aug 24 11:44:53.826611 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-User-Name: tempest-AttachVolumeTestJSON-1126541934-project Aug 24 11:44:53.826611 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: method: > Aug 24 11:44:53.826611 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: exception: Instance 29619526-3255-4729-81c6-53db060e7426 could not be found. Aug 24 11:44:53.826611 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: action_args: {'id': '29619526-3255-4729-81c6-53db060e7426'} Aug 24 11:44:53.828341 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:44:53.828341 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:44:53.828341 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:44:53.828341 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:44:53.828341 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:44:53.828341 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:44:53.828341 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:44:53.828341 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:44:53.828341 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:44:53.828341 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:44:53.828341 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29619526-3255-4729-81c6-53db060e7426 could not be found. Aug 24 11:44:53.828341 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Aug 24 11:44:53.828341 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:44:53.828341 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Aug 24 11:44:53.828341 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:44:53.828341 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:44:53.828341 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:44:53.828341 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:44:53.828341 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:44:53.828341 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:44:53.831008 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:44:53.831008 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:44:53.831008 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:44:53.831008 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:44:53.831008 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:44:53.831008 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:44:53.831008 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:44:53.831008 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29619526-3255-4729-81c6-53db060e7426 could not be found. Aug 24 11:44:53.831008 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Aug 24 11:44:53.831008 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:44:53.831008 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Aug 24 11:44:53.831008 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:44:53.831008 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:44:53.831008 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:44:53.831008 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:44:53.831008 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:44:53.831008 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29619526-3255-4729-81c6-53db060e7426 could not be found. Aug 24 11:44:53.831008 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Aug 24 11:44:53.833612 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-101701af-d58c-48dd-a9f1-05320238fb22 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Returning 404 to user: Instance 29619526-3255-4729-81c6-53db060e7426 could not be found. {{(pid=124769) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:44:53.833612 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-101701af-d58c-48dd-a9f1-05320238fb22 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] 10.222.0.84 "GET /compute/v2.1/servers/29619526-3255-4729-81c6-53db060e7426" status: 404 len: 111 microversion: 2.1 time: 0.032131 Aug 24 11:44:53.833612 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 597/1157] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:44:53 2022] GET /compute/v2.1/servers/29619526-3255-4729-81c6-53db060e7426 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:44:53.836593 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-ccbfd3b1-7167-4d80-88b3-003b0cdf1ab6 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Calling method '.version_select at 0x7f0e2a64d160>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:44:53.847477 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-884e79e1-b2a4-49c1-9e5d-07bc88afab94 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:44:53.848076 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-884e79e1-b2a4-49c1-9e5d-07bc88afab94 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] [instance: 6f3cd4ee-8f91-4184-8488-a9b249a6b468] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:44:53.855699 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-884e79e1-b2a4-49c1-9e5d-07bc88afab94 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:53.856184 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-884e79e1-b2a4-49c1-9e5d-07bc88afab94 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:53.856616 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-884e79e1-b2a4-49c1-9e5d-07bc88afab94 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:53.857358 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-884e79e1-b2a4-49c1-9e5d-07bc88afab94 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:53.858714 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-884e79e1-b2a4-49c1-9e5d-07bc88afab94 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:53.859132 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-884e79e1-b2a4-49c1-9e5d-07bc88afab94 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:53.934634 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-ccbfd3b1-7167-4d80-88b3-003b0cdf1ab6 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] 10.222.0.84 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1921294098" status: 202 len: 0 microversion: 2.1 time: 0.103152 Aug 24 11:44:53.935099 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 561/1158] 10.222.0.84 () {58 vars in 1221 bytes} [Wed Aug 24 11:44:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1921294098 => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:44:54.017476 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-884e79e1-b2a4-49c1-9e5d-07bc88afab94 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b82b6f568bd41fa9d6b44facb766e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ef3fc15a0147e39228729d2b5b2631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:44:54.025978 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-884e79e1-b2a4-49c1-9e5d-07bc88afab94 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] 10.222.0.84 "GET /compute/v2.1/servers/6f3cd4ee-8f91-4184-8488-a9b249a6b468" status: 200 len: 1265 microversion: 2.1 time: 0.184041 Aug 24 11:44:54.026565 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 598/1159] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:44:53 2022] GET /compute/v2.1/servers/6f3cd4ee-8f91-4184-8488-a9b249a6b468 => generated 1265 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:44:55.047397 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-a5c0bcdf-c6ec-4c91-b834-fd7eedb8409a tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:44:55.048044 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-a5c0bcdf-c6ec-4c91-b834-fd7eedb8409a tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] [instance: 6f3cd4ee-8f91-4184-8488-a9b249a6b468] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:44:55.055432 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a5c0bcdf-c6ec-4c91-b834-fd7eedb8409a tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:55.055893 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a5c0bcdf-c6ec-4c91-b834-fd7eedb8409a tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:55.056335 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a5c0bcdf-c6ec-4c91-b834-fd7eedb8409a tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:55.057092 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a5c0bcdf-c6ec-4c91-b834-fd7eedb8409a tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:55.057544 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a5c0bcdf-c6ec-4c91-b834-fd7eedb8409a tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:55.058204 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a5c0bcdf-c6ec-4c91-b834-fd7eedb8409a tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:55.215829 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-a5c0bcdf-c6ec-4c91-b834-fd7eedb8409a tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b82b6f568bd41fa9d6b44facb766e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ef3fc15a0147e39228729d2b5b2631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:44:55.224188 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-a5c0bcdf-c6ec-4c91-b834-fd7eedb8409a tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] 10.222.0.84 "GET /compute/v2.1/servers/6f3cd4ee-8f91-4184-8488-a9b249a6b468" status: 200 len: 1451 microversion: 2.1 time: 0.181485 Aug 24 11:44:55.224751 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 562/1160] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:44:55 2022] GET /compute/v2.1/servers/6f3cd4ee-8f91-4184-8488-a9b249a6b468 => generated 1451 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:44:55.245182 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-d4acb8a6-0bea-482c-b8ce-3e750e9fcbe8 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:44:55.246401 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-d4acb8a6-0bea-482c-b8ce-3e750e9fcbe8 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] [instance: 6f3cd4ee-8f91-4184-8488-a9b249a6b468] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:44:55.253591 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-d4acb8a6-0bea-482c-b8ce-3e750e9fcbe8 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:55.254629 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-d4acb8a6-0bea-482c-b8ce-3e750e9fcbe8 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:55.254629 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-d4acb8a6-0bea-482c-b8ce-3e750e9fcbe8 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:55.255267 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-d4acb8a6-0bea-482c-b8ce-3e750e9fcbe8 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:55.255855 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-d4acb8a6-0bea-482c-b8ce-3e750e9fcbe8 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:55.256214 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-d4acb8a6-0bea-482c-b8ce-3e750e9fcbe8 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:55.396292 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-d4acb8a6-0bea-482c-b8ce-3e750e9fcbe8 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b82b6f568bd41fa9d6b44facb766e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ef3fc15a0147e39228729d2b5b2631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:44:55.404947 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-d4acb8a6-0bea-482c-b8ce-3e750e9fcbe8 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] 10.222.0.84 "GET /compute/v2.1/servers/6f3cd4ee-8f91-4184-8488-a9b249a6b468" status: 200 len: 1451 microversion: 2.1 time: 0.162875 Aug 24 11:44:55.405566 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 599/1161] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:44:55 2022] GET /compute/v2.1/servers/6f3cd4ee-8f91-4184-8488-a9b249a6b468 => generated 1451 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:44:57.591443 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-0fcbb2e1-0392-4a5e-813c-388dbe65f5d1 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:44:57.592697 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-0fcbb2e1-0392-4a5e-813c-388dbe65f5d1 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] [instance: 29619526-3255-4729-81c6-53db060e7426] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:44:57.599678 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-0fcbb2e1-0392-4a5e-813c-388dbe65f5d1 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:57.600657 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-0fcbb2e1-0392-4a5e-813c-388dbe65f5d1 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:57.601633 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-0fcbb2e1-0392-4a5e-813c-388dbe65f5d1 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:57.603408 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-0fcbb2e1-0392-4a5e-813c-388dbe65f5d1 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:57.604087 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-0fcbb2e1-0392-4a5e-813c-388dbe65f5d1 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:57.604695 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-0fcbb2e1-0392-4a5e-813c-388dbe65f5d1 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:57.622220 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.wsgi [None req-0fcbb2e1-0392-4a5e-813c-388dbe65f5d1 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] HTTP exception thrown: Instance 29619526-3255-4729-81c6-53db060e7426 could not be found. Aug 24 11:44:57.625516 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-0fcbb2e1-0392-4a5e-813c-388dbe65f5d1 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Request method failure captured: Aug 24 11:44:57.625516 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: request: DELETE /compute/v2.1/servers/29619526-3255-4729-81c6-53db060e7426 HTTP/1.1 Aug 24 11:44:57.625516 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Accept: application/json Aug 24 11:44:57.625516 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Accept-Encoding: identity Aug 24 11:44:57.625516 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Connection: close Aug 24 11:44:57.625516 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Content-Length: 0 Aug 24 11:44:57.625516 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Content-Type: application/json Aug 24 11:44:57.625516 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Host: 10.222.0.84 Aug 24 11:44:57.625516 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Openstack-System-Scope: None Aug 24 11:44:57.625516 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: User-Agent: python-urllib3/1.26.11 Aug 24 11:44:57.625516 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Auth-Token: gAAAAABjBgwhMRA2cc0ufptdwp2_h4V9wxgyG8HRbsXs7voMg4kkNvxs16qRO7dqeMBpzWdJlNOxoL6pRb4rQbp4bL_LJMOsmXfsJ9Cn4wHtcwCJR4buyH1_orEHcIHlFzsC1aopD-eGByxqvTpBRnq6aVvXi5uMcj80D-MqlnO_9B15eXvtaFs Aug 24 11:44:57.625516 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Domain-Id: None Aug 24 11:44:57.625516 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Domain-Name: None Aug 24 11:44:57.625516 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Identity-Status: Confirmed Aug 24 11:44:57.625516 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Is-Admin-Project: True Aug 24 11:44:57.625516 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Project-Domain-Id: default Aug 24 11:44:57.625516 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Project-Domain-Name: Default Aug 24 11:44:57.625516 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Project-Id: ecec6d0c155f4d658197c4779ab9ffce Aug 24 11:44:57.625516 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Project-Name: tempest-AttachVolumeTestJSON-1126541934 Aug 24 11:44:57.625516 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Role: reader,member Aug 24 11:44:57.625516 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Roles: reader,member Aug 24 11:44:57.627090 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/volume/v3/ecec6d0c155f4d658197c4779ab9ffce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/volume/v3/ecec6d0c155f4d658197c4779ab9ffce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/compute/v2/ecec6d0c155f4d658197c4779ab9ffce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84:8080/v1/AUTH_ecec6d0c155f4d658197c4779ab9ffce", "adminURL": "http://10.222.0.84:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/placement"}]}] Aug 24 11:44:57.627090 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Tenant: tempest-AttachVolumeTestJSON-1126541934 Aug 24 11:44:57.627090 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Tenant-Id: ecec6d0c155f4d658197c4779ab9ffce Aug 24 11:44:57.627090 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1126541934 Aug 24 11:44:57.627090 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User: tempest-AttachVolumeTestJSON-1126541934-project Aug 24 11:44:57.627090 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User-Domain-Id: default Aug 24 11:44:57.627090 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User-Domain-Name: Default Aug 24 11:44:57.627090 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User-Id: 0031939e16194f63b99e6f27f700fa8c Aug 24 11:44:57.627090 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User-Name: tempest-AttachVolumeTestJSON-1126541934-project Aug 24 11:44:57.627090 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: method: > Aug 24 11:44:57.627090 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: exception: Instance 29619526-3255-4729-81c6-53db060e7426 could not be found. Aug 24 11:44:57.627090 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: action_args: {'id': '29619526-3255-4729-81c6-53db060e7426'} Aug 24 11:44:57.627849 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:44:57.627849 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:44:57.627849 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:44:57.627849 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:44:57.627849 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:44:57.627849 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:44:57.627849 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:44:57.627849 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:44:57.627849 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:44:57.627849 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:44:57.627849 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29619526-3255-4729-81c6-53db060e7426 could not be found. Aug 24 11:44:57.627849 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:44:57.627849 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:44:57.627849 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:44:57.627849 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:44:57.627849 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:44:57.627849 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:44:57.627849 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:44:57.627849 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:44:57.627849 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:44:57.629217 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:44:57.629217 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 11:44:57.629217 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 11:44:57.629217 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 11:44:57.629217 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 11:44:57.629217 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:44:57.629217 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:44:57.629217 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:44:57.629217 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:44:57.629217 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29619526-3255-4729-81c6-53db060e7426 could not be found. Aug 24 11:44:57.629217 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:44:57.629217 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:44:57.629217 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:44:57.629217 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:44:57.629217 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:44:57.629217 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:44:57.629217 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:44:57.629217 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:44:57.629217 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29619526-3255-4729-81c6-53db060e7426 could not be found. Aug 24 11:44:57.629217 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:44:57.630417 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-0fcbb2e1-0392-4a5e-813c-388dbe65f5d1 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Returning 404 to user: Instance 29619526-3255-4729-81c6-53db060e7426 could not be found. {{(pid=124770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:44:57.630417 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-0fcbb2e1-0392-4a5e-813c-388dbe65f5d1 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] 10.222.0.84 "DELETE /compute/v2.1/servers/29619526-3255-4729-81c6-53db060e7426" status: 404 len: 111 microversion: 2.1 time: 0.039761 Aug 24 11:44:57.630417 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 563/1162] 10.222.0.84 () {58 vars in 1239 bytes} [Wed Aug 24 11:44:57 2022] DELETE /compute/v2.1/servers/29619526-3255-4729-81c6-53db060e7426 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:44:57.638415 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-70957465-c800-477a-9d98-f05af41df610 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:44:57.641756 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-70957465-c800-477a-9d98-f05af41df610 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] [instance: 29619526-3255-4729-81c6-53db060e7426] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:44:57.648848 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-70957465-c800-477a-9d98-f05af41df610 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:57.649430 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-70957465-c800-477a-9d98-f05af41df610 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:57.649958 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-70957465-c800-477a-9d98-f05af41df610 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:57.650662 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-70957465-c800-477a-9d98-f05af41df610 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:57.651123 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-70957465-c800-477a-9d98-f05af41df610 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:57.651546 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-70957465-c800-477a-9d98-f05af41df610 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:57.666790 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.wsgi [None req-70957465-c800-477a-9d98-f05af41df610 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] HTTP exception thrown: Instance 29619526-3255-4729-81c6-53db060e7426 could not be found. Aug 24 11:44:57.672158 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-70957465-c800-477a-9d98-f05af41df610 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Request method failure captured: Aug 24 11:44:57.672158 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: request: GET /compute/v2.1/servers/29619526-3255-4729-81c6-53db060e7426 HTTP/1.1 Aug 24 11:44:57.672158 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Accept: application/json Aug 24 11:44:57.672158 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Accept-Encoding: identity Aug 24 11:44:57.672158 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Connection: close Aug 24 11:44:57.672158 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Content-Length: 0 Aug 24 11:44:57.672158 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Content-Type: application/json Aug 24 11:44:57.672158 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Host: 10.222.0.84 Aug 24 11:44:57.672158 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Openstack-System-Scope: None Aug 24 11:44:57.672158 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: User-Agent: python-urllib3/1.26.11 Aug 24 11:44:57.672158 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Auth-Token: gAAAAABjBgwhMRA2cc0ufptdwp2_h4V9wxgyG8HRbsXs7voMg4kkNvxs16qRO7dqeMBpzWdJlNOxoL6pRb4rQbp4bL_LJMOsmXfsJ9Cn4wHtcwCJR4buyH1_orEHcIHlFzsC1aopD-eGByxqvTpBRnq6aVvXi5uMcj80D-MqlnO_9B15eXvtaFs Aug 24 11:44:57.672158 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Domain-Id: None Aug 24 11:44:57.672158 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Domain-Name: None Aug 24 11:44:57.672158 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Identity-Status: Confirmed Aug 24 11:44:57.672158 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Is-Admin-Project: True Aug 24 11:44:57.672158 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Project-Domain-Id: default Aug 24 11:44:57.672158 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Project-Domain-Name: Default Aug 24 11:44:57.672158 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Project-Id: ecec6d0c155f4d658197c4779ab9ffce Aug 24 11:44:57.672158 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Project-Name: tempest-AttachVolumeTestJSON-1126541934 Aug 24 11:44:57.672158 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Role: reader,member Aug 24 11:44:57.672158 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Roles: reader,member Aug 24 11:44:57.675050 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/volume/v3/ecec6d0c155f4d658197c4779ab9ffce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/volume/v3/ecec6d0c155f4d658197c4779ab9ffce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/compute/v2/ecec6d0c155f4d658197c4779ab9ffce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84:8080/v1/AUTH_ecec6d0c155f4d658197c4779ab9ffce", "adminURL": "http://10.222.0.84:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/placement"}]}] Aug 24 11:44:57.675050 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Tenant: tempest-AttachVolumeTestJSON-1126541934 Aug 24 11:44:57.675050 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Tenant-Id: ecec6d0c155f4d658197c4779ab9ffce Aug 24 11:44:57.675050 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1126541934 Aug 24 11:44:57.675050 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-User: tempest-AttachVolumeTestJSON-1126541934-project Aug 24 11:44:57.675050 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-User-Domain-Id: default Aug 24 11:44:57.675050 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-User-Domain-Name: Default Aug 24 11:44:57.675050 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-User-Id: 0031939e16194f63b99e6f27f700fa8c Aug 24 11:44:57.675050 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-User-Name: tempest-AttachVolumeTestJSON-1126541934-project Aug 24 11:44:57.675050 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: method: > Aug 24 11:44:57.675050 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: exception: Instance 29619526-3255-4729-81c6-53db060e7426 could not be found. Aug 24 11:44:57.675050 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: action_args: {'id': '29619526-3255-4729-81c6-53db060e7426'} Aug 24 11:44:57.676552 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:44:57.676552 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:44:57.676552 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:44:57.676552 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:44:57.676552 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:44:57.676552 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:44:57.676552 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:44:57.676552 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:44:57.676552 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:44:57.676552 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:44:57.676552 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29619526-3255-4729-81c6-53db060e7426 could not be found. Aug 24 11:44:57.676552 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Aug 24 11:44:57.676552 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:44:57.676552 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Aug 24 11:44:57.676552 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:44:57.676552 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:44:57.676552 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:44:57.676552 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:44:57.676552 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:44:57.676552 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:44:57.679300 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:44:57.679300 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:44:57.679300 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:44:57.679300 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:44:57.679300 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:44:57.679300 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:44:57.679300 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:44:57.679300 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29619526-3255-4729-81c6-53db060e7426 could not be found. Aug 24 11:44:57.679300 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Aug 24 11:44:57.679300 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:44:57.679300 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Aug 24 11:44:57.679300 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:44:57.679300 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:44:57.679300 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:44:57.679300 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:44:57.679300 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:44:57.679300 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29619526-3255-4729-81c6-53db060e7426 could not be found. Aug 24 11:44:57.679300 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Aug 24 11:44:57.681312 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-70957465-c800-477a-9d98-f05af41df610 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Returning 404 to user: Instance 29619526-3255-4729-81c6-53db060e7426 could not be found. {{(pid=124769) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:44:57.681312 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-70957465-c800-477a-9d98-f05af41df610 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] 10.222.0.84 "GET /compute/v2.1/servers/29619526-3255-4729-81c6-53db060e7426" status: 404 len: 111 microversion: 2.1 time: 0.036973 Aug 24 11:44:57.681312 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 600/1163] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:44:57 2022] GET /compute/v2.1/servers/29619526-3255-4729-81c6-53db060e7426 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:44:57.971797 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-198674bd-f561-4b5c-adbd-eb34b0157e6f tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:44:57.971797 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-198674bd-f561-4b5c-adbd-eb34b0157e6f tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] [instance: 52f331ec-d0ce-4940-8430-11e9b6732cfe] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:44:57.972324 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [req-01d00119-0b85-40c0-a076-87800644c262 req-76f693a0-93f5-4540-a139-064c5850f67b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52f331ec-d0ce-4940-8430-11e9b6732cfe", "tag": "2922ba9f-42e7-4aaf-a9d1-30bc6103646f"}]} {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:44:57.974711 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-198674bd-f561-4b5c-adbd-eb34b0157e6f tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:57.975216 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-198674bd-f561-4b5c-adbd-eb34b0157e6f tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:57.975670 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-198674bd-f561-4b5c-adbd-eb34b0157e6f tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:57.976396 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-198674bd-f561-4b5c-adbd-eb34b0157e6f tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:57.984057 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-198674bd-f561-4b5c-adbd-eb34b0157e6f tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:57.984057 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-198674bd-f561-4b5c-adbd-eb34b0157e6f tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:57.985316 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [req-01d00119-0b85-40c0-a076-87800644c262 req-76f693a0-93f5-4540-a139-064c5850f67b service nova] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:57.985810 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [req-01d00119-0b85-40c0-a076-87800644c262 req-76f693a0-93f5-4540-a139-064c5850f67b service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:57.986251 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [req-01d00119-0b85-40c0-a076-87800644c262 req-76f693a0-93f5-4540-a139-064c5850f67b service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:58.021446 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.compute.server_external_events [req-01d00119-0b85-40c0-a076-87800644c262 req-76f693a0-93f5-4540-a139-064c5850f67b service nova] Creating event network-changed:2922ba9f-42e7-4aaf-a9d1-30bc6103646f for instance 52f331ec-d0ce-4940-8430-11e9b6732cfe on hv-cinder-85427 Aug 24 11:44:58.028067 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [req-01d00119-0b85-40c0-a076-87800644c262 req-76f693a0-93f5-4540-a139-064c5850f67b service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066325 Aug 24 11:44:58.030249 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 601/1164] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Aug 24 11:44:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:44:58.033873 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-198674bd-f561-4b5c-adbd-eb34b0157e6f tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] [instance: 52f331ec-d0ce-4940-8430-11e9b6732cfe] Going to try to terminate instance {{(pid=124770) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 11:44:58.037021 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [req-c8e5ec53-0f32-49e4-a411-41eaf488e48e req-d882c897-f172-4f13-a19a-ec04571e00d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f3cd4ee-8f91-4184-8488-a9b249a6b468", "tag": "1be776cf-2b6b-4565-97c5-cf42d0be6f9c"}]} {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:44:58.048640 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [req-c8e5ec53-0f32-49e4-a411-41eaf488e48e req-d882c897-f172-4f13-a19a-ec04571e00d7 service nova] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:58.049428 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [req-c8e5ec53-0f32-49e4-a411-41eaf488e48e req-d882c897-f172-4f13-a19a-ec04571e00d7 service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:58.050074 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [req-c8e5ec53-0f32-49e4-a411-41eaf488e48e req-d882c897-f172-4f13-a19a-ec04571e00d7 service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:58.065442 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.compute.server_external_events [req-c8e5ec53-0f32-49e4-a411-41eaf488e48e req-d882c897-f172-4f13-a19a-ec04571e00d7 service nova] Creating event network-changed:1be776cf-2b6b-4565-97c5-cf42d0be6f9c for instance 6f3cd4ee-8f91-4184-8488-a9b249a6b468 on hv-cinder-85427 Aug 24 11:44:58.069866 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:44:58.071552 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [req-c8e5ec53-0f32-49e4-a411-41eaf488e48e req-d882c897-f172-4f13-a19a-ec04571e00d7 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039694 Aug 24 11:44:58.072354 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 602/1165] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Aug 24 11:44:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:44:58.395398 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-198674bd-f561-4b5c-adbd-eb34b0157e6f tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] 10.222.0.84 "DELETE /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe" status: 204 len: 0 microversion: 2.1 time: 0.437433 Aug 24 11:44:58.396566 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 564/1166] 10.222.0.84 () {58 vars in 1239 bytes} [Wed Aug 24 11:44:57 2022] DELETE /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe => generated 0 bytes in 439 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 11:44:58.409515 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-f695ac70-4d89-4b22-9b37-ee2721a1452e tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:44:58.410818 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-f695ac70-4d89-4b22-9b37-ee2721a1452e tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] [instance: 52f331ec-d0ce-4940-8430-11e9b6732cfe] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:44:58.419323 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f695ac70-4d89-4b22-9b37-ee2721a1452e tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:58.420676 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f695ac70-4d89-4b22-9b37-ee2721a1452e tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:58.421657 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f695ac70-4d89-4b22-9b37-ee2721a1452e tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:58.422279 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f695ac70-4d89-4b22-9b37-ee2721a1452e tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:58.422898 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f695ac70-4d89-4b22-9b37-ee2721a1452e tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:58.423675 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f695ac70-4d89-4b22-9b37-ee2721a1452e tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:58.590260 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-f695ac70-4d89-4b22-9b37-ee2721a1452e tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac5dffd3204413a8834d05db267c3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31998483af514a1a8f87ab761d5cf3ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:44:58.604118 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-f695ac70-4d89-4b22-9b37-ee2721a1452e tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] 10.222.0.84 "GET /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe" status: 200 len: 1567 microversion: 2.1 time: 0.200704 Aug 24 11:44:58.605285 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 603/1167] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:44:58 2022] GET /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe => generated 1567 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:44:59.090385 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-86310ab5-953f-4a8b-aa71-cf6e19933663 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:44:59.091764 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-86310ab5-953f-4a8b-aa71-cf6e19933663 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] [instance: 15d4a46e-9504-4897-918d-39aafc20d22a] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:44:59.121711 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-86310ab5-953f-4a8b-aa71-cf6e19933663 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:59.121711 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-86310ab5-953f-4a8b-aa71-cf6e19933663 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:59.121711 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-86310ab5-953f-4a8b-aa71-cf6e19933663 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:59.121711 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-86310ab5-953f-4a8b-aa71-cf6e19933663 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:59.122038 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-86310ab5-953f-4a8b-aa71-cf6e19933663 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:59.122038 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-86310ab5-953f-4a8b-aa71-cf6e19933663 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:59.127330 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.wsgi [None req-86310ab5-953f-4a8b-aa71-cf6e19933663 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] HTTP exception thrown: Instance 15d4a46e-9504-4897-918d-39aafc20d22a could not be found. Aug 24 11:44:59.129479 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-86310ab5-953f-4a8b-aa71-cf6e19933663 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Request method failure captured: Aug 24 11:44:59.129479 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: request: DELETE /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a HTTP/1.1 Aug 24 11:44:59.129479 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Accept: application/json Aug 24 11:44:59.129479 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Accept-Encoding: identity Aug 24 11:44:59.129479 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Connection: close Aug 24 11:44:59.129479 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Content-Length: 0 Aug 24 11:44:59.129479 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Content-Type: application/json Aug 24 11:44:59.129479 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Host: 10.222.0.84 Aug 24 11:44:59.129479 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Openstack-System-Scope: None Aug 24 11:44:59.129479 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: User-Agent: python-urllib3/1.26.11 Aug 24 11:44:59.129479 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Auth-Token: gAAAAABjBgwhMRA2cc0ufptdwp2_h4V9wxgyG8HRbsXs7voMg4kkNvxs16qRO7dqeMBpzWdJlNOxoL6pRb4rQbp4bL_LJMOsmXfsJ9Cn4wHtcwCJR4buyH1_orEHcIHlFzsC1aopD-eGByxqvTpBRnq6aVvXi5uMcj80D-MqlnO_9B15eXvtaFs Aug 24 11:44:59.129479 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Domain-Id: None Aug 24 11:44:59.129479 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Domain-Name: None Aug 24 11:44:59.129479 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Identity-Status: Confirmed Aug 24 11:44:59.129479 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Is-Admin-Project: True Aug 24 11:44:59.129479 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Project-Domain-Id: default Aug 24 11:44:59.129479 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Project-Domain-Name: Default Aug 24 11:44:59.129479 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Project-Id: ecec6d0c155f4d658197c4779ab9ffce Aug 24 11:44:59.129479 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Project-Name: tempest-AttachVolumeTestJSON-1126541934 Aug 24 11:44:59.129479 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Role: reader,member Aug 24 11:44:59.129479 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Roles: reader,member Aug 24 11:44:59.130962 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/volume/v3/ecec6d0c155f4d658197c4779ab9ffce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/volume/v3/ecec6d0c155f4d658197c4779ab9ffce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/compute/v2/ecec6d0c155f4d658197c4779ab9ffce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84:8080/v1/AUTH_ecec6d0c155f4d658197c4779ab9ffce", "adminURL": "http://10.222.0.84:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/placement"}]}] Aug 24 11:44:59.130962 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Tenant: tempest-AttachVolumeTestJSON-1126541934 Aug 24 11:44:59.130962 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Tenant-Id: ecec6d0c155f4d658197c4779ab9ffce Aug 24 11:44:59.130962 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1126541934 Aug 24 11:44:59.130962 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User: tempest-AttachVolumeTestJSON-1126541934-project Aug 24 11:44:59.130962 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User-Domain-Id: default Aug 24 11:44:59.130962 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User-Domain-Name: Default Aug 24 11:44:59.130962 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User-Id: 0031939e16194f63b99e6f27f700fa8c Aug 24 11:44:59.130962 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User-Name: tempest-AttachVolumeTestJSON-1126541934-project Aug 24 11:44:59.130962 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: method: > Aug 24 11:44:59.130962 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: exception: Instance 15d4a46e-9504-4897-918d-39aafc20d22a could not be found. Aug 24 11:44:59.130962 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: action_args: {'id': '15d4a46e-9504-4897-918d-39aafc20d22a'} Aug 24 11:44:59.131820 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:44:59.131820 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:44:59.131820 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:44:59.131820 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:44:59.131820 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:44:59.131820 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:44:59.131820 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:44:59.131820 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:44:59.131820 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:44:59.131820 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:44:59.131820 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15d4a46e-9504-4897-918d-39aafc20d22a could not be found. Aug 24 11:44:59.131820 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:44:59.131820 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:44:59.131820 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:44:59.131820 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:44:59.131820 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:44:59.131820 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:44:59.131820 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:44:59.131820 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:44:59.131820 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:44:59.133317 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:44:59.133317 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 11:44:59.133317 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 11:44:59.133317 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 11:44:59.133317 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 11:44:59.133317 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:44:59.133317 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:44:59.133317 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:44:59.133317 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:44:59.133317 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15d4a46e-9504-4897-918d-39aafc20d22a could not be found. Aug 24 11:44:59.133317 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:44:59.133317 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:44:59.133317 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:44:59.133317 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:44:59.133317 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:44:59.133317 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:44:59.133317 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:44:59.133317 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:44:59.133317 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15d4a46e-9504-4897-918d-39aafc20d22a could not be found. Aug 24 11:44:59.133317 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:44:59.134834 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-86310ab5-953f-4a8b-aa71-cf6e19933663 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Returning 404 to user: Instance 15d4a46e-9504-4897-918d-39aafc20d22a could not be found. {{(pid=124770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:44:59.134834 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-86310ab5-953f-4a8b-aa71-cf6e19933663 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] 10.222.0.84 "DELETE /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a" status: 404 len: 111 microversion: 2.1 time: 0.045241 Aug 24 11:44:59.134834 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 565/1168] 10.222.0.84 () {58 vars in 1239 bytes} [Wed Aug 24 11:44:59 2022] DELETE /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:44:59.142372 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-28a9e1a1-f599-487a-b824-b32b18ed0726 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:44:59.142977 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-28a9e1a1-f599-487a-b824-b32b18ed0726 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] [instance: 15d4a46e-9504-4897-918d-39aafc20d22a] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:44:59.150720 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-28a9e1a1-f599-487a-b824-b32b18ed0726 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:59.153684 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-28a9e1a1-f599-487a-b824-b32b18ed0726 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:59.153684 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-28a9e1a1-f599-487a-b824-b32b18ed0726 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:59.153684 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-28a9e1a1-f599-487a-b824-b32b18ed0726 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:59.153684 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-28a9e1a1-f599-487a-b824-b32b18ed0726 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:59.155485 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-28a9e1a1-f599-487a-b824-b32b18ed0726 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:59.176168 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.wsgi [None req-28a9e1a1-f599-487a-b824-b32b18ed0726 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] HTTP exception thrown: Instance 15d4a46e-9504-4897-918d-39aafc20d22a could not be found. Aug 24 11:44:59.178333 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-28a9e1a1-f599-487a-b824-b32b18ed0726 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Request method failure captured: Aug 24 11:44:59.178333 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: request: GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a HTTP/1.1 Aug 24 11:44:59.178333 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Accept: application/json Aug 24 11:44:59.178333 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Accept-Encoding: identity Aug 24 11:44:59.178333 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Connection: close Aug 24 11:44:59.178333 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Content-Length: 0 Aug 24 11:44:59.178333 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Content-Type: application/json Aug 24 11:44:59.178333 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Host: 10.222.0.84 Aug 24 11:44:59.178333 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Openstack-System-Scope: None Aug 24 11:44:59.178333 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: User-Agent: python-urllib3/1.26.11 Aug 24 11:44:59.178333 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Auth-Token: gAAAAABjBgwhMRA2cc0ufptdwp2_h4V9wxgyG8HRbsXs7voMg4kkNvxs16qRO7dqeMBpzWdJlNOxoL6pRb4rQbp4bL_LJMOsmXfsJ9Cn4wHtcwCJR4buyH1_orEHcIHlFzsC1aopD-eGByxqvTpBRnq6aVvXi5uMcj80D-MqlnO_9B15eXvtaFs Aug 24 11:44:59.178333 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Domain-Id: None Aug 24 11:44:59.178333 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Domain-Name: None Aug 24 11:44:59.178333 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Identity-Status: Confirmed Aug 24 11:44:59.178333 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Is-Admin-Project: True Aug 24 11:44:59.178333 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Project-Domain-Id: default Aug 24 11:44:59.178333 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Project-Domain-Name: Default Aug 24 11:44:59.178333 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Project-Id: ecec6d0c155f4d658197c4779ab9ffce Aug 24 11:44:59.178333 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Project-Name: tempest-AttachVolumeTestJSON-1126541934 Aug 24 11:44:59.178333 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Role: reader,member Aug 24 11:44:59.178333 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Roles: reader,member Aug 24 11:44:59.183765 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/volume/v3/ecec6d0c155f4d658197c4779ab9ffce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/volume/v3/ecec6d0c155f4d658197c4779ab9ffce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/compute/v2/ecec6d0c155f4d658197c4779ab9ffce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84:8080/v1/AUTH_ecec6d0c155f4d658197c4779ab9ffce", "adminURL": "http://10.222.0.84:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/placement"}]}] Aug 24 11:44:59.183765 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Tenant: tempest-AttachVolumeTestJSON-1126541934 Aug 24 11:44:59.183765 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Tenant-Id: ecec6d0c155f4d658197c4779ab9ffce Aug 24 11:44:59.183765 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1126541934 Aug 24 11:44:59.183765 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-User: tempest-AttachVolumeTestJSON-1126541934-project Aug 24 11:44:59.183765 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-User-Domain-Id: default Aug 24 11:44:59.183765 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-User-Domain-Name: Default Aug 24 11:44:59.183765 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-User-Id: 0031939e16194f63b99e6f27f700fa8c Aug 24 11:44:59.183765 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-User-Name: tempest-AttachVolumeTestJSON-1126541934-project Aug 24 11:44:59.183765 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: method: > Aug 24 11:44:59.183765 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: exception: Instance 15d4a46e-9504-4897-918d-39aafc20d22a could not be found. Aug 24 11:44:59.183765 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: action_args: {'id': '15d4a46e-9504-4897-918d-39aafc20d22a'} Aug 24 11:44:59.184585 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:44:59.184585 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:44:59.184585 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:44:59.184585 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:44:59.184585 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:44:59.184585 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:44:59.184585 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:44:59.184585 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:44:59.184585 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:44:59.184585 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:44:59.184585 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15d4a46e-9504-4897-918d-39aafc20d22a could not be found. Aug 24 11:44:59.184585 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Aug 24 11:44:59.184585 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:44:59.184585 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Aug 24 11:44:59.184585 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:44:59.184585 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:44:59.184585 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:44:59.184585 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:44:59.184585 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:44:59.184585 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:44:59.187095 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:44:59.187095 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:44:59.187095 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:44:59.187095 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:44:59.187095 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:44:59.187095 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:44:59.187095 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:44:59.187095 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15d4a46e-9504-4897-918d-39aafc20d22a could not be found. Aug 24 11:44:59.187095 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Aug 24 11:44:59.187095 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:44:59.187095 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Aug 24 11:44:59.187095 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:44:59.187095 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:44:59.187095 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:44:59.187095 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:44:59.187095 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:44:59.187095 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15d4a46e-9504-4897-918d-39aafc20d22a could not be found. Aug 24 11:44:59.187095 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Aug 24 11:44:59.192295 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-28a9e1a1-f599-487a-b824-b32b18ed0726 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] Returning 404 to user: Instance 15d4a46e-9504-4897-918d-39aafc20d22a could not be found. {{(pid=124769) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:44:59.192295 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-28a9e1a1-f599-487a-b824-b32b18ed0726 tempest-AttachVolumeTestJSON-1126541934 tempest-AttachVolumeTestJSON-1126541934-project] 10.222.0.84 "GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a" status: 404 len: 111 microversion: 2.1 time: 0.042474 Aug 24 11:44:59.192295 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 604/1169] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:44:59 2022] GET /compute/v2.1/servers/15d4a46e-9504-4897-918d-39aafc20d22a => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:44:59.631323 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-cd4a1577-2286-4084-95d7-780c087f219a tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:44:59.631983 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-cd4a1577-2286-4084-95d7-780c087f219a tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] [instance: 52f331ec-d0ce-4940-8430-11e9b6732cfe] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:44:59.641913 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-cd4a1577-2286-4084-95d7-780c087f219a tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:59.642652 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-cd4a1577-2286-4084-95d7-780c087f219a tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:59.643372 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-cd4a1577-2286-4084-95d7-780c087f219a tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:59.644196 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-cd4a1577-2286-4084-95d7-780c087f219a tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:59.644780 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-cd4a1577-2286-4084-95d7-780c087f219a tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:59.645297 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-cd4a1577-2286-4084-95d7-780c087f219a tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:45:00.016278 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-cd4a1577-2286-4084-95d7-780c087f219a tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac5dffd3204413a8834d05db267c3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31998483af514a1a8f87ab761d5cf3ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:45:00.025363 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-cd4a1577-2286-4084-95d7-780c087f219a tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] 10.222.0.84 "GET /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe" status: 200 len: 1567 microversion: 2.1 time: 0.397972 Aug 24 11:45:00.026283 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 566/1170] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:44:59 2022] GET /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe => generated 1567 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:45:01.047974 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-89669783-2377-40c8-bd6c-0eb0cc1c5d59 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:45:01.048769 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-89669783-2377-40c8-bd6c-0eb0cc1c5d59 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] [instance: 52f331ec-d0ce-4940-8430-11e9b6732cfe] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:45:01.056175 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-89669783-2377-40c8-bd6c-0eb0cc1c5d59 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:45:01.057012 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-89669783-2377-40c8-bd6c-0eb0cc1c5d59 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:45:01.057757 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-89669783-2377-40c8-bd6c-0eb0cc1c5d59 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:45:01.058822 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-89669783-2377-40c8-bd6c-0eb0cc1c5d59 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:45:01.059357 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-89669783-2377-40c8-bd6c-0eb0cc1c5d59 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:45:01.059879 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-89669783-2377-40c8-bd6c-0eb0cc1c5d59 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:45:01.263956 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-89669783-2377-40c8-bd6c-0eb0cc1c5d59 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac5dffd3204413a8834d05db267c3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31998483af514a1a8f87ab761d5cf3ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:45:01.273239 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-89669783-2377-40c8-bd6c-0eb0cc1c5d59 tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] 10.222.0.84 "GET /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe" status: 200 len: 1567 microversion: 2.1 time: 0.230155 Aug 24 11:45:01.273815 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 605/1171] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:45:01 2022] GET /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe => generated 1567 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:45:01.841559 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [req-010d3bba-35b1-4304-a160-c1b4f723a8c3 req-56d05745-aff1-4c60-b671-44d8025e1265 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52f331ec-d0ce-4940-8430-11e9b6732cfe", "name": "network-vif-deleted", "tag": "2922ba9f-42e7-4aaf-a9d1-30bc6103646f"}]} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:45:01.852211 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-010d3bba-35b1-4304-a160-c1b4f723a8c3 req-56d05745-aff1-4c60-b671-44d8025e1265 service nova] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:45:01.856186 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-010d3bba-35b1-4304-a160-c1b4f723a8c3 req-56d05745-aff1-4c60-b671-44d8025e1265 service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:45:01.856186 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-010d3bba-35b1-4304-a160-c1b4f723a8c3 req-56d05745-aff1-4c60-b671-44d8025e1265 service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:45:01.865996 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.compute.server_external_events [req-010d3bba-35b1-4304-a160-c1b4f723a8c3 req-56d05745-aff1-4c60-b671-44d8025e1265 service nova] Creating event network-vif-deleted:2922ba9f-42e7-4aaf-a9d1-30bc6103646f for instance 52f331ec-d0ce-4940-8430-11e9b6732cfe on hv-cinder-85427 Aug 24 11:45:01.871430 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [req-010d3bba-35b1-4304-a160-c1b4f723a8c3 req-56d05745-aff1-4c60-b671-44d8025e1265 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034478 Aug 24 11:45:01.872040 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 567/1172] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Aug 24 11:45:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:45:02.296254 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-f02ee0ae-88ed-4d3c-9678-40ae700ed6fd tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:45:02.296881 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-f02ee0ae-88ed-4d3c-9678-40ae700ed6fd tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] [instance: 52f331ec-d0ce-4940-8430-11e9b6732cfe] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:45:02.304785 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f02ee0ae-88ed-4d3c-9678-40ae700ed6fd tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:45:02.305704 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f02ee0ae-88ed-4d3c-9678-40ae700ed6fd tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:45:02.306150 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f02ee0ae-88ed-4d3c-9678-40ae700ed6fd tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:45:02.306876 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f02ee0ae-88ed-4d3c-9678-40ae700ed6fd tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:45:02.307356 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f02ee0ae-88ed-4d3c-9678-40ae700ed6fd tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:45:02.307787 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f02ee0ae-88ed-4d3c-9678-40ae700ed6fd tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:45:02.423858 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-f02ee0ae-88ed-4d3c-9678-40ae700ed6fd tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac5dffd3204413a8834d05db267c3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31998483af514a1a8f87ab761d5cf3ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:45:02.436659 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-f02ee0ae-88ed-4d3c-9678-40ae700ed6fd tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] 10.222.0.84 "GET /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe" status: 200 len: 1219 microversion: 2.1 time: 0.144772 Aug 24 11:45:02.437589 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 606/1173] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:45:02 2022] GET /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe => generated 1219 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:45:03.471619 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-3a897886-c492-4060-af25-6d994e9f996f tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:45:03.472879 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-3a897886-c492-4060-af25-6d994e9f996f tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] [instance: 52f331ec-d0ce-4940-8430-11e9b6732cfe] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:45:03.484039 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-3a897886-c492-4060-af25-6d994e9f996f tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:45:03.484437 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-3a897886-c492-4060-af25-6d994e9f996f tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:45:03.484917 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-3a897886-c492-4060-af25-6d994e9f996f tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:45:03.485655 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-3a897886-c492-4060-af25-6d994e9f996f tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:45:03.486148 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-3a897886-c492-4060-af25-6d994e9f996f tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:45:03.486762 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-3a897886-c492-4060-af25-6d994e9f996f tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:45:03.527458 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-3a897886-c492-4060-af25-6d994e9f996f tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:45:03.527961 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-3a897886-c492-4060-af25-6d994e9f996f tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:45:03.528408 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-3a897886-c492-4060-af25-6d994e9f996f tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:45:03.529457 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.objects.instance [None req-3a897886-c492-4060-af25-6d994e9f996f tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lazy-loading 'fault' on Instance uuid 52f331ec-d0ce-4940-8430-11e9b6732cfe {{(pid=124770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:45:03.598401 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-3a897886-c492-4060-af25-6d994e9f996f tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac5dffd3204413a8834d05db267c3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31998483af514a1a8f87ab761d5cf3ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:45:03.614846 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-3a897886-c492-4060-af25-6d994e9f996f tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] 10.222.0.84 "GET /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe" status: 200 len: 1224 microversion: 2.1 time: 0.151718 Aug 24 11:45:03.615799 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 568/1174] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:45:03 2022] GET /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe => generated 1224 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:45:04.638095 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-83087843-0214-4cc8-b729-4e44af66964e tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:45:04.640498 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-83087843-0214-4cc8-b729-4e44af66964e tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] [instance: 52f331ec-d0ce-4940-8430-11e9b6732cfe] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:45:04.645196 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG dbcounter [-] [124769] Writing DB stats nova_api:SELECT=60 {{(pid=124769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:45:04.646714 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-83087843-0214-4cc8-b729-4e44af66964e tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:45:04.647379 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-83087843-0214-4cc8-b729-4e44af66964e tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:45:04.648126 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-83087843-0214-4cc8-b729-4e44af66964e tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:45:04.649142 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-83087843-0214-4cc8-b729-4e44af66964e tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:45:04.649596 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-83087843-0214-4cc8-b729-4e44af66964e tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:45:04.650015 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-83087843-0214-4cc8-b729-4e44af66964e tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:45:04.666933 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.wsgi [None req-83087843-0214-4cc8-b729-4e44af66964e tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] HTTP exception thrown: Instance 52f331ec-d0ce-4940-8430-11e9b6732cfe could not be found. Aug 24 11:45:04.668858 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-83087843-0214-4cc8-b729-4e44af66964e tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Request method failure captured: Aug 24 11:45:04.668858 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: request: GET /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe HTTP/1.1 Aug 24 11:45:04.668858 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Accept: application/json Aug 24 11:45:04.668858 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Accept-Encoding: identity Aug 24 11:45:04.668858 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Connection: close Aug 24 11:45:04.668858 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Content-Length: 0 Aug 24 11:45:04.668858 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Content-Type: application/json Aug 24 11:45:04.668858 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Host: 10.222.0.84 Aug 24 11:45:04.668858 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Openstack-System-Scope: None Aug 24 11:45:04.668858 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: User-Agent: python-urllib3/1.26.11 Aug 24 11:45:04.668858 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Auth-Token: gAAAAABjBg2a_4ijG3OO3TN7h9Lz1I7eZ3FOMtxAM3bBbDNLT70utLY8lkssO1E2uhF1dk3XWEUuymOyvVVtfv4YmuCkj3D7969nuliBKk74k95_dFOoDe-jYppOmv3WWZ8LTFtCETjqckA0Y7k_xNSZVa8hfKgr389PQ_c95Rlk4OzxQH4sTzM Aug 24 11:45:04.668858 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Domain-Id: None Aug 24 11:45:04.668858 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Domain-Name: None Aug 24 11:45:04.668858 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Identity-Status: Confirmed Aug 24 11:45:04.668858 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Is-Admin-Project: True Aug 24 11:45:04.668858 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Project-Domain-Id: default Aug 24 11:45:04.668858 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Project-Domain-Name: Default Aug 24 11:45:04.668858 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Project-Id: 31998483af514a1a8f87ab761d5cf3ba Aug 24 11:45:04.668858 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Project-Name: tempest-TestShelveInstance-1436344128 Aug 24 11:45:04.668858 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Role: reader,member Aug 24 11:45:04.668858 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Roles: reader,member Aug 24 11:45:04.670624 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/volume/v3/31998483af514a1a8f87ab761d5cf3ba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/volume/v3/31998483af514a1a8f87ab761d5cf3ba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/compute/v2/31998483af514a1a8f87ab761d5cf3ba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84:8080/v1/AUTH_31998483af514a1a8f87ab761d5cf3ba", "adminURL": "http://10.222.0.84:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/placement"}]}] Aug 24 11:45:04.670624 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Tenant: tempest-TestShelveInstance-1436344128 Aug 24 11:45:04.670624 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Tenant-Id: 31998483af514a1a8f87ab761d5cf3ba Aug 24 11:45:04.670624 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Tenant-Name: tempest-TestShelveInstance-1436344128 Aug 24 11:45:04.670624 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-User: tempest-TestShelveInstance-1436344128-project Aug 24 11:45:04.670624 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-User-Domain-Id: default Aug 24 11:45:04.670624 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-User-Domain-Name: Default Aug 24 11:45:04.670624 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-User-Id: 7ac5dffd3204413a8834d05db267c3ab Aug 24 11:45:04.670624 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-User-Name: tempest-TestShelveInstance-1436344128-project Aug 24 11:45:04.670624 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: method: > Aug 24 11:45:04.670624 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: exception: Instance 52f331ec-d0ce-4940-8430-11e9b6732cfe could not be found. Aug 24 11:45:04.670624 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: action_args: {'id': '52f331ec-d0ce-4940-8430-11e9b6732cfe'} Aug 24 11:45:04.671683 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:45:04.671683 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:45:04.671683 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:45:04.671683 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:45:04.671683 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:45:04.671683 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:45:04.671683 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:45:04.671683 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:45:04.671683 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:45:04.671683 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:45:04.671683 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52f331ec-d0ce-4940-8430-11e9b6732cfe could not be found. Aug 24 11:45:04.671683 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Aug 24 11:45:04.671683 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:45:04.671683 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Aug 24 11:45:04.671683 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:45:04.671683 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:45:04.671683 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:45:04.671683 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:45:04.671683 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:45:04.671683 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:45:04.673674 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:45:04.673674 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:45:04.673674 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:45:04.673674 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:45:04.673674 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:45:04.673674 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:45:04.673674 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:45:04.673674 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52f331ec-d0ce-4940-8430-11e9b6732cfe could not be found. Aug 24 11:45:04.673674 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Aug 24 11:45:04.673674 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:45:04.673674 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Aug 24 11:45:04.673674 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:45:04.673674 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:45:04.673674 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:45:04.673674 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:45:04.673674 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:45:04.673674 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52f331ec-d0ce-4940-8430-11e9b6732cfe could not be found. Aug 24 11:45:04.673674 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Aug 24 11:45:04.675729 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-83087843-0214-4cc8-b729-4e44af66964e tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Returning 404 to user: Instance 52f331ec-d0ce-4940-8430-11e9b6732cfe could not be found. {{(pid=124769) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:45:04.676699 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-83087843-0214-4cc8-b729-4e44af66964e tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] 10.222.0.84 "GET /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe" status: 404 len: 111 microversion: 2.1 time: 0.043033 Aug 24 11:45:04.680701 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 607/1175] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:45:04 2022] GET /compute/v2.1/servers/52f331ec-d0ce-4940-8430-11e9b6732cfe => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:45:05.046711 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-2b06de6f-0720-47af-85fb-a0319528ef0d tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] Calling method '.version_select at 0x7f0e2a4a9550>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:45:05.208534 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-2b06de6f-0720-47af-85fb-a0319528ef0d tempest-TestShelveInstance-1436344128 tempest-TestShelveInstance-1436344128-project] 10.222.0.84 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1778781973" status: 202 len: 0 microversion: 2.1 time: 0.165975 Aug 24 11:45:05.209456 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 569/1176] 10.222.0.84 () {58 vars in 1254 bytes} [Wed Aug 24 11:45:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1778781973 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:45:07.111808 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-6fab92e1-036f-4188-babd-2a0cf782a682 tempest-VolumesGetTestJSON-583519393 tempest-VolumesGetTestJSON-583519393-project] Action: 'create', calling method: .version_select at 0x7f0e2a5d4af0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1895260936", "metadata": {"Type": "work"}}} {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:45:08.026671 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-6fab92e1-036f-4188-babd-2a0cf782a682 tempest-VolumesGetTestJSON-583519393 tempest-VolumesGetTestJSON-583519393-project] 10.222.0.84 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 1.051305 Aug 24 11:45:08.027288 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 608/1177] 10.222.0.84 () {60 vars in 1156 bytes} [Wed Aug 24 11:45:06 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 1053 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Aug 24 11:45:08.039753 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-2ef681b7-168c-4b79-af6a-02c9ce114fb6 tempest-VolumesGetTestJSON-583519393 tempest-VolumesGetTestJSON-583519393-project] Calling method '.version_select at 0x7f0e2edd1dc0>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:45:08.096075 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-2ef681b7-168c-4b79-af6a-02c9ce114fb6 tempest-VolumesGetTestJSON-583519393 tempest-VolumesGetTestJSON-583519393-project] 10.222.0.84 "GET /compute/v2.1/os-volumes/67a7b427-57a5-44c9-81e2-084ec51a0a78" status: 200 len: 353 microversion: 2.1 time: 0.060012 Aug 24 11:45:08.097040 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 570/1178] 10.222.0.84 () {58 vars in 1245 bytes} [Wed Aug 24 11:45:08 2022] GET /compute/v2.1/os-volumes/67a7b427-57a5-44c9-81e2-084ec51a0a78 => generated 353 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:45:09.114160 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-194065cc-4906-413e-81f1-060b58aadc85 tempest-VolumesGetTestJSON-583519393 tempest-VolumesGetTestJSON-583519393-project] Calling method '.version_select at 0x7f0e2a6178b0>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:45:09.182323 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-194065cc-4906-413e-81f1-060b58aadc85 tempest-VolumesGetTestJSON-583519393 tempest-VolumesGetTestJSON-583519393-project] 10.222.0.84 "GET /compute/v2.1/os-volumes/67a7b427-57a5-44c9-81e2-084ec51a0a78" status: 200 len: 353 microversion: 2.1 time: 0.067757 Aug 24 11:45:09.182323 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 609/1179] 10.222.0.84 () {58 vars in 1245 bytes} [Wed Aug 24 11:45:09 2022] GET /compute/v2.1/os-volumes/67a7b427-57a5-44c9-81e2-084ec51a0a78 => generated 353 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:45:10.190715 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-486357d9-1bf5-4b56-b3f9-2e5116191059 tempest-VolumesGetTestJSON-583519393 tempest-VolumesGetTestJSON-583519393-project] Calling method '.version_select at 0x7f0e2a654160>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:45:10.241887 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-486357d9-1bf5-4b56-b3f9-2e5116191059 tempest-VolumesGetTestJSON-583519393 tempest-VolumesGetTestJSON-583519393-project] 10.222.0.84 "GET /compute/v2.1/os-volumes/67a7b427-57a5-44c9-81e2-084ec51a0a78" status: 200 len: 354 microversion: 2.1 time: 0.055617 Aug 24 11:45:10.242459 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 571/1180] 10.222.0.84 () {58 vars in 1245 bytes} [Wed Aug 24 11:45:10 2022] GET /compute/v2.1/os-volumes/67a7b427-57a5-44c9-81e2-084ec51a0a78 => generated 354 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:45:10.256392 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-aa8f4635-e2fb-4a38-a159-446e49557017 tempest-VolumesGetTestJSON-583519393 tempest-VolumesGetTestJSON-583519393-project] Calling method '.version_select at 0x7f0e2a5d4430>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:45:10.308538 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-aa8f4635-e2fb-4a38-a159-446e49557017 tempest-VolumesGetTestJSON-583519393 tempest-VolumesGetTestJSON-583519393-project] 10.222.0.84 "GET /compute/v2.1/os-volumes/67a7b427-57a5-44c9-81e2-084ec51a0a78" status: 200 len: 354 microversion: 2.1 time: 0.056726 Aug 24 11:45:10.309137 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 610/1181] 10.222.0.84 () {58 vars in 1245 bytes} [Wed Aug 24 11:45:10 2022] GET /compute/v2.1/os-volumes/67a7b427-57a5-44c9-81e2-084ec51a0a78 => generated 354 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:45:10.327742 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-54e41fce-b926-4f6c-8713-cdc0777e054d tempest-VolumesGetTestJSON-583519393 tempest-VolumesGetTestJSON-583519393-project] Calling method '.version_select at 0x7f0e2a5f31f0>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:45:10.629932 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-54e41fce-b926-4f6c-8713-cdc0777e054d tempest-VolumesGetTestJSON-583519393 tempest-VolumesGetTestJSON-583519393-project] 10.222.0.84 "DELETE /compute/v2.1/os-volumes/67a7b427-57a5-44c9-81e2-084ec51a0a78" status: 202 len: 0 microversion: 2.1 time: 0.307059 Aug 24 11:45:10.630527 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 572/1182] 10.222.0.84 () {58 vars in 1248 bytes} [Wed Aug 24 11:45:10 2022] DELETE /compute/v2.1/os-volumes/67a7b427-57a5-44c9-81e2-084ec51a0a78 => generated 0 bytes in 308 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:45:10.639572 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-b593cfec-7565-46fb-b93e-333590bab1bf tempest-VolumesGetTestJSON-583519393 tempest-VolumesGetTestJSON-583519393-project] Calling method '.version_select at 0x7f0e2a63a280>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:45:10.694926 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-b593cfec-7565-46fb-b93e-333590bab1bf tempest-VolumesGetTestJSON-583519393 tempest-VolumesGetTestJSON-583519393-project] 10.222.0.84 "GET /compute/v2.1/os-volumes/67a7b427-57a5-44c9-81e2-084ec51a0a78" status: 200 len: 353 microversion: 2.1 time: 0.059925 Aug 24 11:45:10.695586 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 611/1183] 10.222.0.84 () {58 vars in 1245 bytes} [Wed Aug 24 11:45:10 2022] GET /compute/v2.1/os-volumes/67a7b427-57a5-44c9-81e2-084ec51a0a78 => generated 353 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:45:11.711752 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-5e96f743-2634-4091-8a4b-5f32a7e27530 tempest-VolumesGetTestJSON-583519393 tempest-VolumesGetTestJSON-583519393-project] Calling method '.version_select at 0x7f0e2a58b5e0>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:45:11.746284 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.wsgi [None req-5e96f743-2634-4091-8a4b-5f32a7e27530 tempest-VolumesGetTestJSON-583519393 tempest-VolumesGetTestJSON-583519393-project] HTTP exception thrown: Volume 67a7b427-57a5-44c9-81e2-084ec51a0a78 could not be found. Aug 24 11:45:11.746284 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-5e96f743-2634-4091-8a4b-5f32a7e27530 tempest-VolumesGetTestJSON-583519393 tempest-VolumesGetTestJSON-583519393-project] Request method failure captured: Aug 24 11:45:11.746284 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: request: GET /compute/v2.1/os-volumes/67a7b427-57a5-44c9-81e2-084ec51a0a78 HTTP/1.1 Aug 24 11:45:11.746284 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Accept: application/json Aug 24 11:45:11.746284 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Accept-Encoding: identity Aug 24 11:45:11.746284 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Connection: close Aug 24 11:45:11.746284 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Content-Length: 0 Aug 24 11:45:11.746284 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Content-Type: application/json Aug 24 11:45:11.746284 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Host: 10.222.0.84 Aug 24 11:45:11.746284 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Openstack-System-Scope: None Aug 24 11:45:11.746284 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: User-Agent: python-urllib3/1.26.11 Aug 24 11:45:11.746284 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Auth-Token: gAAAAABjBg9C4jVShI6X8u5WVw17khqmk49Du6wl7JqEnOv_j5QhIAFjoN9czc0GFCUPWv3zdxXExqdJi22NFE6YTR0Haw9MDstQWfJYF1r1N42r5Lnellk82psKLdLEV2GVZcvCNB3LhDT7vTpeHNVOAqMjKNFLtbc_pTPUDWWbbFjbIjN8_Cg Aug 24 11:45:11.746284 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Domain-Id: None Aug 24 11:45:11.746284 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Domain-Name: None Aug 24 11:45:11.746284 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Identity-Status: Confirmed Aug 24 11:45:11.746284 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Is-Admin-Project: True Aug 24 11:45:11.746284 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Project-Domain-Id: default Aug 24 11:45:11.746284 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Project-Domain-Name: Default Aug 24 11:45:11.746284 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Project-Id: 51a4be7fb0b94dafaf9f583050eb1508 Aug 24 11:45:11.746284 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Project-Name: tempest-VolumesGetTestJSON-583519393 Aug 24 11:45:11.746284 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Role: reader,member Aug 24 11:45:11.746284 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Roles: reader,member Aug 24 11:45:11.748929 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/volume/v3/51a4be7fb0b94dafaf9f583050eb1508"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/volume/v3/51a4be7fb0b94dafaf9f583050eb1508"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/compute/v2/51a4be7fb0b94dafaf9f583050eb1508"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84:8080/v1/AUTH_51a4be7fb0b94dafaf9f583050eb1508", "adminURL": "http://10.222.0.84:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/placement"}]}] Aug 24 11:45:11.748929 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Tenant: tempest-VolumesGetTestJSON-583519393 Aug 24 11:45:11.748929 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Tenant-Id: 51a4be7fb0b94dafaf9f583050eb1508 Aug 24 11:45:11.748929 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Tenant-Name: tempest-VolumesGetTestJSON-583519393 Aug 24 11:45:11.748929 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User: tempest-VolumesGetTestJSON-583519393-project Aug 24 11:45:11.748929 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User-Domain-Id: default Aug 24 11:45:11.748929 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User-Domain-Name: Default Aug 24 11:45:11.748929 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User-Id: 3aeb2625b5514e9fb9ca8dbc3097d3f6 Aug 24 11:45:11.748929 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User-Name: tempest-VolumesGetTestJSON-583519393-project Aug 24 11:45:11.748929 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: method: Aug 24 11:45:11.748929 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: exception: Volume 67a7b427-57a5-44c9-81e2-084ec51a0a78 could not be found. Aug 24 11:45:11.748929 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: action_args: {'id': '67a7b427-57a5-44c9-81e2-084ec51a0a78'} Aug 24 11:45:11.748929 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:45:11.750075 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:45:11.750075 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 11:45:11.750075 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 11:45:11.750075 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 11:45:11.750075 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 11:45:11.750075 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 11:45:11.750075 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 11:45:11.750075 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 11:45:11.750075 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 11:45:11.750075 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 11:45:11.750075 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 11:45:11.750075 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 11:45:11.750075 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 11:45:11.750075 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 11:45:11.750075 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 11:45:11.750075 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 67a7b427-57a5-44c9-81e2-084ec51a0a78 could not be found. (HTTP 404) (Request-ID: req-c86c3869-eef4-4909-838e-385242cbb7ce) Aug 24 11:45:11.750075 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:45:11.750075 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:45:11.750075 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:45:11.751395 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:45:11.751395 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 11:45:11.751395 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 11:45:11.751395 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 11:45:11.751395 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 11:45:11.751395 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 11:45:11.751395 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 11:45:11.751395 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 11:45:11.751395 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 11:45:11.751395 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 11:45:11.751395 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 11:45:11.751395 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 11:45:11.751395 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 11:45:11.751395 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 11:45:11.751395 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 11:45:11.751395 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 11:45:11.751395 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 11:45:11.751395 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 11:45:11.751395 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 11:45:11.752924 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 11:45:11.752924 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 11:45:11.752924 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 11:45:11.752924 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 11:45:11.752924 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 67a7b427-57a5-44c9-81e2-084ec51a0a78 could not be found. Aug 24 11:45:11.752924 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:45:11.752924 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:45:11.752924 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:45:11.752924 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:45:11.752924 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:45:11.752924 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:45:11.752924 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:45:11.752924 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:45:11.752924 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 11:45:11.752924 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 11:45:11.752924 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:45:11.752924 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:45:11.752924 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 11:45:11.752924 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:45:11.754945 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 67a7b427-57a5-44c9-81e2-084ec51a0a78 could not be found. Aug 24 11:45:11.754945 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:45:11.754945 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:45:11.754945 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:45:11.754945 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:45:11.754945 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:45:11.754945 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:45:11.754945 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:45:11.754945 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:45:11.754945 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 67a7b427-57a5-44c9-81e2-084ec51a0a78 could not be found. Aug 24 11:45:11.754945 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:45:11.754945 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-5e96f743-2634-4091-8a4b-5f32a7e27530 tempest-VolumesGetTestJSON-583519393 tempest-VolumesGetTestJSON-583519393-project] Returning 404 to user: Volume 67a7b427-57a5-44c9-81e2-084ec51a0a78 could not be found. {{(pid=124770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:45:11.754945 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-5e96f743-2634-4091-8a4b-5f32a7e27530 tempest-VolumesGetTestJSON-583519393 tempest-VolumesGetTestJSON-583519393-project] 10.222.0.84 "GET /compute/v2.1/os-volumes/67a7b427-57a5-44c9-81e2-084ec51a0a78" status: 404 len: 109 microversion: 2.1 time: 0.039022 Aug 24 11:45:11.754945 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 573/1184] 10.222.0.84 () {58 vars in 1245 bytes} [Wed Aug 24 11:45:11 2022] GET /compute/v2.1/os-volumes/67a7b427-57a5-44c9-81e2-084ec51a0a78 => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:45:38.779651 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG dbcounter [-] [124769] Writing DB stats nova_cell1:SELECT=57 {{(pid=124769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:45:38.780551 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG dbcounter [-] [124769] Writing DB stats nova_api:SELECT=1 {{(pid=124769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:45:38.785469 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-bd5ce06e-ada2-410f-976a-d8f5174acba9 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:45:38.786154 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-bd5ce06e-ada2-410f-976a-d8f5174acba9 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: b86b3db2-2f76-464d-b087-39deddd5a48e] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:45:38.794633 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-bd5ce06e-ada2-410f-976a-d8f5174acba9 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:45:38.795555 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-bd5ce06e-ada2-410f-976a-d8f5174acba9 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:45:38.795555 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-bd5ce06e-ada2-410f-976a-d8f5174acba9 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:45:38.796304 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-bd5ce06e-ada2-410f-976a-d8f5174acba9 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:45:38.796964 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-bd5ce06e-ada2-410f-976a-d8f5174acba9 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:45:38.797273 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-bd5ce06e-ada2-410f-976a-d8f5174acba9 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:45:38.827839 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-bd5ce06e-ada2-410f-976a-d8f5174acba9 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "GET /compute/v2.1/servers/b86b3db2-2f76-464d-b087-39deddd5a48e/ips" status: 200 len: 150 microversion: 2.1 time: 0.049564 Aug 24 11:45:38.828427 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 612/1185] 10.222.0.84 () {58 vars in 1248 bytes} [Wed Aug 24 11:45:38 2022] GET /compute/v2.1/servers/b86b3db2-2f76-464d-b087-39deddd5a48e/ips => generated 150 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:45:41.857383 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:45:41.858159 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:45:41.862342 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-b6be4b1c-6ace-4123-b071-221483feb0c0 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4a30df52-7efc-4dc3-ad9a-0b3e1efa80c6"}} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:45:41.864671 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-b6be4b1c-6ace-4123-b071-221483feb0c0 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: b86b3db2-2f76-464d-b087-39deddd5a48e] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:45:41.871624 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b6be4b1c-6ace-4123-b071-221483feb0c0 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:45:41.872151 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b6be4b1c-6ace-4123-b071-221483feb0c0 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:45:41.872675 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b6be4b1c-6ace-4123-b071-221483feb0c0 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:45:41.873509 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b6be4b1c-6ace-4123-b071-221483feb0c0 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:45:41.874090 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b6be4b1c-6ace-4123-b071-221483feb0c0 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:45:41.874388 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b6be4b1c-6ace-4123-b071-221483feb0c0 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:45:42.921910 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-b6be4b1c-6ace-4123-b071-221483feb0c0 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "POST /compute/v2.1/servers/b86b3db2-2f76-464d-b087-39deddd5a48e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.066088 Aug 24 11:45:42.922569 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 574/1186] 10.222.0.84 () {60 vars in 1323 bytes} [Wed Aug 24 11:45:41 2022] POST /compute/v2.1/servers/b86b3db2-2f76-464d-b087-39deddd5a48e/os-volume_attachments => generated 194 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:45:47.261085 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-cbbde250-8d02-4e16-bbe5-d4495da5babd tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:45:47.263370 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-cbbde250-8d02-4e16-bbe5-d4495da5babd tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: bf04b523-cedf-4e68-b77f-f6039d0de59c] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:45:47.270074 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-cbbde250-8d02-4e16-bbe5-d4495da5babd tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:45:47.274865 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-cbbde250-8d02-4e16-bbe5-d4495da5babd tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:45:47.274865 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-cbbde250-8d02-4e16-bbe5-d4495da5babd tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:45:47.274865 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-cbbde250-8d02-4e16-bbe5-d4495da5babd tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:45:47.274865 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-cbbde250-8d02-4e16-bbe5-d4495da5babd tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:45:47.275297 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-cbbde250-8d02-4e16-bbe5-d4495da5babd tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:45:47.302799 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-cbbde250-8d02-4e16-bbe5-d4495da5babd tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.046695 Aug 24 11:45:47.303356 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 613/1187] 10.222.0.84 () {60 vars in 1343 bytes} [Wed Aug 24 11:45:47 2022] GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:45:47.367707 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-9f0a43f5-bfd5-482c-b656-36b4bbb9b178 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:45:47.369077 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-9f0a43f5-bfd5-482c-b656-36b4bbb9b178 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: bf04b523-cedf-4e68-b77f-f6039d0de59c] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:45:47.375086 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9f0a43f5-bfd5-482c-b656-36b4bbb9b178 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:45:47.375828 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9f0a43f5-bfd5-482c-b656-36b4bbb9b178 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:45:47.376259 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9f0a43f5-bfd5-482c-b656-36b4bbb9b178 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:45:47.376986 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9f0a43f5-bfd5-482c-b656-36b4bbb9b178 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:45:47.377436 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9f0a43f5-bfd5-482c-b656-36b4bbb9b178 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:45:47.377858 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9f0a43f5-bfd5-482c-b656-36b4bbb9b178 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:45:47.403697 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-9f0a43f5-bfd5-482c-b656-36b4bbb9b178 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: bf04b523-cedf-4e68-b77f-f6039d0de59c] Going to try to terminate instance {{(pid=124770) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 11:45:47.783565 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-9f0a43f5-bfd5-482c-b656-36b4bbb9b178 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "DELETE /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c" status: 204 len: 0 microversion: 2.20 time: 0.419795 Aug 24 11:45:47.784190 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 575/1188] 10.222.0.84 () {60 vars in 1280 bytes} [Wed Aug 24 11:45:47 2022] DELETE /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c => generated 0 bytes in 422 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 11:45:47.792628 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-2c2b229a-d6d6-4be8-abf7-bea2cf1660c1 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:45:47.794329 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-2c2b229a-d6d6-4be8-abf7-bea2cf1660c1 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: bf04b523-cedf-4e68-b77f-f6039d0de59c] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:45:47.799493 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-2c2b229a-d6d6-4be8-abf7-bea2cf1660c1 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:45:47.800019 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-2c2b229a-d6d6-4be8-abf7-bea2cf1660c1 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:45:47.800458 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-2c2b229a-d6d6-4be8-abf7-bea2cf1660c1 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:45:47.801179 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-2c2b229a-d6d6-4be8-abf7-bea2cf1660c1 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:45:47.801636 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-2c2b229a-d6d6-4be8-abf7-bea2cf1660c1 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:45:47.802066 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-2c2b229a-d6d6-4be8-abf7-bea2cf1660c1 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:45:47.943588 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-2c2b229a-d6d6-4be8-abf7-bea2cf1660c1 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:45:47.953776 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-2c2b229a-d6d6-4be8-abf7-bea2cf1660c1 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:45:47.955464 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-2c2b229a-d6d6-4be8-abf7-bea2cf1660c1 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:45:47.956659 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-2c2b229a-d6d6-4be8-abf7-bea2cf1660c1 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c" status: 200 len: 1725 microversion: 2.20 time: 0.168106 Aug 24 11:45:47.957248 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 614/1189] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:45:47 2022] GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c => generated 1725 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:45:48.984767 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-65e65242-6ae0-460a-a467-a4be828b792f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:45:48.985905 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-65e65242-6ae0-460a-a467-a4be828b792f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: bf04b523-cedf-4e68-b77f-f6039d0de59c] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:45:48.995044 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-65e65242-6ae0-460a-a467-a4be828b792f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:45:48.999839 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-65e65242-6ae0-460a-a467-a4be828b792f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:45:48.999839 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-65e65242-6ae0-460a-a467-a4be828b792f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:45:48.999839 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-65e65242-6ae0-460a-a467-a4be828b792f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:45:48.999839 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-65e65242-6ae0-460a-a467-a4be828b792f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:45:49.000214 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-65e65242-6ae0-460a-a467-a4be828b792f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:45:49.144339 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-65e65242-6ae0-460a-a467-a4be828b792f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:45:49.155145 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-65e65242-6ae0-460a-a467-a4be828b792f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:45:49.155145 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-65e65242-6ae0-460a-a467-a4be828b792f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:45:49.156076 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-65e65242-6ae0-460a-a467-a4be828b792f tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c" status: 200 len: 1725 microversion: 2.20 time: 0.179139 Aug 24 11:45:49.156873 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 576/1190] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:45:48 2022] GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c => generated 1725 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:45:50.180599 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-2acd7172-a1e0-4582-9f5d-d9728618df78 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:45:50.181267 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-2acd7172-a1e0-4582-9f5d-d9728618df78 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: bf04b523-cedf-4e68-b77f-f6039d0de59c] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:45:50.188144 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-2acd7172-a1e0-4582-9f5d-d9728618df78 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:45:50.188540 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-2acd7172-a1e0-4582-9f5d-d9728618df78 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:45:50.189009 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-2acd7172-a1e0-4582-9f5d-d9728618df78 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:45:50.190378 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-2acd7172-a1e0-4582-9f5d-d9728618df78 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:45:50.190858 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-2acd7172-a1e0-4582-9f5d-d9728618df78 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:45:50.191294 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-2acd7172-a1e0-4582-9f5d-d9728618df78 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:45:50.342472 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-2acd7172-a1e0-4582-9f5d-d9728618df78 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:45:50.351481 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-2acd7172-a1e0-4582-9f5d-d9728618df78 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:45:50.353872 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-2acd7172-a1e0-4582-9f5d-d9728618df78 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:45:50.356281 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-2acd7172-a1e0-4582-9f5d-d9728618df78 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c" status: 200 len: 1725 microversion: 2.20 time: 0.179744 Aug 24 11:45:50.356914 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 615/1191] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:45:50 2022] GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c => generated 1725 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:45:51.380031 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-88777522-7d26-43dc-b814-5bd9eea07854 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:45:51.380656 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-88777522-7d26-43dc-b814-5bd9eea07854 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: bf04b523-cedf-4e68-b77f-f6039d0de59c] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:45:51.389062 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-88777522-7d26-43dc-b814-5bd9eea07854 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:45:51.389545 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-88777522-7d26-43dc-b814-5bd9eea07854 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:45:51.389974 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-88777522-7d26-43dc-b814-5bd9eea07854 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:45:51.390656 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-88777522-7d26-43dc-b814-5bd9eea07854 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:45:51.391103 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-88777522-7d26-43dc-b814-5bd9eea07854 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:45:51.391517 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-88777522-7d26-43dc-b814-5bd9eea07854 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:45:51.532542 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-88777522-7d26-43dc-b814-5bd9eea07854 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:45:51.540647 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-88777522-7d26-43dc-b814-5bd9eea07854 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:45:51.542753 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-88777522-7d26-43dc-b814-5bd9eea07854 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:45:51.544100 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-88777522-7d26-43dc-b814-5bd9eea07854 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c" status: 200 len: 1725 microversion: 2.20 time: 0.168041 Aug 24 11:45:51.544647 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 577/1192] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:45:51 2022] GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c => generated 1725 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:45:52.567948 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-22ec1fc0-1ea1-429e-8aa7-43cb8c31b991 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:45:52.568599 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-22ec1fc0-1ea1-429e-8aa7-43cb8c31b991 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: bf04b523-cedf-4e68-b77f-f6039d0de59c] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:45:52.575824 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-22ec1fc0-1ea1-429e-8aa7-43cb8c31b991 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:45:52.576312 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-22ec1fc0-1ea1-429e-8aa7-43cb8c31b991 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:45:52.576762 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-22ec1fc0-1ea1-429e-8aa7-43cb8c31b991 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:45:52.577488 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-22ec1fc0-1ea1-429e-8aa7-43cb8c31b991 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:45:52.577947 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-22ec1fc0-1ea1-429e-8aa7-43cb8c31b991 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:45:52.578373 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-22ec1fc0-1ea1-429e-8aa7-43cb8c31b991 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:45:52.712547 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-22ec1fc0-1ea1-429e-8aa7-43cb8c31b991 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:45:52.721372 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-22ec1fc0-1ea1-429e-8aa7-43cb8c31b991 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:45:52.722883 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-22ec1fc0-1ea1-429e-8aa7-43cb8c31b991 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:45:52.724053 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-22ec1fc0-1ea1-429e-8aa7-43cb8c31b991 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c" status: 200 len: 1725 microversion: 2.20 time: 0.160086 Aug 24 11:45:52.724619 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 616/1193] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:45:52 2022] GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:45:53.747746 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-8270b062-ccac-4127-8c7b-76d254a29f29 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:45:53.748335 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-8270b062-ccac-4127-8c7b-76d254a29f29 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: bf04b523-cedf-4e68-b77f-f6039d0de59c] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:45:53.755292 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8270b062-ccac-4127-8c7b-76d254a29f29 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:45:53.755770 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8270b062-ccac-4127-8c7b-76d254a29f29 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:45:53.756200 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8270b062-ccac-4127-8c7b-76d254a29f29 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:45:53.756922 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8270b062-ccac-4127-8c7b-76d254a29f29 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:45:53.757370 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8270b062-ccac-4127-8c7b-76d254a29f29 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:45:53.757787 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8270b062-ccac-4127-8c7b-76d254a29f29 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:45:53.891033 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-8270b062-ccac-4127-8c7b-76d254a29f29 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:45:53.899538 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-8270b062-ccac-4127-8c7b-76d254a29f29 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:45:53.901076 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-8270b062-ccac-4127-8c7b-76d254a29f29 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:45:53.903038 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-8270b062-ccac-4127-8c7b-76d254a29f29 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c" status: 200 len: 1725 microversion: 2.20 time: 0.159780 Aug 24 11:45:53.903689 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 578/1194] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:45:53 2022] GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 11:45:54.929618 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-c8020f25-9384-49c3-a6dd-a39281bab1cf tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:45:54.930896 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-c8020f25-9384-49c3-a6dd-a39281bab1cf tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: bf04b523-cedf-4e68-b77f-f6039d0de59c] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:45:54.939690 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-c8020f25-9384-49c3-a6dd-a39281bab1cf tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:45:54.940169 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-c8020f25-9384-49c3-a6dd-a39281bab1cf tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:45:54.940993 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-c8020f25-9384-49c3-a6dd-a39281bab1cf tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:45:54.941874 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-c8020f25-9384-49c3-a6dd-a39281bab1cf tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:45:54.942500 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-c8020f25-9384-49c3-a6dd-a39281bab1cf tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:45:54.943250 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-c8020f25-9384-49c3-a6dd-a39281bab1cf tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:45:55.012636 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [req-0f0c8ea0-f782-47b9-bde4-de3d89980326 req-31b9c1d6-009a-42e8-b516-97dbfbd68833 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf04b523-cedf-4e68-b77f-f6039d0de59c", "name": "network-vif-unplugged", "status": "completed", "tag": "c30f1b51-2afd-425d-956e-dbabf88edac3"}]} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:45:55.023809 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-0f0c8ea0-f782-47b9-bde4-de3d89980326 req-31b9c1d6-009a-42e8-b516-97dbfbd68833 service nova] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:45:55.024618 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-0f0c8ea0-f782-47b9-bde4-de3d89980326 req-31b9c1d6-009a-42e8-b516-97dbfbd68833 service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:45:55.025073 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-0f0c8ea0-f782-47b9-bde4-de3d89980326 req-31b9c1d6-009a-42e8-b516-97dbfbd68833 service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:45:55.036748 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.compute.server_external_events [req-0f0c8ea0-f782-47b9-bde4-de3d89980326 req-31b9c1d6-009a-42e8-b516-97dbfbd68833 service nova] Creating event network-vif-unplugged:c30f1b51-2afd-425d-956e-dbabf88edac3 for instance bf04b523-cedf-4e68-b77f-f6039d0de59c on hv-cinder-85427 Aug 24 11:45:55.042508 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [req-0f0c8ea0-f782-47b9-bde4-de3d89980326 req-31b9c1d6-009a-42e8-b516-97dbfbd68833 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034410 Aug 24 11:45:55.043688 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 579/1195] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Aug 24 11:45:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:45:55.215142 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-c8020f25-9384-49c3-a6dd-a39281bab1cf tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:45:55.224040 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-c8020f25-9384-49c3-a6dd-a39281bab1cf tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:45:55.225625 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-c8020f25-9384-49c3-a6dd-a39281bab1cf tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:45:55.226831 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-c8020f25-9384-49c3-a6dd-a39281bab1cf tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c" status: 200 len: 1725 microversion: 2.20 time: 0.304571 Aug 24 11:45:55.227394 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 617/1196] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:45:54 2022] GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c => generated 1725 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:45:55.939422 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [req-b3196cbf-6a0f-4d61-874a-7f96411e9d77 req-dafda4d1-a880-4694-b0cf-6c0067908d16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf04b523-cedf-4e68-b77f-f6039d0de59c", "name": "network-vif-deleted", "tag": "c30f1b51-2afd-425d-956e-dbabf88edac3"}]} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:45:55.952024 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-b3196cbf-6a0f-4d61-874a-7f96411e9d77 req-dafda4d1-a880-4694-b0cf-6c0067908d16 service nova] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:45:55.952024 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-b3196cbf-6a0f-4d61-874a-7f96411e9d77 req-dafda4d1-a880-4694-b0cf-6c0067908d16 service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:45:55.952024 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-b3196cbf-6a0f-4d61-874a-7f96411e9d77 req-dafda4d1-a880-4694-b0cf-6c0067908d16 service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:45:55.963097 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.compute.server_external_events [req-b3196cbf-6a0f-4d61-874a-7f96411e9d77 req-dafda4d1-a880-4694-b0cf-6c0067908d16 service nova] Creating event network-vif-deleted:c30f1b51-2afd-425d-956e-dbabf88edac3 for instance bf04b523-cedf-4e68-b77f-f6039d0de59c on hv-cinder-85427 Aug 24 11:45:55.969771 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [req-b3196cbf-6a0f-4d61-874a-7f96411e9d77 req-dafda4d1-a880-4694-b0cf-6c0067908d16 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034117 Aug 24 11:45:55.970618 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 580/1197] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Aug 24 11:45:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:45:56.254593 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-8c35ba5a-1c06-4937-8c42-7e6d1f784806 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:45:56.255241 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-8c35ba5a-1c06-4937-8c42-7e6d1f784806 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: bf04b523-cedf-4e68-b77f-f6039d0de59c] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:45:56.263054 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-8c35ba5a-1c06-4937-8c42-7e6d1f784806 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:45:56.268221 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-8c35ba5a-1c06-4937-8c42-7e6d1f784806 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:45:56.268221 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-8c35ba5a-1c06-4937-8c42-7e6d1f784806 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:45:56.268221 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-8c35ba5a-1c06-4937-8c42-7e6d1f784806 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:45:56.268221 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-8c35ba5a-1c06-4937-8c42-7e6d1f784806 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:45:56.268687 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-8c35ba5a-1c06-4937-8c42-7e6d1f784806 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:45:56.344097 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-8c35ba5a-1c06-4937-8c42-7e6d1f784806 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:45:56.355500 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-8c35ba5a-1c06-4937-8c42-7e6d1f784806 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:45:56.357897 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-8c35ba5a-1c06-4937-8c42-7e6d1f784806 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:45:56.359358 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-8c35ba5a-1c06-4937-8c42-7e6d1f784806 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c" status: 200 len: 1367 microversion: 2.20 time: 0.109477 Aug 24 11:45:56.359895 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 618/1198] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:45:56 2022] GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c => generated 1367 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:45:56.966285 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-7300acc1-bac6-4991-b005-e6827f44af59 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:45:56.966959 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-7300acc1-bac6-4991-b005-e6827f44af59 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: b86b3db2-2f76-464d-b087-39deddd5a48e] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:45:56.973313 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-7300acc1-bac6-4991-b005-e6827f44af59 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:45:56.973793 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-7300acc1-bac6-4991-b005-e6827f44af59 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:45:56.974586 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-7300acc1-bac6-4991-b005-e6827f44af59 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:45:56.975336 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-7300acc1-bac6-4991-b005-e6827f44af59 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:45:56.975784 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-7300acc1-bac6-4991-b005-e6827f44af59 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:45:56.976205 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-7300acc1-bac6-4991-b005-e6827f44af59 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:45:57.069158 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.objects.instance [None req-7300acc1-bac6-4991-b005-e6827f44af59 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lazy-loading 'services' on Instance uuid b86b3db2-2f76-464d-b087-39deddd5a48e {{(pid=124770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:45:57.257625 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-7300acc1-bac6-4991-b005-e6827f44af59 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "DELETE /compute/v2.1/servers/b86b3db2-2f76-464d-b087-39deddd5a48e/os-volume_attachments/4a30df52-7efc-4dc3-ad9a-0b3e1efa80c6" status: 202 len: 0 microversion: 2.1 time: 0.296753 Aug 24 11:45:57.258220 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 581/1199] 10.222.0.84 () {58 vars in 1416 bytes} [Wed Aug 24 11:45:56 2022] DELETE /compute/v2.1/servers/b86b3db2-2f76-464d-b087-39deddd5a48e/os-volume_attachments/4a30df52-7efc-4dc3-ad9a-0b3e1efa80c6 => generated 0 bytes in 298 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:45:57.267501 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-5b4e05cd-44f5-475b-83a7-852dfd9b8fdc tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:45:57.269806 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-5b4e05cd-44f5-475b-83a7-852dfd9b8fdc tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: b86b3db2-2f76-464d-b087-39deddd5a48e] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:45:57.276981 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-5b4e05cd-44f5-475b-83a7-852dfd9b8fdc tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:45:57.277654 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-5b4e05cd-44f5-475b-83a7-852dfd9b8fdc tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:45:57.278091 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-5b4e05cd-44f5-475b-83a7-852dfd9b8fdc tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:45:57.278779 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-5b4e05cd-44f5-475b-83a7-852dfd9b8fdc tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:45:57.279229 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-5b4e05cd-44f5-475b-83a7-852dfd9b8fdc tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:45:57.279663 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-5b4e05cd-44f5-475b-83a7-852dfd9b8fdc tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:45:57.309532 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-5b4e05cd-44f5-475b-83a7-852dfd9b8fdc tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "GET /compute/v2.1/servers/b86b3db2-2f76-464d-b087-39deddd5a48e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046041 Aug 24 11:45:57.310285 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 619/1200] 10.222.0.84 () {58 vars in 1302 bytes} [Wed Aug 24 11:45:57 2022] GET /compute/v2.1/servers/b86b3db2-2f76-464d-b087-39deddd5a48e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:45:57.382855 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-e6cf4d28-f914-43fc-8248-61ddd412be2b tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:45:57.383462 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-e6cf4d28-f914-43fc-8248-61ddd412be2b tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: bf04b523-cedf-4e68-b77f-f6039d0de59c] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:45:57.390470 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e6cf4d28-f914-43fc-8248-61ddd412be2b tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:45:57.390960 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e6cf4d28-f914-43fc-8248-61ddd412be2b tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:45:57.391400 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e6cf4d28-f914-43fc-8248-61ddd412be2b tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:45:57.392102 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e6cf4d28-f914-43fc-8248-61ddd412be2b tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:45:57.392553 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e6cf4d28-f914-43fc-8248-61ddd412be2b tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:45:57.393006 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e6cf4d28-f914-43fc-8248-61ddd412be2b tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:45:57.427856 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e6cf4d28-f914-43fc-8248-61ddd412be2b tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:45:57.428331 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e6cf4d28-f914-43fc-8248-61ddd412be2b tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:45:57.428763 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e6cf4d28-f914-43fc-8248-61ddd412be2b tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:45:57.429307 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.objects.instance [None req-e6cf4d28-f914-43fc-8248-61ddd412be2b tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lazy-loading 'fault' on Instance uuid bf04b523-cedf-4e68-b77f-f6039d0de59c {{(pid=124770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:45:57.475959 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-e6cf4d28-f914-43fc-8248-61ddd412be2b tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:45:57.484564 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-e6cf4d28-f914-43fc-8248-61ddd412be2b tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:45:57.486085 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-e6cf4d28-f914-43fc-8248-61ddd412be2b tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:45:57.487227 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-e6cf4d28-f914-43fc-8248-61ddd412be2b tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c" status: 200 len: 1372 microversion: 2.20 time: 0.108834 Aug 24 11:45:57.487781 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 582/1201] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:45:57 2022] GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c => generated 1372 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:45:58.322325 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-0b29dabb-24d8-4b22-b656-eff9706e1c8c tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:45:58.325384 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-0b29dabb-24d8-4b22-b656-eff9706e1c8c tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: b86b3db2-2f76-464d-b087-39deddd5a48e] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:45:58.331948 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-0b29dabb-24d8-4b22-b656-eff9706e1c8c tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:45:58.339392 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-0b29dabb-24d8-4b22-b656-eff9706e1c8c tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:45:58.339392 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-0b29dabb-24d8-4b22-b656-eff9706e1c8c tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:45:58.339392 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-0b29dabb-24d8-4b22-b656-eff9706e1c8c tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:45:58.339392 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-0b29dabb-24d8-4b22-b656-eff9706e1c8c tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:45:58.339879 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-0b29dabb-24d8-4b22-b656-eff9706e1c8c tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:45:58.370931 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-0b29dabb-24d8-4b22-b656-eff9706e1c8c tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "GET /compute/v2.1/servers/b86b3db2-2f76-464d-b087-39deddd5a48e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051854 Aug 24 11:45:58.371529 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 620/1202] 10.222.0.84 () {58 vars in 1302 bytes} [Wed Aug 24 11:45:58 2022] GET /compute/v2.1/servers/b86b3db2-2f76-464d-b087-39deddd5a48e/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:45:58.516646 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-a0d7cab1-bc45-4439-a5bc-ddb0b7eff042 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:45:58.517248 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-a0d7cab1-bc45-4439-a5bc-ddb0b7eff042 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: bf04b523-cedf-4e68-b77f-f6039d0de59c] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:45:58.523948 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a0d7cab1-bc45-4439-a5bc-ddb0b7eff042 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:45:58.524430 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a0d7cab1-bc45-4439-a5bc-ddb0b7eff042 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:45:58.524894 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a0d7cab1-bc45-4439-a5bc-ddb0b7eff042 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:45:58.525582 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a0d7cab1-bc45-4439-a5bc-ddb0b7eff042 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:45:58.526032 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a0d7cab1-bc45-4439-a5bc-ddb0b7eff042 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:45:58.526547 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a0d7cab1-bc45-4439-a5bc-ddb0b7eff042 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:45:58.558803 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a0d7cab1-bc45-4439-a5bc-ddb0b7eff042 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:45:58.559285 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a0d7cab1-bc45-4439-a5bc-ddb0b7eff042 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:45:58.559724 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a0d7cab1-bc45-4439-a5bc-ddb0b7eff042 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:45:58.560175 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.objects.instance [None req-a0d7cab1-bc45-4439-a5bc-ddb0b7eff042 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lazy-loading 'fault' on Instance uuid bf04b523-cedf-4e68-b77f-f6039d0de59c {{(pid=124770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:45:58.602141 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-a0d7cab1-bc45-4439-a5bc-ddb0b7eff042 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:45:58.610868 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-a0d7cab1-bc45-4439-a5bc-ddb0b7eff042 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:45:58.612369 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-a0d7cab1-bc45-4439-a5bc-ddb0b7eff042 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:45:58.613569 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-a0d7cab1-bc45-4439-a5bc-ddb0b7eff042 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c" status: 200 len: 1372 microversion: 2.20 time: 0.105780 Aug 24 11:45:58.614132 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 583/1203] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:45:58 2022] GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c => generated 1372 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:45:59.388673 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-6194bdbb-848c-49b0-af5f-1e7c5e8f547a tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:45:59.392425 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-6194bdbb-848c-49b0-af5f-1e7c5e8f547a tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: b86b3db2-2f76-464d-b087-39deddd5a48e] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:45:59.399937 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-6194bdbb-848c-49b0-af5f-1e7c5e8f547a tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:45:59.400370 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-6194bdbb-848c-49b0-af5f-1e7c5e8f547a tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:45:59.400823 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-6194bdbb-848c-49b0-af5f-1e7c5e8f547a tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:45:59.402180 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-6194bdbb-848c-49b0-af5f-1e7c5e8f547a tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:45:59.402729 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-6194bdbb-848c-49b0-af5f-1e7c5e8f547a tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:45:59.403156 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-6194bdbb-848c-49b0-af5f-1e7c5e8f547a tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:45:59.433764 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-6194bdbb-848c-49b0-af5f-1e7c5e8f547a tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "GET /compute/v2.1/servers/b86b3db2-2f76-464d-b087-39deddd5a48e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052768 Aug 24 11:45:59.434326 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 621/1204] 10.222.0.84 () {58 vars in 1302 bytes} [Wed Aug 24 11:45:59 2022] GET /compute/v2.1/servers/b86b3db2-2f76-464d-b087-39deddd5a48e/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:45:59.638263 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-f308da78-4677-4795-9889-8a55b648df95 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:45:59.638872 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-f308da78-4677-4795-9889-8a55b648df95 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: bf04b523-cedf-4e68-b77f-f6039d0de59c] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:45:59.645287 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-f308da78-4677-4795-9889-8a55b648df95 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:45:59.645815 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-f308da78-4677-4795-9889-8a55b648df95 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:45:59.646360 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-f308da78-4677-4795-9889-8a55b648df95 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:45:59.647138 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-f308da78-4677-4795-9889-8a55b648df95 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:45:59.647591 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-f308da78-4677-4795-9889-8a55b648df95 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:45:59.648112 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-f308da78-4677-4795-9889-8a55b648df95 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:45:59.680496 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-f308da78-4677-4795-9889-8a55b648df95 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:45:59.681025 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-f308da78-4677-4795-9889-8a55b648df95 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:45:59.681489 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-f308da78-4677-4795-9889-8a55b648df95 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:45:59.681936 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.objects.instance [None req-f308da78-4677-4795-9889-8a55b648df95 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lazy-loading 'fault' on Instance uuid bf04b523-cedf-4e68-b77f-f6039d0de59c {{(pid=124770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:45:59.723886 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-f308da78-4677-4795-9889-8a55b648df95 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:45:59.732510 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-f308da78-4677-4795-9889-8a55b648df95 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:45:59.734070 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-f308da78-4677-4795-9889-8a55b648df95 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:45:59.735231 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-f308da78-4677-4795-9889-8a55b648df95 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c" status: 200 len: 1372 microversion: 2.20 time: 0.102061 Aug 24 11:45:59.735781 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 584/1205] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:45:59 2022] GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c => generated 1372 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:46:00.444982 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-c53aa6a0-9b8c-4fab-b485-be2ce4996d81 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:46:00.447116 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-c53aa6a0-9b8c-4fab-b485-be2ce4996d81 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: b86b3db2-2f76-464d-b087-39deddd5a48e] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:46:00.454241 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-c53aa6a0-9b8c-4fab-b485-be2ce4996d81 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:46:00.454812 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-c53aa6a0-9b8c-4fab-b485-be2ce4996d81 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:46:00.455152 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-c53aa6a0-9b8c-4fab-b485-be2ce4996d81 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:46:00.455850 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-c53aa6a0-9b8c-4fab-b485-be2ce4996d81 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:46:00.456302 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-c53aa6a0-9b8c-4fab-b485-be2ce4996d81 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:46:00.456726 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-c53aa6a0-9b8c-4fab-b485-be2ce4996d81 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:46:00.491549 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-c53aa6a0-9b8c-4fab-b485-be2ce4996d81 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "GET /compute/v2.1/servers/b86b3db2-2f76-464d-b087-39deddd5a48e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050346 Aug 24 11:46:00.492053 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 622/1206] 10.222.0.84 () {58 vars in 1302 bytes} [Wed Aug 24 11:46:00 2022] GET /compute/v2.1/servers/b86b3db2-2f76-464d-b087-39deddd5a48e/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:46:00.758900 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-5e53a4d9-c269-4fdd-a907-d489636ec538 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:46:00.759566 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-5e53a4d9-c269-4fdd-a907-d489636ec538 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: bf04b523-cedf-4e68-b77f-f6039d0de59c] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:46:00.767138 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5e53a4d9-c269-4fdd-a907-d489636ec538 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:46:00.767667 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5e53a4d9-c269-4fdd-a907-d489636ec538 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:46:00.768097 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5e53a4d9-c269-4fdd-a907-d489636ec538 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:46:00.768784 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5e53a4d9-c269-4fdd-a907-d489636ec538 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:46:00.769262 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5e53a4d9-c269-4fdd-a907-d489636ec538 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:46:00.769705 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5e53a4d9-c269-4fdd-a907-d489636ec538 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:46:00.799442 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5e53a4d9-c269-4fdd-a907-d489636ec538 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:46:00.799906 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5e53a4d9-c269-4fdd-a907-d489636ec538 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:46:00.800347 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5e53a4d9-c269-4fdd-a907-d489636ec538 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:46:00.800776 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.objects.instance [None req-5e53a4d9-c269-4fdd-a907-d489636ec538 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lazy-loading 'fault' on Instance uuid bf04b523-cedf-4e68-b77f-f6039d0de59c {{(pid=124770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:46:00.842338 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-5e53a4d9-c269-4fdd-a907-d489636ec538 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:46:00.850529 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-5e53a4d9-c269-4fdd-a907-d489636ec538 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:46:00.852140 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-5e53a4d9-c269-4fdd-a907-d489636ec538 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a80d0127ee349d69f0ed949bcb4c919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e00cee82c44a196eaf5d0dc07b7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:46:00.853337 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-5e53a4d9-c269-4fdd-a907-d489636ec538 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c" status: 200 len: 1372 microversion: 2.20 time: 0.098545 Aug 24 11:46:00.853947 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 585/1207] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:46:00 2022] GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c => generated 1372 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:46:01.504614 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-8d740a85-829d-442c-a959-88a2743b8c86 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:46:01.506890 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-8d740a85-829d-442c-a959-88a2743b8c86 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: b86b3db2-2f76-464d-b087-39deddd5a48e] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:46:01.514657 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-8d740a85-829d-442c-a959-88a2743b8c86 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:46:01.515180 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-8d740a85-829d-442c-a959-88a2743b8c86 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:46:01.515642 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-8d740a85-829d-442c-a959-88a2743b8c86 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:46:01.516347 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-8d740a85-829d-442c-a959-88a2743b8c86 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:46:01.516835 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-8d740a85-829d-442c-a959-88a2743b8c86 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:46:01.517451 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-8d740a85-829d-442c-a959-88a2743b8c86 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:46:01.552648 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-8d740a85-829d-442c-a959-88a2743b8c86 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "GET /compute/v2.1/servers/b86b3db2-2f76-464d-b087-39deddd5a48e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052724 Aug 24 11:46:01.553458 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 623/1208] 10.222.0.84 () {58 vars in 1302 bytes} [Wed Aug 24 11:46:01 2022] GET /compute/v2.1/servers/b86b3db2-2f76-464d-b087-39deddd5a48e/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:46:01.876428 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-d74e164c-899e-4255-b25f-b081a5af4552 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:46:01.876907 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-d74e164c-899e-4255-b25f-b081a5af4552 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: bf04b523-cedf-4e68-b77f-f6039d0de59c] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:46:01.883346 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d74e164c-899e-4255-b25f-b081a5af4552 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:46:01.883845 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d74e164c-899e-4255-b25f-b081a5af4552 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:46:01.884280 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d74e164c-899e-4255-b25f-b081a5af4552 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:46:01.885021 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d74e164c-899e-4255-b25f-b081a5af4552 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:46:01.888469 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d74e164c-899e-4255-b25f-b081a5af4552 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:46:01.889487 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d74e164c-899e-4255-b25f-b081a5af4552 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:46:01.904898 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.wsgi [None req-d74e164c-899e-4255-b25f-b081a5af4552 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] HTTP exception thrown: Instance bf04b523-cedf-4e68-b77f-f6039d0de59c could not be found. Aug 24 11:46:01.906602 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-d74e164c-899e-4255-b25f-b081a5af4552 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Request method failure captured: Aug 24 11:46:01.906602 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: request: GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c HTTP/1.1 Aug 24 11:46:01.906602 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Accept: application/json Aug 24 11:46:01.906602 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Accept-Encoding: identity Aug 24 11:46:01.906602 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Connection: close Aug 24 11:46:01.906602 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Content-Length: 0 Aug 24 11:46:01.906602 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Content-Type: application/json Aug 24 11:46:01.906602 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Host: 10.222.0.84 Aug 24 11:46:01.906602 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Openstack-System-Scope: None Aug 24 11:46:01.906602 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: User-Agent: python-urllib3/1.26.11 Aug 24 11:46:01.906602 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Auth-Token: gAAAAABjBgwjqMI9ytFP7VsVHRP_Ve7OKeTCX30XQiKKQRG2LSSGgytPnOci29Q2gHVmiSkSzv-ncMAbc9BWAtzjPMrEQ9DgQiqJHEsoVLsTI-7rEziZM2TxObMN3otskXoxjncEe9UfCmp-Knwv-1P3tr3F6dPE5AY_27hhfhxbUjks2TOg5-4 Aug 24 11:46:01.906602 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Domain-Id: None Aug 24 11:46:01.906602 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Domain-Name: None Aug 24 11:46:01.906602 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Identity-Status: Confirmed Aug 24 11:46:01.906602 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Is-Admin-Project: True Aug 24 11:46:01.906602 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 11:46:01.906602 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Project-Domain-Id: default Aug 24 11:46:01.906602 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Project-Domain-Name: Default Aug 24 11:46:01.906602 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Project-Id: 177e00cee82c44a196eaf5d0dc07b7f2 Aug 24 11:46:01.906602 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-585166699 Aug 24 11:46:01.906602 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Role: reader,member Aug 24 11:46:01.906602 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Roles: reader,member Aug 24 11:46:01.908416 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/volume/v3/177e00cee82c44a196eaf5d0dc07b7f2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/volume/v3/177e00cee82c44a196eaf5d0dc07b7f2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/compute/v2/177e00cee82c44a196eaf5d0dc07b7f2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84:8080/v1/AUTH_177e00cee82c44a196eaf5d0dc07b7f2", "adminURL": "http://10.222.0.84:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/placement"}]}] Aug 24 11:46:01.908416 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Tenant: tempest-AttachVolumeShelveTestJSON-585166699 Aug 24 11:46:01.908416 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Tenant-Id: 177e00cee82c44a196eaf5d0dc07b7f2 Aug 24 11:46:01.908416 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-585166699 Aug 24 11:46:01.908416 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User: tempest-AttachVolumeShelveTestJSON-585166699-project Aug 24 11:46:01.908416 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User-Domain-Id: default Aug 24 11:46:01.908416 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User-Domain-Name: Default Aug 24 11:46:01.908416 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User-Id: 4a80d0127ee349d69f0ed949bcb4c919 Aug 24 11:46:01.908416 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User-Name: tempest-AttachVolumeShelveTestJSON-585166699-project Aug 24 11:46:01.908416 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: method: > Aug 24 11:46:01.908416 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: exception: Instance bf04b523-cedf-4e68-b77f-f6039d0de59c could not be found. Aug 24 11:46:01.908416 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: action_args: {'id': 'bf04b523-cedf-4e68-b77f-f6039d0de59c'} Aug 24 11:46:01.909323 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:46:01.909323 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:46:01.909323 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:46:01.909323 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:46:01.909323 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:46:01.909323 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:46:01.909323 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:46:01.909323 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:46:01.909323 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:46:01.909323 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:46:01.909323 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf04b523-cedf-4e68-b77f-f6039d0de59c could not be found. Aug 24 11:46:01.909323 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:46:01.909323 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:46:01.909323 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:46:01.909323 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:46:01.909323 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:46:01.909323 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:46:01.909323 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:46:01.909323 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:46:01.909323 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:46:01.910918 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:46:01.910918 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:46:01.910918 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:46:01.910918 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:46:01.910918 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:46:01.910918 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:46:01.910918 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:46:01.910918 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf04b523-cedf-4e68-b77f-f6039d0de59c could not be found. Aug 24 11:46:01.910918 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:46:01.910918 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:46:01.910918 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:46:01.910918 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:46:01.910918 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:46:01.910918 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:46:01.910918 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:46:01.910918 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:46:01.910918 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf04b523-cedf-4e68-b77f-f6039d0de59c could not be found. Aug 24 11:46:01.910918 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:46:01.912294 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-d74e164c-899e-4255-b25f-b081a5af4552 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Returning 404 to user: Instance bf04b523-cedf-4e68-b77f-f6039d0de59c could not be found. {{(pid=124770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:46:01.912294 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-d74e164c-899e-4255-b25f-b081a5af4552 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c" status: 404 len: 111 microversion: 2.20 time: 0.036269 Aug 24 11:46:01.912294 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 586/1209] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:46:01 2022] GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 11:46:01.917075 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-44247914-4f37-4d65-bf7e-ec3e8961a5b4 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '.version_select at 0x7f0e2a8c6a60>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:46:02.049242 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-44247914-4f37-4d65-bf7e-ec3e8961a5b4 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1524553077" status: 204 len: 0 microversion: 2.20 time: 0.135928 Aug 24 11:46:02.049739 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 624/1210] 10.222.0.84 () {60 vars in 1262 bytes} [Wed Aug 24 11:46:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1524553077 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 11:46:02.566051 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-9ff04da2-518e-4b93-90da-78c14c763d73 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:46:02.568254 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-9ff04da2-518e-4b93-90da-78c14c763d73 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: b86b3db2-2f76-464d-b087-39deddd5a48e] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:46:02.575707 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9ff04da2-518e-4b93-90da-78c14c763d73 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:46:02.576204 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9ff04da2-518e-4b93-90da-78c14c763d73 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:46:02.576643 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9ff04da2-518e-4b93-90da-78c14c763d73 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:46:02.577383 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9ff04da2-518e-4b93-90da-78c14c763d73 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:46:02.577949 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9ff04da2-518e-4b93-90da-78c14c763d73 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:46:02.578379 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9ff04da2-518e-4b93-90da-78c14c763d73 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:46:02.597742 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:46:02.611381 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-9ff04da2-518e-4b93-90da-78c14c763d73 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "GET /compute/v2.1/servers/b86b3db2-2f76-464d-b087-39deddd5a48e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049309 Aug 24 11:46:02.612049 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 587/1211] 10.222.0.84 () {58 vars in 1302 bytes} [Wed Aug 24 11:46:02 2022] GET /compute/v2.1/servers/b86b3db2-2f76-464d-b087-39deddd5a48e/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 11:46:02.680064 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-9ad4ada2-e4fc-44f3-9dbd-9b926bf88bd8 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:46:02.680690 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-9ad4ada2-e4fc-44f3-9dbd-9b926bf88bd8 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: b86b3db2-2f76-464d-b087-39deddd5a48e] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:46:02.687193 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-9ad4ada2-e4fc-44f3-9dbd-9b926bf88bd8 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:46:02.687681 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-9ad4ada2-e4fc-44f3-9dbd-9b926bf88bd8 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:46:02.688114 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-9ad4ada2-e4fc-44f3-9dbd-9b926bf88bd8 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:46:02.688843 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-9ad4ada2-e4fc-44f3-9dbd-9b926bf88bd8 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:46:02.689357 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-9ad4ada2-e4fc-44f3-9dbd-9b926bf88bd8 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:46:02.689777 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-9ad4ada2-e4fc-44f3-9dbd-9b926bf88bd8 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:46:02.718065 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-9ad4ada2-e4fc-44f3-9dbd-9b926bf88bd8 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: b86b3db2-2f76-464d-b087-39deddd5a48e] Going to try to terminate instance {{(pid=124769) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 11:46:03.046631 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-9ad4ada2-e4fc-44f3-9dbd-9b926bf88bd8 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "DELETE /compute/v2.1/servers/b86b3db2-2f76-464d-b087-39deddd5a48e" status: 204 len: 0 microversion: 2.1 time: 0.370909 Aug 24 11:46:03.047644 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 625/1212] 10.222.0.84 () {58 vars in 1239 bytes} [Wed Aug 24 11:46:02 2022] DELETE /compute/v2.1/servers/b86b3db2-2f76-464d-b087-39deddd5a48e => generated 0 bytes in 373 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 11:46:03.055737 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-9f8c163c-ff88-4065-9c0b-91897e579af2 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:46:03.056346 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-9f8c163c-ff88-4065-9c0b-91897e579af2 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: b86b3db2-2f76-464d-b087-39deddd5a48e] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:46:03.064128 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9f8c163c-ff88-4065-9c0b-91897e579af2 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:46:03.064601 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9f8c163c-ff88-4065-9c0b-91897e579af2 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:46:03.065057 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9f8c163c-ff88-4065-9c0b-91897e579af2 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:46:03.065745 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9f8c163c-ff88-4065-9c0b-91897e579af2 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:46:03.066195 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9f8c163c-ff88-4065-9c0b-91897e579af2 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:46:03.066612 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9f8c163c-ff88-4065-9c0b-91897e579af2 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:46:03.227206 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-9f8c163c-ff88-4065-9c0b-91897e579af2 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2715cf2a5129439c83a5347bb963f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4159dc366f41bc9e4057a079f6fb5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:46:03.236033 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-9f8c163c-ff88-4065-9c0b-91897e579af2 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "GET /compute/v2.1/servers/b86b3db2-2f76-464d-b087-39deddd5a48e" status: 200 len: 1681 microversion: 2.1 time: 0.184013 Aug 24 11:46:03.236610 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 588/1213] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:46:03 2022] GET /compute/v2.1/servers/b86b3db2-2f76-464d-b087-39deddd5a48e => generated 1681 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:46:04.260678 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-891f2f9c-53a5-4954-a40c-76d4f8921d5b tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:46:04.261492 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-891f2f9c-53a5-4954-a40c-76d4f8921d5b tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: b86b3db2-2f76-464d-b087-39deddd5a48e] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:46:04.268251 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-891f2f9c-53a5-4954-a40c-76d4f8921d5b tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:46:04.269177 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-891f2f9c-53a5-4954-a40c-76d4f8921d5b tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:46:04.269615 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-891f2f9c-53a5-4954-a40c-76d4f8921d5b tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:46:04.270320 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-891f2f9c-53a5-4954-a40c-76d4f8921d5b tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:46:04.270774 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-891f2f9c-53a5-4954-a40c-76d4f8921d5b tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:46:04.271190 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-891f2f9c-53a5-4954-a40c-76d4f8921d5b tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:46:04.449132 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-47ff4c77-f0c9-420f-a406-12f1a2d84cb5 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:46:04.450801 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-47ff4c77-f0c9-420f-a406-12f1a2d84cb5 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: bf04b523-cedf-4e68-b77f-f6039d0de59c] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:46:04.452406 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-891f2f9c-53a5-4954-a40c-76d4f8921d5b tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2715cf2a5129439c83a5347bb963f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4159dc366f41bc9e4057a079f6fb5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:46:04.463822 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-47ff4c77-f0c9-420f-a406-12f1a2d84cb5 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:46:04.464636 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-47ff4c77-f0c9-420f-a406-12f1a2d84cb5 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:46:04.465111 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-47ff4c77-f0c9-420f-a406-12f1a2d84cb5 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:46:04.466015 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-47ff4c77-f0c9-420f-a406-12f1a2d84cb5 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:46:04.466486 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-47ff4c77-f0c9-420f-a406-12f1a2d84cb5 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:46:04.466912 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-47ff4c77-f0c9-420f-a406-12f1a2d84cb5 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:46:04.474000 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-891f2f9c-53a5-4954-a40c-76d4f8921d5b tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "GET /compute/v2.1/servers/b86b3db2-2f76-464d-b087-39deddd5a48e" status: 200 len: 1681 microversion: 2.1 time: 0.217977 Aug 24 11:46:04.475324 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 626/1214] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:46:04 2022] GET /compute/v2.1/servers/b86b3db2-2f76-464d-b087-39deddd5a48e => generated 1681 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:46:04.482044 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.wsgi [None req-47ff4c77-f0c9-420f-a406-12f1a2d84cb5 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] HTTP exception thrown: Instance bf04b523-cedf-4e68-b77f-f6039d0de59c could not be found. Aug 24 11:46:04.484025 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-47ff4c77-f0c9-420f-a406-12f1a2d84cb5 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Request method failure captured: Aug 24 11:46:04.484025 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: request: DELETE /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c HTTP/1.1 Aug 24 11:46:04.484025 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Accept: application/json Aug 24 11:46:04.484025 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Accept-Encoding: identity Aug 24 11:46:04.484025 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Connection: close Aug 24 11:46:04.484025 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Content-Length: 0 Aug 24 11:46:04.484025 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Content-Type: application/json Aug 24 11:46:04.484025 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Host: 10.222.0.84 Aug 24 11:46:04.484025 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Openstack-System-Scope: None Aug 24 11:46:04.484025 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: User-Agent: python-urllib3/1.26.11 Aug 24 11:46:04.484025 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Auth-Token: gAAAAABjBgwjqMI9ytFP7VsVHRP_Ve7OKeTCX30XQiKKQRG2LSSGgytPnOci29Q2gHVmiSkSzv-ncMAbc9BWAtzjPMrEQ9DgQiqJHEsoVLsTI-7rEziZM2TxObMN3otskXoxjncEe9UfCmp-Knwv-1P3tr3F6dPE5AY_27hhfhxbUjks2TOg5-4 Aug 24 11:46:04.484025 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Domain-Id: None Aug 24 11:46:04.484025 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Domain-Name: None Aug 24 11:46:04.484025 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Identity-Status: Confirmed Aug 24 11:46:04.484025 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Is-Admin-Project: True Aug 24 11:46:04.484025 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 11:46:04.484025 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Project-Domain-Id: default Aug 24 11:46:04.484025 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Project-Domain-Name: Default Aug 24 11:46:04.484025 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Project-Id: 177e00cee82c44a196eaf5d0dc07b7f2 Aug 24 11:46:04.484025 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-585166699 Aug 24 11:46:04.484025 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Role: reader,member Aug 24 11:46:04.484025 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Roles: reader,member Aug 24 11:46:04.488869 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/volume/v3/177e00cee82c44a196eaf5d0dc07b7f2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/volume/v3/177e00cee82c44a196eaf5d0dc07b7f2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/compute/v2/177e00cee82c44a196eaf5d0dc07b7f2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84:8080/v1/AUTH_177e00cee82c44a196eaf5d0dc07b7f2", "adminURL": "http://10.222.0.84:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/placement"}]}] Aug 24 11:46:04.488869 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Tenant: tempest-AttachVolumeShelveTestJSON-585166699 Aug 24 11:46:04.488869 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Tenant-Id: 177e00cee82c44a196eaf5d0dc07b7f2 Aug 24 11:46:04.488869 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-585166699 Aug 24 11:46:04.488869 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User: tempest-AttachVolumeShelveTestJSON-585166699-project Aug 24 11:46:04.488869 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User-Domain-Id: default Aug 24 11:46:04.488869 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User-Domain-Name: Default Aug 24 11:46:04.488869 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User-Id: 4a80d0127ee349d69f0ed949bcb4c919 Aug 24 11:46:04.488869 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User-Name: tempest-AttachVolumeShelveTestJSON-585166699-project Aug 24 11:46:04.488869 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: method: > Aug 24 11:46:04.488869 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: exception: Instance bf04b523-cedf-4e68-b77f-f6039d0de59c could not be found. Aug 24 11:46:04.488869 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: action_args: {'id': 'bf04b523-cedf-4e68-b77f-f6039d0de59c'} Aug 24 11:46:04.493939 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:46:04.493939 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:46:04.493939 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:46:04.493939 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:46:04.493939 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:46:04.493939 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:46:04.493939 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:46:04.493939 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:46:04.493939 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:46:04.493939 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:46:04.493939 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf04b523-cedf-4e68-b77f-f6039d0de59c could not be found. Aug 24 11:46:04.493939 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:46:04.493939 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:46:04.493939 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:46:04.493939 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:46:04.493939 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:46:04.493939 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:46:04.493939 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:46:04.493939 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:46:04.493939 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:46:04.496485 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:46:04.496485 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 11:46:04.496485 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 11:46:04.496485 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 11:46:04.496485 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 11:46:04.496485 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:46:04.496485 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:46:04.496485 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:46:04.496485 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:46:04.496485 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf04b523-cedf-4e68-b77f-f6039d0de59c could not be found. Aug 24 11:46:04.496485 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:46:04.496485 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:46:04.496485 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:46:04.496485 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:46:04.496485 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:46:04.496485 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:46:04.496485 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:46:04.496485 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:46:04.496485 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf04b523-cedf-4e68-b77f-f6039d0de59c could not be found. Aug 24 11:46:04.496485 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:46:04.498040 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-47ff4c77-f0c9-420f-a406-12f1a2d84cb5 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Returning 404 to user: Instance bf04b523-cedf-4e68-b77f-f6039d0de59c could not be found. {{(pid=124770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:46:04.498040 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-47ff4c77-f0c9-420f-a406-12f1a2d84cb5 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "DELETE /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c" status: 404 len: 111 microversion: 2.20 time: 0.043791 Aug 24 11:46:04.498040 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 589/1215] 10.222.0.84 () {60 vars in 1280 bytes} [Wed Aug 24 11:46:04 2022] DELETE /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 11:46:04.506895 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-146e4667-ca60-42f0-aced-856a3b630383 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:46:04.507533 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-146e4667-ca60-42f0-aced-856a3b630383 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: bf04b523-cedf-4e68-b77f-f6039d0de59c] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:46:04.514831 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-146e4667-ca60-42f0-aced-856a3b630383 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:46:04.515254 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-146e4667-ca60-42f0-aced-856a3b630383 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:46:04.515642 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-146e4667-ca60-42f0-aced-856a3b630383 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:46:04.516392 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-146e4667-ca60-42f0-aced-856a3b630383 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:46:04.516855 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-146e4667-ca60-42f0-aced-856a3b630383 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:46:04.517315 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-146e4667-ca60-42f0-aced-856a3b630383 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:46:04.532532 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.wsgi [None req-146e4667-ca60-42f0-aced-856a3b630383 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] HTTP exception thrown: Instance bf04b523-cedf-4e68-b77f-f6039d0de59c could not be found. Aug 24 11:46:04.534466 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-146e4667-ca60-42f0-aced-856a3b630383 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Request method failure captured: Aug 24 11:46:04.534466 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: request: GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c HTTP/1.1 Aug 24 11:46:04.534466 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Accept: application/json Aug 24 11:46:04.534466 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Accept-Encoding: identity Aug 24 11:46:04.534466 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Connection: close Aug 24 11:46:04.534466 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Content-Length: 0 Aug 24 11:46:04.534466 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Content-Type: application/json Aug 24 11:46:04.534466 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Host: 10.222.0.84 Aug 24 11:46:04.534466 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Openstack-System-Scope: None Aug 24 11:46:04.534466 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: User-Agent: python-urllib3/1.26.11 Aug 24 11:46:04.534466 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Auth-Token: gAAAAABjBgwjqMI9ytFP7VsVHRP_Ve7OKeTCX30XQiKKQRG2LSSGgytPnOci29Q2gHVmiSkSzv-ncMAbc9BWAtzjPMrEQ9DgQiqJHEsoVLsTI-7rEziZM2TxObMN3otskXoxjncEe9UfCmp-Knwv-1P3tr3F6dPE5AY_27hhfhxbUjks2TOg5-4 Aug 24 11:46:04.534466 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Domain-Id: None Aug 24 11:46:04.534466 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Domain-Name: None Aug 24 11:46:04.534466 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Identity-Status: Confirmed Aug 24 11:46:04.534466 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Is-Admin-Project: True Aug 24 11:46:04.534466 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 11:46:04.534466 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Project-Domain-Id: default Aug 24 11:46:04.534466 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Project-Domain-Name: Default Aug 24 11:46:04.534466 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Project-Id: 177e00cee82c44a196eaf5d0dc07b7f2 Aug 24 11:46:04.534466 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-585166699 Aug 24 11:46:04.534466 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Role: reader,member Aug 24 11:46:04.534466 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Roles: reader,member Aug 24 11:46:04.539304 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/volume/v3/177e00cee82c44a196eaf5d0dc07b7f2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/volume/v3/177e00cee82c44a196eaf5d0dc07b7f2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/compute/v2/177e00cee82c44a196eaf5d0dc07b7f2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84:8080/v1/AUTH_177e00cee82c44a196eaf5d0dc07b7f2", "adminURL": "http://10.222.0.84:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/placement"}]}] Aug 24 11:46:04.539304 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Tenant: tempest-AttachVolumeShelveTestJSON-585166699 Aug 24 11:46:04.539304 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Tenant-Id: 177e00cee82c44a196eaf5d0dc07b7f2 Aug 24 11:46:04.539304 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-585166699 Aug 24 11:46:04.539304 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-User: tempest-AttachVolumeShelveTestJSON-585166699-project Aug 24 11:46:04.539304 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-User-Domain-Id: default Aug 24 11:46:04.539304 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-User-Domain-Name: Default Aug 24 11:46:04.539304 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-User-Id: 4a80d0127ee349d69f0ed949bcb4c919 Aug 24 11:46:04.539304 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-User-Name: tempest-AttachVolumeShelveTestJSON-585166699-project Aug 24 11:46:04.539304 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: method: > Aug 24 11:46:04.539304 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: exception: Instance bf04b523-cedf-4e68-b77f-f6039d0de59c could not be found. Aug 24 11:46:04.539304 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: action_args: {'id': 'bf04b523-cedf-4e68-b77f-f6039d0de59c'} Aug 24 11:46:04.540750 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:46:04.540750 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:46:04.540750 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:46:04.540750 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:46:04.540750 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:46:04.540750 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:46:04.540750 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:46:04.540750 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:46:04.540750 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:46:04.540750 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:46:04.540750 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf04b523-cedf-4e68-b77f-f6039d0de59c could not be found. Aug 24 11:46:04.540750 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Aug 24 11:46:04.540750 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:46:04.540750 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Aug 24 11:46:04.540750 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:46:04.540750 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:46:04.540750 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:46:04.540750 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:46:04.540750 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:46:04.540750 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:46:04.543569 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:46:04.543569 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:46:04.543569 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:46:04.543569 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:46:04.543569 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:46:04.543569 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:46:04.543569 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:46:04.543569 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf04b523-cedf-4e68-b77f-f6039d0de59c could not be found. Aug 24 11:46:04.543569 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Aug 24 11:46:04.543569 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:46:04.543569 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Aug 24 11:46:04.543569 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:46:04.543569 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:46:04.543569 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:46:04.543569 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:46:04.543569 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:46:04.543569 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf04b523-cedf-4e68-b77f-f6039d0de59c could not be found. Aug 24 11:46:04.543569 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Aug 24 11:46:04.545425 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-146e4667-ca60-42f0-aced-856a3b630383 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Returning 404 to user: Instance bf04b523-cedf-4e68-b77f-f6039d0de59c could not be found. {{(pid=124769) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:46:04.545425 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-146e4667-ca60-42f0-aced-856a3b630383 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c" status: 404 len: 111 microversion: 2.20 time: 0.035871 Aug 24 11:46:04.545425 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 627/1216] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:46:04 2022] GET /compute/v2.1/servers/bf04b523-cedf-4e68-b77f-f6039d0de59c => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 24 11:46:05.500985 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-c78de4eb-c74c-46c2-bfb4-b3a11de24c46 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:46:05.501937 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-c78de4eb-c74c-46c2-bfb4-b3a11de24c46 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: b86b3db2-2f76-464d-b087-39deddd5a48e] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:46:05.508689 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c78de4eb-c74c-46c2-bfb4-b3a11de24c46 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:46:05.509250 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c78de4eb-c74c-46c2-bfb4-b3a11de24c46 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:46:05.509697 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c78de4eb-c74c-46c2-bfb4-b3a11de24c46 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:46:05.511018 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c78de4eb-c74c-46c2-bfb4-b3a11de24c46 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:46:05.511903 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c78de4eb-c74c-46c2-bfb4-b3a11de24c46 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:46:05.512600 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c78de4eb-c74c-46c2-bfb4-b3a11de24c46 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:46:05.663721 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-c78de4eb-c74c-46c2-bfb4-b3a11de24c46 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2715cf2a5129439c83a5347bb963f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4159dc366f41bc9e4057a079f6fb5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:46:05.672409 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-c78de4eb-c74c-46c2-bfb4-b3a11de24c46 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "GET /compute/v2.1/servers/b86b3db2-2f76-464d-b087-39deddd5a48e" status: 200 len: 1681 microversion: 2.1 time: 0.175911 Aug 24 11:46:05.673005 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 590/1217] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:46:05 2022] GET /compute/v2.1/servers/b86b3db2-2f76-464d-b087-39deddd5a48e => generated 1681 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:46:05.920924 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-42749f6f-e821-49d7-8f8d-22f4160d3b64 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:46:05.932604 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-42749f6f-e821-49d7-8f8d-22f4160d3b64 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: 2e661217-fb1a-48ad-9f1b-47985a4074de] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:46:05.932604 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-42749f6f-e821-49d7-8f8d-22f4160d3b64 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:46:05.932604 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-42749f6f-e821-49d7-8f8d-22f4160d3b64 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:46:05.932604 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-42749f6f-e821-49d7-8f8d-22f4160d3b64 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:46:05.933231 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-42749f6f-e821-49d7-8f8d-22f4160d3b64 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:46:05.933231 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-42749f6f-e821-49d7-8f8d-22f4160d3b64 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:46:05.933231 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-42749f6f-e821-49d7-8f8d-22f4160d3b64 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:46:05.945672 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.wsgi [None req-42749f6f-e821-49d7-8f8d-22f4160d3b64 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] HTTP exception thrown: Instance 2e661217-fb1a-48ad-9f1b-47985a4074de could not be found. Aug 24 11:46:05.947344 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-42749f6f-e821-49d7-8f8d-22f4160d3b64 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Request method failure captured: Aug 24 11:46:05.947344 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: request: DELETE /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de HTTP/1.1 Aug 24 11:46:05.947344 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Accept: application/json Aug 24 11:46:05.947344 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Accept-Encoding: identity Aug 24 11:46:05.947344 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Connection: close Aug 24 11:46:05.947344 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Content-Length: 0 Aug 24 11:46:05.947344 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Content-Type: application/json Aug 24 11:46:05.947344 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Host: 10.222.0.84 Aug 24 11:46:05.947344 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Openstack-System-Scope: None Aug 24 11:46:05.947344 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: User-Agent: python-urllib3/1.26.11 Aug 24 11:46:05.947344 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Auth-Token: gAAAAABjBgwjqMI9ytFP7VsVHRP_Ve7OKeTCX30XQiKKQRG2LSSGgytPnOci29Q2gHVmiSkSzv-ncMAbc9BWAtzjPMrEQ9DgQiqJHEsoVLsTI-7rEziZM2TxObMN3otskXoxjncEe9UfCmp-Knwv-1P3tr3F6dPE5AY_27hhfhxbUjks2TOg5-4 Aug 24 11:46:05.947344 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Domain-Id: None Aug 24 11:46:05.947344 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Domain-Name: None Aug 24 11:46:05.947344 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Identity-Status: Confirmed Aug 24 11:46:05.947344 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Is-Admin-Project: True Aug 24 11:46:05.947344 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 11:46:05.947344 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Project-Domain-Id: default Aug 24 11:46:05.947344 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Project-Domain-Name: Default Aug 24 11:46:05.947344 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Project-Id: 177e00cee82c44a196eaf5d0dc07b7f2 Aug 24 11:46:05.947344 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-585166699 Aug 24 11:46:05.947344 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Role: reader,member Aug 24 11:46:05.947344 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Roles: reader,member Aug 24 11:46:05.949703 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/volume/v3/177e00cee82c44a196eaf5d0dc07b7f2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/volume/v3/177e00cee82c44a196eaf5d0dc07b7f2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/compute/v2/177e00cee82c44a196eaf5d0dc07b7f2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84:8080/v1/AUTH_177e00cee82c44a196eaf5d0dc07b7f2", "adminURL": "http://10.222.0.84:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/placement"}]}] Aug 24 11:46:05.949703 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Tenant: tempest-AttachVolumeShelveTestJSON-585166699 Aug 24 11:46:05.949703 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Tenant-Id: 177e00cee82c44a196eaf5d0dc07b7f2 Aug 24 11:46:05.949703 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-585166699 Aug 24 11:46:05.949703 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-User: tempest-AttachVolumeShelveTestJSON-585166699-project Aug 24 11:46:05.949703 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-User-Domain-Id: default Aug 24 11:46:05.949703 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-User-Domain-Name: Default Aug 24 11:46:05.949703 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-User-Id: 4a80d0127ee349d69f0ed949bcb4c919 Aug 24 11:46:05.949703 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-User-Name: tempest-AttachVolumeShelveTestJSON-585166699-project Aug 24 11:46:05.949703 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: method: > Aug 24 11:46:05.949703 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: exception: Instance 2e661217-fb1a-48ad-9f1b-47985a4074de could not be found. Aug 24 11:46:05.949703 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: action_args: {'id': '2e661217-fb1a-48ad-9f1b-47985a4074de'} Aug 24 11:46:05.950549 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:46:05.950549 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:46:05.950549 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:46:05.950549 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:46:05.950549 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:46:05.950549 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:46:05.950549 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:46:05.950549 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:46:05.950549 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:46:05.950549 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:46:05.950549 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e661217-fb1a-48ad-9f1b-47985a4074de could not be found. Aug 24 11:46:05.950549 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Aug 24 11:46:05.950549 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:46:05.950549 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Aug 24 11:46:05.950549 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:46:05.950549 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:46:05.950549 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:46:05.950549 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:46:05.950549 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:46:05.950549 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:46:05.951909 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:46:05.951909 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 11:46:05.951909 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 11:46:05.951909 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 11:46:05.951909 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 11:46:05.951909 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:46:05.951909 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:46:05.951909 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:46:05.951909 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:46:05.951909 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e661217-fb1a-48ad-9f1b-47985a4074de could not be found. Aug 24 11:46:05.951909 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Aug 24 11:46:05.951909 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:46:05.951909 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Aug 24 11:46:05.951909 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:46:05.951909 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:46:05.951909 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:46:05.951909 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:46:05.951909 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:46:05.951909 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e661217-fb1a-48ad-9f1b-47985a4074de could not be found. Aug 24 11:46:05.951909 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Aug 24 11:46:05.953563 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-42749f6f-e821-49d7-8f8d-22f4160d3b64 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Returning 404 to user: Instance 2e661217-fb1a-48ad-9f1b-47985a4074de could not be found. {{(pid=124769) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:46:05.953563 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-42749f6f-e821-49d7-8f8d-22f4160d3b64 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "DELETE /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de" status: 404 len: 111 microversion: 2.20 time: 0.033333 Aug 24 11:46:05.953563 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 628/1218] 10.222.0.84 () {60 vars in 1280 bytes} [Wed Aug 24 11:46:05 2022] DELETE /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 11:46:05.960034 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-e0121834-4f19-453c-9443-cd5435588611 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:46:05.960724 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-e0121834-4f19-453c-9443-cd5435588611 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] [instance: 2e661217-fb1a-48ad-9f1b-47985a4074de] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:46:05.967109 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e0121834-4f19-453c-9443-cd5435588611 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:46:05.967595 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e0121834-4f19-453c-9443-cd5435588611 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:46:05.968060 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e0121834-4f19-453c-9443-cd5435588611 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:46:05.968990 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e0121834-4f19-453c-9443-cd5435588611 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:46:05.969311 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e0121834-4f19-453c-9443-cd5435588611 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:46:05.969730 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e0121834-4f19-453c-9443-cd5435588611 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:46:05.983962 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.wsgi [None req-e0121834-4f19-453c-9443-cd5435588611 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] HTTP exception thrown: Instance 2e661217-fb1a-48ad-9f1b-47985a4074de could not be found. Aug 24 11:46:05.985637 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-e0121834-4f19-453c-9443-cd5435588611 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Request method failure captured: Aug 24 11:46:05.985637 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: request: GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de HTTP/1.1 Aug 24 11:46:05.985637 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Accept: application/json Aug 24 11:46:05.985637 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Accept-Encoding: identity Aug 24 11:46:05.985637 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Connection: close Aug 24 11:46:05.985637 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Content-Length: 0 Aug 24 11:46:05.985637 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Content-Type: application/json Aug 24 11:46:05.985637 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Host: 10.222.0.84 Aug 24 11:46:05.985637 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Openstack-System-Scope: None Aug 24 11:46:05.985637 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: User-Agent: python-urllib3/1.26.11 Aug 24 11:46:05.985637 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Auth-Token: gAAAAABjBgwjqMI9ytFP7VsVHRP_Ve7OKeTCX30XQiKKQRG2LSSGgytPnOci29Q2gHVmiSkSzv-ncMAbc9BWAtzjPMrEQ9DgQiqJHEsoVLsTI-7rEziZM2TxObMN3otskXoxjncEe9UfCmp-Knwv-1P3tr3F6dPE5AY_27hhfhxbUjks2TOg5-4 Aug 24 11:46:05.985637 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Domain-Id: None Aug 24 11:46:05.985637 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Domain-Name: None Aug 24 11:46:05.985637 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Identity-Status: Confirmed Aug 24 11:46:05.985637 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Is-Admin-Project: True Aug 24 11:46:05.985637 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 11:46:05.985637 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Project-Domain-Id: default Aug 24 11:46:05.985637 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Project-Domain-Name: Default Aug 24 11:46:05.985637 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Project-Id: 177e00cee82c44a196eaf5d0dc07b7f2 Aug 24 11:46:05.985637 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-585166699 Aug 24 11:46:05.985637 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Role: reader,member Aug 24 11:46:05.985637 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Roles: reader,member Aug 24 11:46:05.987440 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/volume/v3/177e00cee82c44a196eaf5d0dc07b7f2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/volume/v3/177e00cee82c44a196eaf5d0dc07b7f2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/compute/v2/177e00cee82c44a196eaf5d0dc07b7f2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84:8080/v1/AUTH_177e00cee82c44a196eaf5d0dc07b7f2", "adminURL": "http://10.222.0.84:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/placement"}]}] Aug 24 11:46:05.987440 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Tenant: tempest-AttachVolumeShelveTestJSON-585166699 Aug 24 11:46:05.987440 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Tenant-Id: 177e00cee82c44a196eaf5d0dc07b7f2 Aug 24 11:46:05.987440 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-585166699 Aug 24 11:46:05.987440 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User: tempest-AttachVolumeShelveTestJSON-585166699-project Aug 24 11:46:05.987440 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User-Domain-Id: default Aug 24 11:46:05.987440 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User-Domain-Name: Default Aug 24 11:46:05.987440 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User-Id: 4a80d0127ee349d69f0ed949bcb4c919 Aug 24 11:46:05.987440 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User-Name: tempest-AttachVolumeShelveTestJSON-585166699-project Aug 24 11:46:05.987440 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: method: > Aug 24 11:46:05.987440 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: exception: Instance 2e661217-fb1a-48ad-9f1b-47985a4074de could not be found. Aug 24 11:46:05.987440 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: action_args: {'id': '2e661217-fb1a-48ad-9f1b-47985a4074de'} Aug 24 11:46:05.988430 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:46:05.988430 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:46:05.988430 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:46:05.988430 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:46:05.988430 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:46:05.988430 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:46:05.988430 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:46:05.988430 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:46:05.988430 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:46:05.988430 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:46:05.988430 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e661217-fb1a-48ad-9f1b-47985a4074de could not be found. Aug 24 11:46:05.988430 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:46:05.988430 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:46:05.988430 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:46:05.988430 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:46:05.988430 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:46:05.988430 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:46:05.988430 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:46:05.988430 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:46:05.988430 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:46:05.996541 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:46:05.996541 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:46:05.996541 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:46:05.996541 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:46:05.996541 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:46:05.996541 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:46:05.996541 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:46:05.996541 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e661217-fb1a-48ad-9f1b-47985a4074de could not be found. Aug 24 11:46:05.996541 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:46:05.996541 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:46:05.996541 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:46:05.996541 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:46:05.996541 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:46:05.996541 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:46:05.996541 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:46:05.996541 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:46:05.996541 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e661217-fb1a-48ad-9f1b-47985a4074de could not be found. Aug 24 11:46:05.996541 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:46:05.999160 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-e0121834-4f19-453c-9443-cd5435588611 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] Returning 404 to user: Instance 2e661217-fb1a-48ad-9f1b-47985a4074de could not be found. {{(pid=124770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:46:05.999160 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-e0121834-4f19-453c-9443-cd5435588611 tempest-AttachVolumeShelveTestJSON-585166699 tempest-AttachVolumeShelveTestJSON-585166699-project] 10.222.0.84 "GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de" status: 404 len: 111 microversion: 2.20 time: 0.031046 Aug 24 11:46:05.999160 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 591/1219] 10.222.0.84 () {60 vars in 1277 bytes} [Wed Aug 24 11:46:05 2022] GET /compute/v2.1/servers/2e661217-fb1a-48ad-9f1b-47985a4074de => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 11:46:06.695909 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-d80f4bae-20b5-46da-bdec-28e358182ad1 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:46:06.696972 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-d80f4bae-20b5-46da-bdec-28e358182ad1 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: b86b3db2-2f76-464d-b087-39deddd5a48e] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:46:06.704472 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-d80f4bae-20b5-46da-bdec-28e358182ad1 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:46:06.705422 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-d80f4bae-20b5-46da-bdec-28e358182ad1 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:46:06.705993 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-d80f4bae-20b5-46da-bdec-28e358182ad1 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:46:06.706774 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-d80f4bae-20b5-46da-bdec-28e358182ad1 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:46:06.707302 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-d80f4bae-20b5-46da-bdec-28e358182ad1 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:46:06.707807 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-d80f4bae-20b5-46da-bdec-28e358182ad1 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:46:06.727382 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG dbcounter [-] [124769] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:46:06.998409 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-d80f4bae-20b5-46da-bdec-28e358182ad1 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2715cf2a5129439c83a5347bb963f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4159dc366f41bc9e4057a079f6fb5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:46:07.014097 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-d80f4bae-20b5-46da-bdec-28e358182ad1 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "GET /compute/v2.1/servers/b86b3db2-2f76-464d-b087-39deddd5a48e" status: 200 len: 1681 microversion: 2.1 time: 0.323535 Aug 24 11:46:07.014787 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 629/1220] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:46:06 2022] GET /compute/v2.1/servers/b86b3db2-2f76-464d-b087-39deddd5a48e => generated 1681 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:46:07.641356 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [req-73baf562-0459-4650-b705-fea35de64894 req-ab0f8660-15e2-4e7e-bcad-de741743c09f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b86b3db2-2f76-464d-b087-39deddd5a48e", "name": "network-vif-deleted", "tag": "73a82f8e-4955-4b47-9cb6-a410213182dc"}]} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:46:07.652151 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-73baf562-0459-4650-b705-fea35de64894 req-ab0f8660-15e2-4e7e-bcad-de741743c09f service nova] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:46:07.653062 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-73baf562-0459-4650-b705-fea35de64894 req-ab0f8660-15e2-4e7e-bcad-de741743c09f service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:46:07.653748 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-73baf562-0459-4650-b705-fea35de64894 req-ab0f8660-15e2-4e7e-bcad-de741743c09f service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:46:07.666891 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.compute.server_external_events [req-73baf562-0459-4650-b705-fea35de64894 req-ab0f8660-15e2-4e7e-bcad-de741743c09f service nova] Creating event network-vif-deleted:73a82f8e-4955-4b47-9cb6-a410213182dc for instance b86b3db2-2f76-464d-b087-39deddd5a48e on hv-cinder-85427 Aug 24 11:46:07.673741 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [req-73baf562-0459-4650-b705-fea35de64894 req-ab0f8660-15e2-4e7e-bcad-de741743c09f service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039734 Aug 24 11:46:07.674901 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 592/1221] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Aug 24 11:46:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:46:08.035986 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-2c3cb735-afe8-4902-9072-80c06de68352 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:46:08.036666 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-2c3cb735-afe8-4902-9072-80c06de68352 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: b86b3db2-2f76-464d-b087-39deddd5a48e] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:46:08.048047 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-2c3cb735-afe8-4902-9072-80c06de68352 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:46:08.048945 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-2c3cb735-afe8-4902-9072-80c06de68352 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:46:08.049614 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-2c3cb735-afe8-4902-9072-80c06de68352 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:46:08.050608 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-2c3cb735-afe8-4902-9072-80c06de68352 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:46:08.051254 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-2c3cb735-afe8-4902-9072-80c06de68352 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:46:08.051874 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-2c3cb735-afe8-4902-9072-80c06de68352 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:46:08.089234 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-2c3cb735-afe8-4902-9072-80c06de68352 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:46:08.090077 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-2c3cb735-afe8-4902-9072-80c06de68352 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:46:08.090698 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-2c3cb735-afe8-4902-9072-80c06de68352 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:46:08.091362 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.objects.instance [None req-2c3cb735-afe8-4902-9072-80c06de68352 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lazy-loading 'fault' on Instance uuid b86b3db2-2f76-464d-b087-39deddd5a48e {{(pid=124769) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:46:08.150999 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-2c3cb735-afe8-4902-9072-80c06de68352 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2715cf2a5129439c83a5347bb963f1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4159dc366f41bc9e4057a079f6fb5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:46:08.161836 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-2c3cb735-afe8-4902-9072-80c06de68352 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "GET /compute/v2.1/servers/b86b3db2-2f76-464d-b087-39deddd5a48e" status: 200 len: 1331 microversion: 2.1 time: 0.129642 Aug 24 11:46:08.172316 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 630/1222] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:46:08 2022] GET /compute/v2.1/servers/b86b3db2-2f76-464d-b087-39deddd5a48e => generated 1331 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:46:09.185296 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-d8916325-6232-481b-a69a-3a580aa7abdc tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:46:09.186014 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-d8916325-6232-481b-a69a-3a580aa7abdc tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: b86b3db2-2f76-464d-b087-39deddd5a48e] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:46:09.196392 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d8916325-6232-481b-a69a-3a580aa7abdc tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:46:09.196899 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d8916325-6232-481b-a69a-3a580aa7abdc tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:46:09.197393 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d8916325-6232-481b-a69a-3a580aa7abdc tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:46:09.199058 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d8916325-6232-481b-a69a-3a580aa7abdc tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:46:09.199742 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d8916325-6232-481b-a69a-3a580aa7abdc tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:46:09.200436 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d8916325-6232-481b-a69a-3a580aa7abdc tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:46:09.219468 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.wsgi [None req-d8916325-6232-481b-a69a-3a580aa7abdc tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] HTTP exception thrown: Instance b86b3db2-2f76-464d-b087-39deddd5a48e could not be found. Aug 24 11:46:09.221872 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-d8916325-6232-481b-a69a-3a580aa7abdc tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Request method failure captured: Aug 24 11:46:09.221872 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: request: GET /compute/v2.1/servers/b86b3db2-2f76-464d-b087-39deddd5a48e HTTP/1.1 Aug 24 11:46:09.221872 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Accept: application/json Aug 24 11:46:09.221872 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Accept-Encoding: identity Aug 24 11:46:09.221872 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Connection: close Aug 24 11:46:09.221872 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Content-Length: 0 Aug 24 11:46:09.221872 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Content-Type: application/json Aug 24 11:46:09.221872 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Host: 10.222.0.84 Aug 24 11:46:09.221872 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Openstack-System-Scope: None Aug 24 11:46:09.221872 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: User-Agent: python-urllib3/1.26.11 Aug 24 11:46:09.221872 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Auth-Token: gAAAAABjBgweR4cEvCTKaEtRPVxZbNsTt1me1RX2L8orBaoPmyfbKHmzEiPGrzhUPAZ-dVqobDImAozYNHZy-giT-StyTeTjwVyRR-kCHyxEj3vuiJ5-SAwaDdad7hiiarcqgu_OA8lN_aNGemV1KcSFFCiGn60rq1bxi6ViCi6rFYftaJqzRGY Aug 24 11:46:09.221872 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Domain-Id: None Aug 24 11:46:09.221872 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Domain-Name: None Aug 24 11:46:09.221872 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Identity-Status: Confirmed Aug 24 11:46:09.221872 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Is-Admin-Project: True Aug 24 11:46:09.221872 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Project-Domain-Id: default Aug 24 11:46:09.221872 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Project-Domain-Name: Default Aug 24 11:46:09.221872 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Project-Id: 4a4159dc366f41bc9e4057a079f6fb5a Aug 24 11:46:09.221872 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Project-Name: tempest-AttachVolumeNegativeTest-1758140935 Aug 24 11:46:09.221872 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Role: reader,member Aug 24 11:46:09.221872 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Roles: reader,member Aug 24 11:46:09.223559 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/volume/v3/4a4159dc366f41bc9e4057a079f6fb5a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/volume/v3/4a4159dc366f41bc9e4057a079f6fb5a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/compute/v2/4a4159dc366f41bc9e4057a079f6fb5a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84:8080/v1/AUTH_4a4159dc366f41bc9e4057a079f6fb5a", "adminURL": "http://10.222.0.84:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/placement"}]}] Aug 24 11:46:09.223559 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Tenant: tempest-AttachVolumeNegativeTest-1758140935 Aug 24 11:46:09.223559 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Tenant-Id: 4a4159dc366f41bc9e4057a079f6fb5a Aug 24 11:46:09.223559 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1758140935 Aug 24 11:46:09.223559 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User: tempest-AttachVolumeNegativeTest-1758140935-project Aug 24 11:46:09.223559 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User-Domain-Id: default Aug 24 11:46:09.223559 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User-Domain-Name: Default Aug 24 11:46:09.223559 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User-Id: 2715cf2a5129439c83a5347bb963f1a9 Aug 24 11:46:09.223559 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User-Name: tempest-AttachVolumeNegativeTest-1758140935-project Aug 24 11:46:09.223559 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: method: > Aug 24 11:46:09.223559 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: exception: Instance b86b3db2-2f76-464d-b087-39deddd5a48e could not be found. Aug 24 11:46:09.223559 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: action_args: {'id': 'b86b3db2-2f76-464d-b087-39deddd5a48e'} Aug 24 11:46:09.224484 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:46:09.224484 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:46:09.224484 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:46:09.224484 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:46:09.224484 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:46:09.224484 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:46:09.224484 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:46:09.224484 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:46:09.224484 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:46:09.224484 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:46:09.224484 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b86b3db2-2f76-464d-b087-39deddd5a48e could not be found. Aug 24 11:46:09.224484 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:46:09.224484 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:46:09.224484 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:46:09.224484 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:46:09.224484 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:46:09.224484 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:46:09.224484 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:46:09.224484 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:46:09.224484 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:46:09.226016 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:46:09.226016 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:46:09.226016 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:46:09.226016 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:46:09.226016 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:46:09.226016 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:46:09.226016 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:46:09.226016 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b86b3db2-2f76-464d-b087-39deddd5a48e could not be found. Aug 24 11:46:09.226016 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:46:09.226016 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:46:09.226016 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:46:09.226016 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:46:09.226016 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:46:09.226016 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:46:09.226016 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:46:09.226016 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:46:09.226016 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b86b3db2-2f76-464d-b087-39deddd5a48e could not be found. Aug 24 11:46:09.226016 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:46:09.229521 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-d8916325-6232-481b-a69a-3a580aa7abdc tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Returning 404 to user: Instance b86b3db2-2f76-464d-b087-39deddd5a48e could not be found. {{(pid=124770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:46:09.230566 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-d8916325-6232-481b-a69a-3a580aa7abdc tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "GET /compute/v2.1/servers/b86b3db2-2f76-464d-b087-39deddd5a48e" status: 404 len: 111 microversion: 2.1 time: 0.050742 Aug 24 11:46:09.231498 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 593/1223] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:46:09 2022] GET /compute/v2.1/servers/b86b3db2-2f76-464d-b087-39deddd5a48e => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:46:09.248336 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-78f612c1-0a25-4fc3-a208-11ce196a93db tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '.version_select at 0x7f0e2a69f3a0>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:46:09.364505 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-78f612c1-0a25-4fc3-a208-11ce196a93db tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1875491419" status: 202 len: 0 microversion: 2.1 time: 0.128066 Aug 24 11:46:09.366226 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 631/1224] 10.222.0.84 () {58 vars in 1221 bytes} [Wed Aug 24 11:46:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1875491419 => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:46:11.792667 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-cfd4f89a-c441-4aaa-9434-45cd9302be8b tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:46:11.793290 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-cfd4f89a-c441-4aaa-9434-45cd9302be8b tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: b86b3db2-2f76-464d-b087-39deddd5a48e] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:46:11.799893 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-cfd4f89a-c441-4aaa-9434-45cd9302be8b tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:46:11.800386 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-cfd4f89a-c441-4aaa-9434-45cd9302be8b tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:46:11.800858 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-cfd4f89a-c441-4aaa-9434-45cd9302be8b tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:46:11.801571 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-cfd4f89a-c441-4aaa-9434-45cd9302be8b tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:46:11.802037 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-cfd4f89a-c441-4aaa-9434-45cd9302be8b tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:46:11.802463 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-cfd4f89a-c441-4aaa-9434-45cd9302be8b tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:46:11.817507 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.wsgi [None req-cfd4f89a-c441-4aaa-9434-45cd9302be8b tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] HTTP exception thrown: Instance b86b3db2-2f76-464d-b087-39deddd5a48e could not be found. Aug 24 11:46:11.819134 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-cfd4f89a-c441-4aaa-9434-45cd9302be8b tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Request method failure captured: Aug 24 11:46:11.819134 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: request: DELETE /compute/v2.1/servers/b86b3db2-2f76-464d-b087-39deddd5a48e HTTP/1.1 Aug 24 11:46:11.819134 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Accept: application/json Aug 24 11:46:11.819134 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Accept-Encoding: identity Aug 24 11:46:11.819134 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Connection: close Aug 24 11:46:11.819134 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Content-Length: 0 Aug 24 11:46:11.819134 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Content-Type: application/json Aug 24 11:46:11.819134 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Host: 10.222.0.84 Aug 24 11:46:11.819134 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Openstack-System-Scope: None Aug 24 11:46:11.819134 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: User-Agent: python-urllib3/1.26.11 Aug 24 11:46:11.819134 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Auth-Token: gAAAAABjBgweR4cEvCTKaEtRPVxZbNsTt1me1RX2L8orBaoPmyfbKHmzEiPGrzhUPAZ-dVqobDImAozYNHZy-giT-StyTeTjwVyRR-kCHyxEj3vuiJ5-SAwaDdad7hiiarcqgu_OA8lN_aNGemV1KcSFFCiGn60rq1bxi6ViCi6rFYftaJqzRGY Aug 24 11:46:11.819134 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Domain-Id: None Aug 24 11:46:11.819134 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Domain-Name: None Aug 24 11:46:11.819134 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Identity-Status: Confirmed Aug 24 11:46:11.819134 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Is-Admin-Project: True Aug 24 11:46:11.819134 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Project-Domain-Id: default Aug 24 11:46:11.819134 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Project-Domain-Name: Default Aug 24 11:46:11.819134 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Project-Id: 4a4159dc366f41bc9e4057a079f6fb5a Aug 24 11:46:11.819134 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Project-Name: tempest-AttachVolumeNegativeTest-1758140935 Aug 24 11:46:11.819134 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Role: reader,member Aug 24 11:46:11.819134 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Roles: reader,member Aug 24 11:46:11.820770 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/volume/v3/4a4159dc366f41bc9e4057a079f6fb5a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/volume/v3/4a4159dc366f41bc9e4057a079f6fb5a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/compute/v2/4a4159dc366f41bc9e4057a079f6fb5a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84:8080/v1/AUTH_4a4159dc366f41bc9e4057a079f6fb5a", "adminURL": "http://10.222.0.84:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/placement"}]}] Aug 24 11:46:11.820770 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Tenant: tempest-AttachVolumeNegativeTest-1758140935 Aug 24 11:46:11.820770 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Tenant-Id: 4a4159dc366f41bc9e4057a079f6fb5a Aug 24 11:46:11.820770 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1758140935 Aug 24 11:46:11.820770 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User: tempest-AttachVolumeNegativeTest-1758140935-project Aug 24 11:46:11.820770 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User-Domain-Id: default Aug 24 11:46:11.820770 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User-Domain-Name: Default Aug 24 11:46:11.820770 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User-Id: 2715cf2a5129439c83a5347bb963f1a9 Aug 24 11:46:11.820770 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User-Name: tempest-AttachVolumeNegativeTest-1758140935-project Aug 24 11:46:11.820770 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: method: > Aug 24 11:46:11.820770 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: exception: Instance b86b3db2-2f76-464d-b087-39deddd5a48e could not be found. Aug 24 11:46:11.820770 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: action_args: {'id': 'b86b3db2-2f76-464d-b087-39deddd5a48e'} Aug 24 11:46:11.821677 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:46:11.821677 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:46:11.821677 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:46:11.821677 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:46:11.821677 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:46:11.821677 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:46:11.821677 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:46:11.821677 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:46:11.821677 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:46:11.821677 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:46:11.821677 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b86b3db2-2f76-464d-b087-39deddd5a48e could not be found. Aug 24 11:46:11.821677 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:46:11.821677 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:46:11.821677 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:46:11.821677 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:46:11.821677 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:46:11.821677 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:46:11.821677 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:46:11.821677 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:46:11.821677 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:46:11.823683 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:46:11.823683 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 11:46:11.823683 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 11:46:11.823683 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 11:46:11.823683 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 11:46:11.823683 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:46:11.823683 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:46:11.823683 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:46:11.823683 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:46:11.823683 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b86b3db2-2f76-464d-b087-39deddd5a48e could not be found. Aug 24 11:46:11.823683 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:46:11.823683 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:46:11.823683 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:46:11.823683 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:46:11.823683 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:46:11.823683 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:46:11.823683 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:46:11.823683 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:46:11.823683 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b86b3db2-2f76-464d-b087-39deddd5a48e could not be found. Aug 24 11:46:11.823683 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:46:11.825205 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-cfd4f89a-c441-4aaa-9434-45cd9302be8b tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Returning 404 to user: Instance b86b3db2-2f76-464d-b087-39deddd5a48e could not be found. {{(pid=124770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:46:11.825205 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-cfd4f89a-c441-4aaa-9434-45cd9302be8b tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "DELETE /compute/v2.1/servers/b86b3db2-2f76-464d-b087-39deddd5a48e" status: 404 len: 111 microversion: 2.1 time: 0.033112 Aug 24 11:46:11.825205 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 594/1225] 10.222.0.84 () {58 vars in 1239 bytes} [Wed Aug 24 11:46:11 2022] DELETE /compute/v2.1/servers/b86b3db2-2f76-464d-b087-39deddd5a48e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 11:46:11.831117 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-79b9e436-5ae7-4639-8670-f57c562ceb6e tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:46:11.832178 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-79b9e436-5ae7-4639-8670-f57c562ceb6e tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: b86b3db2-2f76-464d-b087-39deddd5a48e] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:46:11.838947 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-79b9e436-5ae7-4639-8670-f57c562ceb6e tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:46:11.842827 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-79b9e436-5ae7-4639-8670-f57c562ceb6e tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:46:11.842827 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-79b9e436-5ae7-4639-8670-f57c562ceb6e tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:46:11.842827 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-79b9e436-5ae7-4639-8670-f57c562ceb6e tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:46:11.842827 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-79b9e436-5ae7-4639-8670-f57c562ceb6e tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:46:11.843280 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-79b9e436-5ae7-4639-8670-f57c562ceb6e tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:46:11.855728 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.wsgi [None req-79b9e436-5ae7-4639-8670-f57c562ceb6e tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] HTTP exception thrown: Instance b86b3db2-2f76-464d-b087-39deddd5a48e could not be found. Aug 24 11:46:11.857348 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-79b9e436-5ae7-4639-8670-f57c562ceb6e tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Request method failure captured: Aug 24 11:46:11.857348 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: request: GET /compute/v2.1/servers/b86b3db2-2f76-464d-b087-39deddd5a48e HTTP/1.1 Aug 24 11:46:11.857348 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Accept: application/json Aug 24 11:46:11.857348 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Accept-Encoding: identity Aug 24 11:46:11.857348 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Connection: close Aug 24 11:46:11.857348 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Content-Length: 0 Aug 24 11:46:11.857348 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Content-Type: application/json Aug 24 11:46:11.857348 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Host: 10.222.0.84 Aug 24 11:46:11.857348 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Openstack-System-Scope: None Aug 24 11:46:11.857348 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: User-Agent: python-urllib3/1.26.11 Aug 24 11:46:11.857348 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Auth-Token: gAAAAABjBgweR4cEvCTKaEtRPVxZbNsTt1me1RX2L8orBaoPmyfbKHmzEiPGrzhUPAZ-dVqobDImAozYNHZy-giT-StyTeTjwVyRR-kCHyxEj3vuiJ5-SAwaDdad7hiiarcqgu_OA8lN_aNGemV1KcSFFCiGn60rq1bxi6ViCi6rFYftaJqzRGY Aug 24 11:46:11.857348 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Domain-Id: None Aug 24 11:46:11.857348 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Domain-Name: None Aug 24 11:46:11.857348 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Identity-Status: Confirmed Aug 24 11:46:11.857348 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Is-Admin-Project: True Aug 24 11:46:11.857348 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Project-Domain-Id: default Aug 24 11:46:11.857348 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Project-Domain-Name: Default Aug 24 11:46:11.857348 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Project-Id: 4a4159dc366f41bc9e4057a079f6fb5a Aug 24 11:46:11.857348 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Project-Name: tempest-AttachVolumeNegativeTest-1758140935 Aug 24 11:46:11.857348 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Role: reader,member Aug 24 11:46:11.857348 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Roles: reader,member Aug 24 11:46:11.859062 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/volume/v3/4a4159dc366f41bc9e4057a079f6fb5a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/volume/v3/4a4159dc366f41bc9e4057a079f6fb5a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/compute/v2/4a4159dc366f41bc9e4057a079f6fb5a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84:8080/v1/AUTH_4a4159dc366f41bc9e4057a079f6fb5a", "adminURL": "http://10.222.0.84:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/placement"}]}] Aug 24 11:46:11.859062 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Tenant: tempest-AttachVolumeNegativeTest-1758140935 Aug 24 11:46:11.859062 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Tenant-Id: 4a4159dc366f41bc9e4057a079f6fb5a Aug 24 11:46:11.859062 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1758140935 Aug 24 11:46:11.859062 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-User: tempest-AttachVolumeNegativeTest-1758140935-project Aug 24 11:46:11.859062 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-User-Domain-Id: default Aug 24 11:46:11.859062 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-User-Domain-Name: Default Aug 24 11:46:11.859062 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-User-Id: 2715cf2a5129439c83a5347bb963f1a9 Aug 24 11:46:11.859062 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-User-Name: tempest-AttachVolumeNegativeTest-1758140935-project Aug 24 11:46:11.859062 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: method: > Aug 24 11:46:11.859062 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: exception: Instance b86b3db2-2f76-464d-b087-39deddd5a48e could not be found. Aug 24 11:46:11.859062 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: action_args: {'id': 'b86b3db2-2f76-464d-b087-39deddd5a48e'} Aug 24 11:46:11.859915 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:46:11.859915 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:46:11.859915 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:46:11.859915 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:46:11.859915 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:46:11.859915 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:46:11.859915 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:46:11.859915 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:46:11.859915 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:46:11.859915 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:46:11.859915 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b86b3db2-2f76-464d-b087-39deddd5a48e could not be found. Aug 24 11:46:11.859915 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Aug 24 11:46:11.859915 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:46:11.859915 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Aug 24 11:46:11.859915 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:46:11.859915 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:46:11.859915 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:46:11.859915 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:46:11.859915 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:46:11.859915 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:46:11.861342 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:46:11.861342 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:46:11.861342 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:46:11.861342 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:46:11.861342 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:46:11.861342 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:46:11.861342 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:46:11.861342 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b86b3db2-2f76-464d-b087-39deddd5a48e could not be found. Aug 24 11:46:11.861342 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Aug 24 11:46:11.861342 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:46:11.861342 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Aug 24 11:46:11.861342 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:46:11.861342 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:46:11.861342 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:46:11.861342 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:46:11.861342 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:46:11.861342 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b86b3db2-2f76-464d-b087-39deddd5a48e could not be found. Aug 24 11:46:11.861342 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Aug 24 11:46:11.862444 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-79b9e436-5ae7-4639-8670-f57c562ceb6e tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Returning 404 to user: Instance b86b3db2-2f76-464d-b087-39deddd5a48e could not be found. {{(pid=124769) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:46:11.862444 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-79b9e436-5ae7-4639-8670-f57c562ceb6e tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "GET /compute/v2.1/servers/b86b3db2-2f76-464d-b087-39deddd5a48e" status: 404 len: 111 microversion: 2.1 time: 0.032527 Aug 24 11:46:11.862444 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 632/1226] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:46:11 2022] GET /compute/v2.1/servers/b86b3db2-2f76-464d-b087-39deddd5a48e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:46:18.517103 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-b9291d7d-8e39-466d-b0b7-f1ccb8b21ed5 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:46:18.517628 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-b9291d7d-8e39-466d-b0b7-f1ccb8b21ed5 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: 4b0af30d-b2e2-466a-bc9b-50ae86e6af28] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:46:18.520178 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:46:18.524927 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b9291d7d-8e39-466d-b0b7-f1ccb8b21ed5 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:46:18.531302 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b9291d7d-8e39-466d-b0b7-f1ccb8b21ed5 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:46:18.531302 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b9291d7d-8e39-466d-b0b7-f1ccb8b21ed5 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:46:18.531302 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b9291d7d-8e39-466d-b0b7-f1ccb8b21ed5 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:46:18.531302 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b9291d7d-8e39-466d-b0b7-f1ccb8b21ed5 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:46:18.531704 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b9291d7d-8e39-466d-b0b7-f1ccb8b21ed5 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:46:18.541976 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.wsgi [None req-b9291d7d-8e39-466d-b0b7-f1ccb8b21ed5 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] HTTP exception thrown: Instance 4b0af30d-b2e2-466a-bc9b-50ae86e6af28 could not be found. Aug 24 11:46:18.543561 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-b9291d7d-8e39-466d-b0b7-f1ccb8b21ed5 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Request method failure captured: Aug 24 11:46:18.543561 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: request: DELETE /compute/v2.1/servers/4b0af30d-b2e2-466a-bc9b-50ae86e6af28 HTTP/1.1 Aug 24 11:46:18.543561 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Accept: application/json Aug 24 11:46:18.543561 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Accept-Encoding: identity Aug 24 11:46:18.543561 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Connection: close Aug 24 11:46:18.543561 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Content-Length: 0 Aug 24 11:46:18.543561 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Content-Type: application/json Aug 24 11:46:18.543561 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Host: 10.222.0.84 Aug 24 11:46:18.543561 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Openstack-System-Scope: None Aug 24 11:46:18.543561 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: User-Agent: python-urllib3/1.26.11 Aug 24 11:46:18.543561 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Auth-Token: gAAAAABjBgweR4cEvCTKaEtRPVxZbNsTt1me1RX2L8orBaoPmyfbKHmzEiPGrzhUPAZ-dVqobDImAozYNHZy-giT-StyTeTjwVyRR-kCHyxEj3vuiJ5-SAwaDdad7hiiarcqgu_OA8lN_aNGemV1KcSFFCiGn60rq1bxi6ViCi6rFYftaJqzRGY Aug 24 11:46:18.543561 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Domain-Id: None Aug 24 11:46:18.543561 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Domain-Name: None Aug 24 11:46:18.543561 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Identity-Status: Confirmed Aug 24 11:46:18.543561 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Is-Admin-Project: True Aug 24 11:46:18.543561 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Project-Domain-Id: default Aug 24 11:46:18.543561 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Project-Domain-Name: Default Aug 24 11:46:18.543561 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Project-Id: 4a4159dc366f41bc9e4057a079f6fb5a Aug 24 11:46:18.543561 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Project-Name: tempest-AttachVolumeNegativeTest-1758140935 Aug 24 11:46:18.543561 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Role: reader,member Aug 24 11:46:18.543561 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Roles: reader,member Aug 24 11:46:18.545263 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/volume/v3/4a4159dc366f41bc9e4057a079f6fb5a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/volume/v3/4a4159dc366f41bc9e4057a079f6fb5a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/compute/v2/4a4159dc366f41bc9e4057a079f6fb5a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84:8080/v1/AUTH_4a4159dc366f41bc9e4057a079f6fb5a", "adminURL": "http://10.222.0.84:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/placement"}]}] Aug 24 11:46:18.545263 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Tenant: tempest-AttachVolumeNegativeTest-1758140935 Aug 24 11:46:18.545263 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Tenant-Id: 4a4159dc366f41bc9e4057a079f6fb5a Aug 24 11:46:18.545263 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1758140935 Aug 24 11:46:18.545263 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User: tempest-AttachVolumeNegativeTest-1758140935-project Aug 24 11:46:18.545263 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User-Domain-Id: default Aug 24 11:46:18.545263 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User-Domain-Name: Default Aug 24 11:46:18.545263 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User-Id: 2715cf2a5129439c83a5347bb963f1a9 Aug 24 11:46:18.545263 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User-Name: tempest-AttachVolumeNegativeTest-1758140935-project Aug 24 11:46:18.545263 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: method: > Aug 24 11:46:18.545263 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: exception: Instance 4b0af30d-b2e2-466a-bc9b-50ae86e6af28 could not be found. Aug 24 11:46:18.545263 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: action_args: {'id': '4b0af30d-b2e2-466a-bc9b-50ae86e6af28'} Aug 24 11:46:18.546206 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:46:18.546206 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:46:18.546206 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:46:18.546206 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:46:18.546206 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:46:18.546206 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:46:18.546206 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:46:18.546206 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:46:18.546206 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:46:18.546206 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:46:18.546206 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b0af30d-b2e2-466a-bc9b-50ae86e6af28 could not be found. Aug 24 11:46:18.546206 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:46:18.546206 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:46:18.546206 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:46:18.546206 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:46:18.546206 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:46:18.546206 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:46:18.546206 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:46:18.546206 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:46:18.546206 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:46:18.547718 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:46:18.547718 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 11:46:18.547718 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 11:46:18.547718 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 11:46:18.547718 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 11:46:18.547718 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:46:18.547718 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:46:18.547718 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:46:18.547718 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:46:18.547718 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b0af30d-b2e2-466a-bc9b-50ae86e6af28 could not be found. Aug 24 11:46:18.547718 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:46:18.547718 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:46:18.547718 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:46:18.547718 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:46:18.547718 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:46:18.547718 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:46:18.547718 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:46:18.547718 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:46:18.547718 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b0af30d-b2e2-466a-bc9b-50ae86e6af28 could not be found. Aug 24 11:46:18.547718 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:46:18.549280 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-b9291d7d-8e39-466d-b0b7-f1ccb8b21ed5 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Returning 404 to user: Instance 4b0af30d-b2e2-466a-bc9b-50ae86e6af28 could not be found. {{(pid=124770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:46:18.549280 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-b9291d7d-8e39-466d-b0b7-f1ccb8b21ed5 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "DELETE /compute/v2.1/servers/4b0af30d-b2e2-466a-bc9b-50ae86e6af28" status: 404 len: 111 microversion: 2.1 time: 0.031693 Aug 24 11:46:18.549280 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 595/1227] 10.222.0.84 () {58 vars in 1239 bytes} [Wed Aug 24 11:46:18 2022] DELETE /compute/v2.1/servers/4b0af30d-b2e2-466a-bc9b-50ae86e6af28 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:46:18.553663 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-f480e823-be7c-4e3e-9175-e13f9adfb50b tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:46:18.554279 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-f480e823-be7c-4e3e-9175-e13f9adfb50b tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: 4b0af30d-b2e2-466a-bc9b-50ae86e6af28] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:46:18.556702 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG dbcounter [-] [124769] Writing DB stats nova_api:SELECT=52,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=124769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:46:18.561415 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f480e823-be7c-4e3e-9175-e13f9adfb50b tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:46:18.561895 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f480e823-be7c-4e3e-9175-e13f9adfb50b tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:46:18.562331 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f480e823-be7c-4e3e-9175-e13f9adfb50b tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:46:18.563012 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f480e823-be7c-4e3e-9175-e13f9adfb50b tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:46:18.563786 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f480e823-be7c-4e3e-9175-e13f9adfb50b tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:46:18.563899 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f480e823-be7c-4e3e-9175-e13f9adfb50b tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:46:18.577691 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.wsgi [None req-f480e823-be7c-4e3e-9175-e13f9adfb50b tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] HTTP exception thrown: Instance 4b0af30d-b2e2-466a-bc9b-50ae86e6af28 could not be found. Aug 24 11:46:18.579242 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-f480e823-be7c-4e3e-9175-e13f9adfb50b tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Request method failure captured: Aug 24 11:46:18.579242 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: request: GET /compute/v2.1/servers/4b0af30d-b2e2-466a-bc9b-50ae86e6af28 HTTP/1.1 Aug 24 11:46:18.579242 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Accept: application/json Aug 24 11:46:18.579242 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Accept-Encoding: identity Aug 24 11:46:18.579242 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Connection: close Aug 24 11:46:18.579242 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Content-Length: 0 Aug 24 11:46:18.579242 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Content-Type: application/json Aug 24 11:46:18.579242 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Host: 10.222.0.84 Aug 24 11:46:18.579242 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Openstack-System-Scope: None Aug 24 11:46:18.579242 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: User-Agent: python-urllib3/1.26.11 Aug 24 11:46:18.579242 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Auth-Token: gAAAAABjBgweR4cEvCTKaEtRPVxZbNsTt1me1RX2L8orBaoPmyfbKHmzEiPGrzhUPAZ-dVqobDImAozYNHZy-giT-StyTeTjwVyRR-kCHyxEj3vuiJ5-SAwaDdad7hiiarcqgu_OA8lN_aNGemV1KcSFFCiGn60rq1bxi6ViCi6rFYftaJqzRGY Aug 24 11:46:18.579242 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Domain-Id: None Aug 24 11:46:18.579242 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Domain-Name: None Aug 24 11:46:18.579242 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Identity-Status: Confirmed Aug 24 11:46:18.579242 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Is-Admin-Project: True Aug 24 11:46:18.579242 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Project-Domain-Id: default Aug 24 11:46:18.579242 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Project-Domain-Name: Default Aug 24 11:46:18.579242 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Project-Id: 4a4159dc366f41bc9e4057a079f6fb5a Aug 24 11:46:18.579242 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Project-Name: tempest-AttachVolumeNegativeTest-1758140935 Aug 24 11:46:18.579242 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Role: reader,member Aug 24 11:46:18.579242 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Roles: reader,member Aug 24 11:46:18.580965 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/volume/v3/4a4159dc366f41bc9e4057a079f6fb5a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/volume/v3/4a4159dc366f41bc9e4057a079f6fb5a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/compute/v2/4a4159dc366f41bc9e4057a079f6fb5a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84:8080/v1/AUTH_4a4159dc366f41bc9e4057a079f6fb5a", "adminURL": "http://10.222.0.84:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/placement"}]}] Aug 24 11:46:18.580965 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Tenant: tempest-AttachVolumeNegativeTest-1758140935 Aug 24 11:46:18.580965 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Tenant-Id: 4a4159dc366f41bc9e4057a079f6fb5a Aug 24 11:46:18.580965 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1758140935 Aug 24 11:46:18.580965 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-User: tempest-AttachVolumeNegativeTest-1758140935-project Aug 24 11:46:18.580965 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-User-Domain-Id: default Aug 24 11:46:18.580965 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-User-Domain-Name: Default Aug 24 11:46:18.580965 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-User-Id: 2715cf2a5129439c83a5347bb963f1a9 Aug 24 11:46:18.580965 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-User-Name: tempest-AttachVolumeNegativeTest-1758140935-project Aug 24 11:46:18.580965 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: method: > Aug 24 11:46:18.580965 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: exception: Instance 4b0af30d-b2e2-466a-bc9b-50ae86e6af28 could not be found. Aug 24 11:46:18.580965 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: action_args: {'id': '4b0af30d-b2e2-466a-bc9b-50ae86e6af28'} Aug 24 11:46:18.581894 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:46:18.581894 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:46:18.581894 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:46:18.581894 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:46:18.581894 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:46:18.581894 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:46:18.581894 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:46:18.581894 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:46:18.581894 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:46:18.581894 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:46:18.581894 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b0af30d-b2e2-466a-bc9b-50ae86e6af28 could not be found. Aug 24 11:46:18.581894 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Aug 24 11:46:18.581894 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:46:18.581894 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Aug 24 11:46:18.581894 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:46:18.581894 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:46:18.581894 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:46:18.581894 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:46:18.581894 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:46:18.581894 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:46:18.583322 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:46:18.583322 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:46:18.583322 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:46:18.583322 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:46:18.583322 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:46:18.583322 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:46:18.583322 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:46:18.583322 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b0af30d-b2e2-466a-bc9b-50ae86e6af28 could not be found. Aug 24 11:46:18.583322 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Aug 24 11:46:18.583322 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:46:18.583322 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Aug 24 11:46:18.583322 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:46:18.583322 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:46:18.583322 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:46:18.583322 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:46:18.583322 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:46:18.583322 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b0af30d-b2e2-466a-bc9b-50ae86e6af28 could not be found. Aug 24 11:46:18.583322 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Aug 24 11:46:18.584907 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-f480e823-be7c-4e3e-9175-e13f9adfb50b tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Returning 404 to user: Instance 4b0af30d-b2e2-466a-bc9b-50ae86e6af28 could not be found. {{(pid=124769) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:46:18.584907 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-f480e823-be7c-4e3e-9175-e13f9adfb50b tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "GET /compute/v2.1/servers/4b0af30d-b2e2-466a-bc9b-50ae86e6af28" status: 404 len: 111 microversion: 2.1 time: 0.030911 Aug 24 11:46:18.584907 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 633/1228] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:46:18 2022] GET /compute/v2.1/servers/4b0af30d-b2e2-466a-bc9b-50ae86e6af28 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:46:18.589941 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-75a52fac-924b-4e70-b116-7f52f08719e5 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:46:18.590441 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-75a52fac-924b-4e70-b116-7f52f08719e5 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: ea26410d-7ad5-47e7-8d4a-ade5827e511c] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:46:18.597086 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-75a52fac-924b-4e70-b116-7f52f08719e5 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:46:18.597935 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-75a52fac-924b-4e70-b116-7f52f08719e5 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:46:18.600185 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-75a52fac-924b-4e70-b116-7f52f08719e5 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:46:18.600185 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-75a52fac-924b-4e70-b116-7f52f08719e5 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:46:18.600185 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-75a52fac-924b-4e70-b116-7f52f08719e5 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:46:18.600185 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-75a52fac-924b-4e70-b116-7f52f08719e5 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:46:18.613257 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.wsgi [None req-75a52fac-924b-4e70-b116-7f52f08719e5 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] HTTP exception thrown: Instance ea26410d-7ad5-47e7-8d4a-ade5827e511c could not be found. Aug 24 11:46:18.614878 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-75a52fac-924b-4e70-b116-7f52f08719e5 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Request method failure captured: Aug 24 11:46:18.614878 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: request: DELETE /compute/v2.1/servers/ea26410d-7ad5-47e7-8d4a-ade5827e511c HTTP/1.1 Aug 24 11:46:18.614878 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Accept: application/json Aug 24 11:46:18.614878 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Accept-Encoding: identity Aug 24 11:46:18.614878 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Connection: close Aug 24 11:46:18.614878 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Content-Length: 0 Aug 24 11:46:18.614878 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Content-Type: application/json Aug 24 11:46:18.614878 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Host: 10.222.0.84 Aug 24 11:46:18.614878 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Openstack-System-Scope: None Aug 24 11:46:18.614878 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: User-Agent: python-urllib3/1.26.11 Aug 24 11:46:18.614878 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Auth-Token: gAAAAABjBgweR4cEvCTKaEtRPVxZbNsTt1me1RX2L8orBaoPmyfbKHmzEiPGrzhUPAZ-dVqobDImAozYNHZy-giT-StyTeTjwVyRR-kCHyxEj3vuiJ5-SAwaDdad7hiiarcqgu_OA8lN_aNGemV1KcSFFCiGn60rq1bxi6ViCi6rFYftaJqzRGY Aug 24 11:46:18.614878 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Domain-Id: None Aug 24 11:46:18.614878 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Domain-Name: None Aug 24 11:46:18.614878 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Identity-Status: Confirmed Aug 24 11:46:18.614878 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Is-Admin-Project: True Aug 24 11:46:18.614878 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Project-Domain-Id: default Aug 24 11:46:18.614878 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Project-Domain-Name: Default Aug 24 11:46:18.614878 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Project-Id: 4a4159dc366f41bc9e4057a079f6fb5a Aug 24 11:46:18.614878 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Project-Name: tempest-AttachVolumeNegativeTest-1758140935 Aug 24 11:46:18.614878 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Role: reader,member Aug 24 11:46:18.614878 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Roles: reader,member Aug 24 11:46:18.616515 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/volume/v3/4a4159dc366f41bc9e4057a079f6fb5a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/volume/v3/4a4159dc366f41bc9e4057a079f6fb5a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/compute/v2/4a4159dc366f41bc9e4057a079f6fb5a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84:8080/v1/AUTH_4a4159dc366f41bc9e4057a079f6fb5a", "adminURL": "http://10.222.0.84:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/placement"}]}] Aug 24 11:46:18.616515 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Tenant: tempest-AttachVolumeNegativeTest-1758140935 Aug 24 11:46:18.616515 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Tenant-Id: 4a4159dc366f41bc9e4057a079f6fb5a Aug 24 11:46:18.616515 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1758140935 Aug 24 11:46:18.616515 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User: tempest-AttachVolumeNegativeTest-1758140935-project Aug 24 11:46:18.616515 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User-Domain-Id: default Aug 24 11:46:18.616515 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User-Domain-Name: Default Aug 24 11:46:18.616515 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User-Id: 2715cf2a5129439c83a5347bb963f1a9 Aug 24 11:46:18.616515 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User-Name: tempest-AttachVolumeNegativeTest-1758140935-project Aug 24 11:46:18.616515 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: method: > Aug 24 11:46:18.616515 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: exception: Instance ea26410d-7ad5-47e7-8d4a-ade5827e511c could not be found. Aug 24 11:46:18.616515 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: action_args: {'id': 'ea26410d-7ad5-47e7-8d4a-ade5827e511c'} Aug 24 11:46:18.617754 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:46:18.617754 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:46:18.617754 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:46:18.617754 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:46:18.617754 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:46:18.617754 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:46:18.617754 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:46:18.617754 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:46:18.617754 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:46:18.617754 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:46:18.617754 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea26410d-7ad5-47e7-8d4a-ade5827e511c could not be found. Aug 24 11:46:18.617754 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:46:18.617754 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:46:18.617754 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:46:18.617754 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:46:18.617754 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:46:18.617754 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:46:18.617754 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:46:18.617754 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:46:18.617754 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:46:18.619806 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:46:18.619806 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 11:46:18.619806 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 11:46:18.619806 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 11:46:18.619806 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 11:46:18.619806 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:46:18.619806 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:46:18.619806 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:46:18.619806 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:46:18.619806 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea26410d-7ad5-47e7-8d4a-ade5827e511c could not be found. Aug 24 11:46:18.619806 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:46:18.619806 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:46:18.619806 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:46:18.619806 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:46:18.619806 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:46:18.619806 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:46:18.619806 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:46:18.619806 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:46:18.619806 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea26410d-7ad5-47e7-8d4a-ade5827e511c could not be found. Aug 24 11:46:18.619806 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:46:18.621630 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-75a52fac-924b-4e70-b116-7f52f08719e5 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Returning 404 to user: Instance ea26410d-7ad5-47e7-8d4a-ade5827e511c could not be found. {{(pid=124770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:46:18.621630 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-75a52fac-924b-4e70-b116-7f52f08719e5 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "DELETE /compute/v2.1/servers/ea26410d-7ad5-47e7-8d4a-ade5827e511c" status: 404 len: 111 microversion: 2.1 time: 0.030820 Aug 24 11:46:18.621630 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 596/1229] 10.222.0.84 () {58 vars in 1239 bytes} [Wed Aug 24 11:46:18 2022] DELETE /compute/v2.1/servers/ea26410d-7ad5-47e7-8d4a-ade5827e511c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:46:18.625979 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-ec4d366b-32d1-40e7-9a0c-6e979eaf08e3 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:46:18.626719 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-ec4d366b-32d1-40e7-9a0c-6e979eaf08e3 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: ea26410d-7ad5-47e7-8d4a-ade5827e511c] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:46:18.632829 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-ec4d366b-32d1-40e7-9a0c-6e979eaf08e3 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:46:18.633332 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-ec4d366b-32d1-40e7-9a0c-6e979eaf08e3 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:46:18.633774 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-ec4d366b-32d1-40e7-9a0c-6e979eaf08e3 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:46:18.634467 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-ec4d366b-32d1-40e7-9a0c-6e979eaf08e3 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:46:18.635528 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-ec4d366b-32d1-40e7-9a0c-6e979eaf08e3 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:46:18.636035 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-ec4d366b-32d1-40e7-9a0c-6e979eaf08e3 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:46:18.649733 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.wsgi [None req-ec4d366b-32d1-40e7-9a0c-6e979eaf08e3 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] HTTP exception thrown: Instance ea26410d-7ad5-47e7-8d4a-ade5827e511c could not be found. Aug 24 11:46:18.651522 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-ec4d366b-32d1-40e7-9a0c-6e979eaf08e3 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Request method failure captured: Aug 24 11:46:18.651522 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: request: GET /compute/v2.1/servers/ea26410d-7ad5-47e7-8d4a-ade5827e511c HTTP/1.1 Aug 24 11:46:18.651522 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Accept: application/json Aug 24 11:46:18.651522 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Accept-Encoding: identity Aug 24 11:46:18.651522 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Connection: close Aug 24 11:46:18.651522 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Content-Length: 0 Aug 24 11:46:18.651522 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Content-Type: application/json Aug 24 11:46:18.651522 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Host: 10.222.0.84 Aug 24 11:46:18.651522 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Openstack-System-Scope: None Aug 24 11:46:18.651522 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: User-Agent: python-urllib3/1.26.11 Aug 24 11:46:18.651522 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Auth-Token: gAAAAABjBgweR4cEvCTKaEtRPVxZbNsTt1me1RX2L8orBaoPmyfbKHmzEiPGrzhUPAZ-dVqobDImAozYNHZy-giT-StyTeTjwVyRR-kCHyxEj3vuiJ5-SAwaDdad7hiiarcqgu_OA8lN_aNGemV1KcSFFCiGn60rq1bxi6ViCi6rFYftaJqzRGY Aug 24 11:46:18.651522 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Domain-Id: None Aug 24 11:46:18.651522 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Domain-Name: None Aug 24 11:46:18.651522 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Identity-Status: Confirmed Aug 24 11:46:18.651522 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Is-Admin-Project: True Aug 24 11:46:18.651522 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Project-Domain-Id: default Aug 24 11:46:18.651522 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Project-Domain-Name: Default Aug 24 11:46:18.651522 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Project-Id: 4a4159dc366f41bc9e4057a079f6fb5a Aug 24 11:46:18.651522 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Project-Name: tempest-AttachVolumeNegativeTest-1758140935 Aug 24 11:46:18.651522 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Role: reader,member Aug 24 11:46:18.651522 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Roles: reader,member Aug 24 11:46:18.652935 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/volume/v3/4a4159dc366f41bc9e4057a079f6fb5a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/volume/v3/4a4159dc366f41bc9e4057a079f6fb5a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/compute/v2/4a4159dc366f41bc9e4057a079f6fb5a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84:8080/v1/AUTH_4a4159dc366f41bc9e4057a079f6fb5a", "adminURL": "http://10.222.0.84:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/placement"}]}] Aug 24 11:46:18.652935 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Tenant: tempest-AttachVolumeNegativeTest-1758140935 Aug 24 11:46:18.652935 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Tenant-Id: 4a4159dc366f41bc9e4057a079f6fb5a Aug 24 11:46:18.652935 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1758140935 Aug 24 11:46:18.652935 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-User: tempest-AttachVolumeNegativeTest-1758140935-project Aug 24 11:46:18.652935 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-User-Domain-Id: default Aug 24 11:46:18.652935 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-User-Domain-Name: Default Aug 24 11:46:18.652935 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-User-Id: 2715cf2a5129439c83a5347bb963f1a9 Aug 24 11:46:18.652935 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-User-Name: tempest-AttachVolumeNegativeTest-1758140935-project Aug 24 11:46:18.652935 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: method: > Aug 24 11:46:18.652935 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: exception: Instance ea26410d-7ad5-47e7-8d4a-ade5827e511c could not be found. Aug 24 11:46:18.652935 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: action_args: {'id': 'ea26410d-7ad5-47e7-8d4a-ade5827e511c'} Aug 24 11:46:18.653714 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:46:18.653714 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:46:18.653714 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:46:18.653714 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:46:18.653714 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:46:18.653714 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:46:18.653714 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:46:18.653714 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:46:18.653714 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:46:18.653714 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:46:18.653714 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea26410d-7ad5-47e7-8d4a-ade5827e511c could not be found. Aug 24 11:46:18.653714 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Aug 24 11:46:18.653714 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:46:18.653714 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Aug 24 11:46:18.653714 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:46:18.653714 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:46:18.653714 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:46:18.653714 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:46:18.653714 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:46:18.653714 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:46:18.655518 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:46:18.655518 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:46:18.655518 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:46:18.655518 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:46:18.655518 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:46:18.655518 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:46:18.655518 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:46:18.655518 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea26410d-7ad5-47e7-8d4a-ade5827e511c could not be found. Aug 24 11:46:18.655518 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Aug 24 11:46:18.655518 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:46:18.655518 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Aug 24 11:46:18.655518 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:46:18.655518 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:46:18.655518 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:46:18.655518 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:46:18.655518 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:46:18.655518 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea26410d-7ad5-47e7-8d4a-ade5827e511c could not be found. Aug 24 11:46:18.655518 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Aug 24 11:46:18.656701 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-ec4d366b-32d1-40e7-9a0c-6e979eaf08e3 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Returning 404 to user: Instance ea26410d-7ad5-47e7-8d4a-ade5827e511c could not be found. {{(pid=124769) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:46:18.656701 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-ec4d366b-32d1-40e7-9a0c-6e979eaf08e3 tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "GET /compute/v2.1/servers/ea26410d-7ad5-47e7-8d4a-ade5827e511c" status: 404 len: 111 microversion: 2.1 time: 0.031168 Aug 24 11:46:18.656701 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 634/1230] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:46:18 2022] GET /compute/v2.1/servers/ea26410d-7ad5-47e7-8d4a-ade5827e511c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:46:19.992841 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-e06f9dd7-e560-4fd0-81f3-83e4ca1efd9e tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:46:19.993407 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-e06f9dd7-e560-4fd0-81f3-83e4ca1efd9e tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:46:20.001472 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e06f9dd7-e560-4fd0-81f3-83e4ca1efd9e tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:46:20.001956 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e06f9dd7-e560-4fd0-81f3-83e4ca1efd9e tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:46:20.002396 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e06f9dd7-e560-4fd0-81f3-83e4ca1efd9e tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:46:20.003090 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e06f9dd7-e560-4fd0-81f3-83e4ca1efd9e tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:46:20.003542 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e06f9dd7-e560-4fd0-81f3-83e4ca1efd9e tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:46:20.003965 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e06f9dd7-e560-4fd0-81f3-83e4ca1efd9e tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:46:20.017772 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.wsgi [None req-e06f9dd7-e560-4fd0-81f3-83e4ca1efd9e tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] HTTP exception thrown: Instance e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311 could not be found. Aug 24 11:46:20.019455 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-e06f9dd7-e560-4fd0-81f3-83e4ca1efd9e tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Request method failure captured: Aug 24 11:46:20.019455 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: request: DELETE /compute/v2.1/servers/e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311 HTTP/1.1 Aug 24 11:46:20.019455 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Accept: application/json Aug 24 11:46:20.019455 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Accept-Encoding: identity Aug 24 11:46:20.019455 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Connection: close Aug 24 11:46:20.019455 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Content-Length: 0 Aug 24 11:46:20.019455 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Content-Type: application/json Aug 24 11:46:20.019455 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Host: 10.222.0.84 Aug 24 11:46:20.019455 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Openstack-System-Scope: None Aug 24 11:46:20.019455 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: User-Agent: python-urllib3/1.26.11 Aug 24 11:46:20.019455 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Auth-Token: gAAAAABjBgweR4cEvCTKaEtRPVxZbNsTt1me1RX2L8orBaoPmyfbKHmzEiPGrzhUPAZ-dVqobDImAozYNHZy-giT-StyTeTjwVyRR-kCHyxEj3vuiJ5-SAwaDdad7hiiarcqgu_OA8lN_aNGemV1KcSFFCiGn60rq1bxi6ViCi6rFYftaJqzRGY Aug 24 11:46:20.019455 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Domain-Id: None Aug 24 11:46:20.019455 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Domain-Name: None Aug 24 11:46:20.019455 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Identity-Status: Confirmed Aug 24 11:46:20.019455 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Is-Admin-Project: True Aug 24 11:46:20.019455 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Project-Domain-Id: default Aug 24 11:46:20.019455 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Project-Domain-Name: Default Aug 24 11:46:20.019455 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Project-Id: 4a4159dc366f41bc9e4057a079f6fb5a Aug 24 11:46:20.019455 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Project-Name: tempest-AttachVolumeNegativeTest-1758140935 Aug 24 11:46:20.019455 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Role: reader,member Aug 24 11:46:20.019455 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Roles: reader,member Aug 24 11:46:20.021669 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/volume/v3/4a4159dc366f41bc9e4057a079f6fb5a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/volume/v3/4a4159dc366f41bc9e4057a079f6fb5a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/compute/v2/4a4159dc366f41bc9e4057a079f6fb5a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84:8080/v1/AUTH_4a4159dc366f41bc9e4057a079f6fb5a", "adminURL": "http://10.222.0.84:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/placement"}]}] Aug 24 11:46:20.021669 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Tenant: tempest-AttachVolumeNegativeTest-1758140935 Aug 24 11:46:20.021669 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Tenant-Id: 4a4159dc366f41bc9e4057a079f6fb5a Aug 24 11:46:20.021669 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1758140935 Aug 24 11:46:20.021669 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User: tempest-AttachVolumeNegativeTest-1758140935-project Aug 24 11:46:20.021669 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User-Domain-Id: default Aug 24 11:46:20.021669 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User-Domain-Name: Default Aug 24 11:46:20.021669 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User-Id: 2715cf2a5129439c83a5347bb963f1a9 Aug 24 11:46:20.021669 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User-Name: tempest-AttachVolumeNegativeTest-1758140935-project Aug 24 11:46:20.021669 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: method: > Aug 24 11:46:20.021669 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: exception: Instance e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311 could not be found. Aug 24 11:46:20.021669 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: action_args: {'id': 'e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311'} Aug 24 11:46:20.022715 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:46:20.022715 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:46:20.022715 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:46:20.022715 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:46:20.022715 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:46:20.022715 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:46:20.022715 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:46:20.022715 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:46:20.022715 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:46:20.022715 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:46:20.022715 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311 could not be found. Aug 24 11:46:20.022715 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:46:20.022715 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:46:20.022715 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:46:20.022715 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:46:20.022715 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:46:20.022715 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:46:20.022715 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:46:20.022715 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:46:20.022715 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:46:20.024259 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:46:20.024259 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 11:46:20.024259 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 11:46:20.024259 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 11:46:20.024259 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 11:46:20.024259 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:46:20.024259 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:46:20.024259 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:46:20.024259 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:46:20.024259 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311 could not be found. Aug 24 11:46:20.024259 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:46:20.024259 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:46:20.024259 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:46:20.024259 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:46:20.024259 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:46:20.024259 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:46:20.024259 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:46:20.024259 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:46:20.024259 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311 could not be found. Aug 24 11:46:20.024259 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:46:20.026160 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-e06f9dd7-e560-4fd0-81f3-83e4ca1efd9e tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Returning 404 to user: Instance e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311 could not be found. {{(pid=124770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:46:20.026160 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-e06f9dd7-e560-4fd0-81f3-83e4ca1efd9e tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "DELETE /compute/v2.1/servers/e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311" status: 404 len: 111 microversion: 2.1 time: 0.031917 Aug 24 11:46:20.026160 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 597/1231] 10.222.0.84 () {58 vars in 1239 bytes} [Wed Aug 24 11:46:19 2022] DELETE /compute/v2.1/servers/e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:46:20.030337 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-5ef0258d-3041-42a3-83f9-0523342b2a1e tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:46:20.030950 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-5ef0258d-3041-42a3-83f9-0523342b2a1e tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] [instance: e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:46:20.038388 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-5ef0258d-3041-42a3-83f9-0523342b2a1e tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:46:20.047645 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-5ef0258d-3041-42a3-83f9-0523342b2a1e tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:46:20.047645 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-5ef0258d-3041-42a3-83f9-0523342b2a1e tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:46:20.047645 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-5ef0258d-3041-42a3-83f9-0523342b2a1e tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:46:20.047645 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-5ef0258d-3041-42a3-83f9-0523342b2a1e tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:46:20.048201 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-5ef0258d-3041-42a3-83f9-0523342b2a1e tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:46:20.057311 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.wsgi [None req-5ef0258d-3041-42a3-83f9-0523342b2a1e tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] HTTP exception thrown: Instance e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311 could not be found. Aug 24 11:46:20.058878 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-5ef0258d-3041-42a3-83f9-0523342b2a1e tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Request method failure captured: Aug 24 11:46:20.058878 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: request: GET /compute/v2.1/servers/e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311 HTTP/1.1 Aug 24 11:46:20.058878 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Accept: application/json Aug 24 11:46:20.058878 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Accept-Encoding: identity Aug 24 11:46:20.058878 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Connection: close Aug 24 11:46:20.058878 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Content-Length: 0 Aug 24 11:46:20.058878 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Content-Type: application/json Aug 24 11:46:20.058878 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Host: 10.222.0.84 Aug 24 11:46:20.058878 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Openstack-System-Scope: None Aug 24 11:46:20.058878 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: User-Agent: python-urllib3/1.26.11 Aug 24 11:46:20.058878 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Auth-Token: gAAAAABjBgweR4cEvCTKaEtRPVxZbNsTt1me1RX2L8orBaoPmyfbKHmzEiPGrzhUPAZ-dVqobDImAozYNHZy-giT-StyTeTjwVyRR-kCHyxEj3vuiJ5-SAwaDdad7hiiarcqgu_OA8lN_aNGemV1KcSFFCiGn60rq1bxi6ViCi6rFYftaJqzRGY Aug 24 11:46:20.058878 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Domain-Id: None Aug 24 11:46:20.058878 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Domain-Name: None Aug 24 11:46:20.058878 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Identity-Status: Confirmed Aug 24 11:46:20.058878 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Is-Admin-Project: True Aug 24 11:46:20.058878 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Project-Domain-Id: default Aug 24 11:46:20.058878 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Project-Domain-Name: Default Aug 24 11:46:20.058878 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Project-Id: 4a4159dc366f41bc9e4057a079f6fb5a Aug 24 11:46:20.058878 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Project-Name: tempest-AttachVolumeNegativeTest-1758140935 Aug 24 11:46:20.058878 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Role: reader,member Aug 24 11:46:20.058878 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Roles: reader,member Aug 24 11:46:20.060902 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/volume/v3/4a4159dc366f41bc9e4057a079f6fb5a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/volume/v3/4a4159dc366f41bc9e4057a079f6fb5a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/compute/v2/4a4159dc366f41bc9e4057a079f6fb5a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84:8080/v1/AUTH_4a4159dc366f41bc9e4057a079f6fb5a", "adminURL": "http://10.222.0.84:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/placement"}]}] Aug 24 11:46:20.060902 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Tenant: tempest-AttachVolumeNegativeTest-1758140935 Aug 24 11:46:20.060902 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Tenant-Id: 4a4159dc366f41bc9e4057a079f6fb5a Aug 24 11:46:20.060902 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1758140935 Aug 24 11:46:20.060902 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-User: tempest-AttachVolumeNegativeTest-1758140935-project Aug 24 11:46:20.060902 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-User-Domain-Id: default Aug 24 11:46:20.060902 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-User-Domain-Name: Default Aug 24 11:46:20.060902 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-User-Id: 2715cf2a5129439c83a5347bb963f1a9 Aug 24 11:46:20.060902 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-User-Name: tempest-AttachVolumeNegativeTest-1758140935-project Aug 24 11:46:20.060902 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: method: > Aug 24 11:46:20.060902 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: exception: Instance e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311 could not be found. Aug 24 11:46:20.060902 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: action_args: {'id': 'e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311'} Aug 24 11:46:20.061961 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:46:20.061961 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:46:20.061961 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:46:20.061961 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:46:20.061961 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:46:20.061961 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:46:20.061961 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:46:20.061961 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:46:20.061961 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:46:20.061961 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:46:20.061961 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311 could not be found. Aug 24 11:46:20.061961 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Aug 24 11:46:20.061961 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:46:20.061961 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Aug 24 11:46:20.061961 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:46:20.061961 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:46:20.061961 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:46:20.061961 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:46:20.061961 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:46:20.061961 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:46:20.063488 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:46:20.063488 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:46:20.063488 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:46:20.063488 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:46:20.063488 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:46:20.063488 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:46:20.063488 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:46:20.063488 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311 could not be found. Aug 24 11:46:20.063488 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Aug 24 11:46:20.063488 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:46:20.063488 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Aug 24 11:46:20.063488 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:46:20.063488 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:46:20.063488 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:46:20.063488 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:46:20.063488 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:46:20.063488 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311 could not be found. Aug 24 11:46:20.063488 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Aug 24 11:46:20.064996 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-5ef0258d-3041-42a3-83f9-0523342b2a1e tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] Returning 404 to user: Instance e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311 could not be found. {{(pid=124769) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:46:20.064996 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-5ef0258d-3041-42a3-83f9-0523342b2a1e tempest-AttachVolumeNegativeTest-1758140935 tempest-AttachVolumeNegativeTest-1758140935-project] 10.222.0.84 "GET /compute/v2.1/servers/e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311" status: 404 len: 111 microversion: 2.1 time: 0.034526 Aug 24 11:46:20.064996 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 635/1232] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:46:20 2022] GET /compute/v2.1/servers/e0b05b92-99b3-4c2e-9f1a-5c9b9bd48311 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:46:45.175409 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 11:46:45.176058 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Wed Aug 24 11:46:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 11:46:49.543353 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 11:46:49.543353 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Wed Aug 24 11:46:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 11:47:51.350021 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_api:SELECT=5 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:47:51.353690 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG dbcounter [-] [124769] Writing DB stats nova_cell1:SELECT=18 {{(pid=124769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:47:51.358588 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [req-69862db1-7d93-4570-99c2-d4f8f14db265 req-a5528e2b-b40d-414e-99c7-b46d42ffe177 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f3cd4ee-8f91-4184-8488-a9b249a6b468", "tag": "1be776cf-2b6b-4565-97c5-cf42d0be6f9c"}]} {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:47:51.361127 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_cell1:SELECT=30 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:47:51.365220 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-97e152c5-7423-4d13-9fca-c131eb45b61b tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:47:51.365722 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-97e152c5-7423-4d13-9fca-c131eb45b61b tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] [instance: 6f3cd4ee-8f91-4184-8488-a9b249a6b468] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:47:51.372188 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-97e152c5-7423-4d13-9fca-c131eb45b61b tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:47:51.372676 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-97e152c5-7423-4d13-9fca-c131eb45b61b tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:47:51.373141 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-97e152c5-7423-4d13-9fca-c131eb45b61b tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:47:51.373277 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [req-69862db1-7d93-4570-99c2-d4f8f14db265 req-a5528e2b-b40d-414e-99c7-b46d42ffe177 service nova] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:47:51.373668 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [req-69862db1-7d93-4570-99c2-d4f8f14db265 req-a5528e2b-b40d-414e-99c7-b46d42ffe177 service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:47:51.373827 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-97e152c5-7423-4d13-9fca-c131eb45b61b tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:47:51.374107 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [req-69862db1-7d93-4570-99c2-d4f8f14db265 req-a5528e2b-b40d-414e-99c7-b46d42ffe177 service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:47:51.374459 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-97e152c5-7423-4d13-9fca-c131eb45b61b tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:47:51.374880 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-97e152c5-7423-4d13-9fca-c131eb45b61b tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:47:51.386082 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.compute.server_external_events [req-69862db1-7d93-4570-99c2-d4f8f14db265 req-a5528e2b-b40d-414e-99c7-b46d42ffe177 service nova] Creating event network-changed:1be776cf-2b6b-4565-97c5-cf42d0be6f9c for instance 6f3cd4ee-8f91-4184-8488-a9b249a6b468 on hv-cinder-85427 Aug 24 11:47:51.391882 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [req-69862db1-7d93-4570-99c2-d4f8f14db265 req-a5528e2b-b40d-414e-99c7-b46d42ffe177 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039985 Aug 24 11:47:51.392480 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 636/1233] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Aug 24 11:47:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:47:51.402085 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-97e152c5-7423-4d13-9fca-c131eb45b61b tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] [instance: 6f3cd4ee-8f91-4184-8488-a9b249a6b468] Going to try to terminate instance {{(pid=124770) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 11:47:51.812736 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-97e152c5-7423-4d13-9fca-c131eb45b61b tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] 10.222.0.84 "DELETE /compute/v2.1/servers/6f3cd4ee-8f91-4184-8488-a9b249a6b468" status: 204 len: 0 microversion: 2.1 time: 0.464593 Aug 24 11:47:51.813363 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 598/1234] 10.222.0.84 () {58 vars in 1239 bytes} [Wed Aug 24 11:47:51 2022] DELETE /compute/v2.1/servers/6f3cd4ee-8f91-4184-8488-a9b249a6b468 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 11:47:51.824346 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-8b0e1499-b4dc-48e4-888a-cc79b70caaca tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:47:51.825093 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-8b0e1499-b4dc-48e4-888a-cc79b70caaca tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] [instance: 6f3cd4ee-8f91-4184-8488-a9b249a6b468] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:47:51.832327 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-8b0e1499-b4dc-48e4-888a-cc79b70caaca tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:47:51.832830 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-8b0e1499-b4dc-48e4-888a-cc79b70caaca tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:47:51.833263 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-8b0e1499-b4dc-48e4-888a-cc79b70caaca tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:47:51.833959 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-8b0e1499-b4dc-48e4-888a-cc79b70caaca tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:47:51.834406 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-8b0e1499-b4dc-48e4-888a-cc79b70caaca tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:47:51.834858 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-8b0e1499-b4dc-48e4-888a-cc79b70caaca tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:47:52.096648 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-8b0e1499-b4dc-48e4-888a-cc79b70caaca tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b82b6f568bd41fa9d6b44facb766e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ef3fc15a0147e39228729d2b5b2631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:47:52.105321 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-8b0e1499-b4dc-48e4-888a-cc79b70caaca tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] 10.222.0.84 "GET /compute/v2.1/servers/6f3cd4ee-8f91-4184-8488-a9b249a6b468" status: 200 len: 1576 microversion: 2.1 time: 0.287117 Aug 24 11:47:52.106197 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 637/1235] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:47:51 2022] GET /compute/v2.1/servers/6f3cd4ee-8f91-4184-8488-a9b249a6b468 => generated 1576 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:47:53.129468 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-b66a2de0-ee80-4ff5-bd44-f17fe1ae2482 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:47:53.130165 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-b66a2de0-ee80-4ff5-bd44-f17fe1ae2482 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] [instance: 6f3cd4ee-8f91-4184-8488-a9b249a6b468] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:47:53.137632 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b66a2de0-ee80-4ff5-bd44-f17fe1ae2482 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:47:53.138120 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b66a2de0-ee80-4ff5-bd44-f17fe1ae2482 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:47:53.138552 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b66a2de0-ee80-4ff5-bd44-f17fe1ae2482 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:47:53.139250 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b66a2de0-ee80-4ff5-bd44-f17fe1ae2482 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:47:53.139698 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b66a2de0-ee80-4ff5-bd44-f17fe1ae2482 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:47:53.140116 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b66a2de0-ee80-4ff5-bd44-f17fe1ae2482 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:47:53.333247 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-b66a2de0-ee80-4ff5-bd44-f17fe1ae2482 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b82b6f568bd41fa9d6b44facb766e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ef3fc15a0147e39228729d2b5b2631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:47:53.341286 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-b66a2de0-ee80-4ff5-bd44-f17fe1ae2482 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] 10.222.0.84 "GET /compute/v2.1/servers/6f3cd4ee-8f91-4184-8488-a9b249a6b468" status: 200 len: 1576 microversion: 2.1 time: 0.216322 Aug 24 11:47:53.342929 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 599/1236] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:47:53 2022] GET /compute/v2.1/servers/6f3cd4ee-8f91-4184-8488-a9b249a6b468 => generated 1576 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:47:54.362887 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-311f6cb8-186a-4ea3-b6b6-bbeef6136e1a tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:47:54.363405 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-311f6cb8-186a-4ea3-b6b6-bbeef6136e1a tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] [instance: 6f3cd4ee-8f91-4184-8488-a9b249a6b468] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:47:54.370020 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-311f6cb8-186a-4ea3-b6b6-bbeef6136e1a tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:47:54.370504 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-311f6cb8-186a-4ea3-b6b6-bbeef6136e1a tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:47:54.372142 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-311f6cb8-186a-4ea3-b6b6-bbeef6136e1a tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:47:54.372911 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-311f6cb8-186a-4ea3-b6b6-bbeef6136e1a tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:47:54.373375 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-311f6cb8-186a-4ea3-b6b6-bbeef6136e1a tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:47:54.373806 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-311f6cb8-186a-4ea3-b6b6-bbeef6136e1a tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:47:54.513483 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-311f6cb8-186a-4ea3-b6b6-bbeef6136e1a tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b82b6f568bd41fa9d6b44facb766e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ef3fc15a0147e39228729d2b5b2631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:47:54.521464 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-311f6cb8-186a-4ea3-b6b6-bbeef6136e1a tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] 10.222.0.84 "GET /compute/v2.1/servers/6f3cd4ee-8f91-4184-8488-a9b249a6b468" status: 200 len: 1576 microversion: 2.1 time: 0.162569 Aug 24 11:47:54.522030 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 638/1237] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:47:54 2022] GET /compute/v2.1/servers/6f3cd4ee-8f91-4184-8488-a9b249a6b468 => generated 1576 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:47:55.543789 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-0b87515a-73f0-4e95-8aa6-fb7e5e4d65f4 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:47:55.544424 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-0b87515a-73f0-4e95-8aa6-fb7e5e4d65f4 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] [instance: 6f3cd4ee-8f91-4184-8488-a9b249a6b468] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:47:55.551157 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-0b87515a-73f0-4e95-8aa6-fb7e5e4d65f4 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:47:55.551762 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-0b87515a-73f0-4e95-8aa6-fb7e5e4d65f4 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:47:55.552296 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-0b87515a-73f0-4e95-8aa6-fb7e5e4d65f4 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:47:55.553091 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-0b87515a-73f0-4e95-8aa6-fb7e5e4d65f4 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:47:55.553647 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-0b87515a-73f0-4e95-8aa6-fb7e5e4d65f4 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:47:55.554115 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-0b87515a-73f0-4e95-8aa6-fb7e5e4d65f4 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:47:55.702575 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-0b87515a-73f0-4e95-8aa6-fb7e5e4d65f4 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b82b6f568bd41fa9d6b44facb766e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ef3fc15a0147e39228729d2b5b2631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:47:55.711191 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-0b87515a-73f0-4e95-8aa6-fb7e5e4d65f4 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] 10.222.0.84 "GET /compute/v2.1/servers/6f3cd4ee-8f91-4184-8488-a9b249a6b468" status: 200 len: 1576 microversion: 2.1 time: 0.171693 Aug 24 11:47:55.711769 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 600/1238] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:47:55 2022] GET /compute/v2.1/servers/6f3cd4ee-8f91-4184-8488-a9b249a6b468 => generated 1576 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:47:56.733182 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-8e1c57e8-c73b-464a-968f-e12cfe83e026 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:47:56.734504 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-8e1c57e8-c73b-464a-968f-e12cfe83e026 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] [instance: 6f3cd4ee-8f91-4184-8488-a9b249a6b468] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:47:56.743775 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-8e1c57e8-c73b-464a-968f-e12cfe83e026 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:47:56.744876 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-8e1c57e8-c73b-464a-968f-e12cfe83e026 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:47:56.745639 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-8e1c57e8-c73b-464a-968f-e12cfe83e026 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:47:56.747094 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-8e1c57e8-c73b-464a-968f-e12cfe83e026 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:47:56.747685 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-8e1c57e8-c73b-464a-968f-e12cfe83e026 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:47:56.748575 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-8e1c57e8-c73b-464a-968f-e12cfe83e026 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:47:57.007233 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-8e1c57e8-c73b-464a-968f-e12cfe83e026 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b82b6f568bd41fa9d6b44facb766e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ef3fc15a0147e39228729d2b5b2631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:47:57.018056 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-8e1c57e8-c73b-464a-968f-e12cfe83e026 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] 10.222.0.84 "GET /compute/v2.1/servers/6f3cd4ee-8f91-4184-8488-a9b249a6b468" status: 200 len: 1576 microversion: 2.1 time: 0.289753 Aug 24 11:47:57.035742 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 639/1239] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:47:56 2022] GET /compute/v2.1/servers/6f3cd4ee-8f91-4184-8488-a9b249a6b468 => generated 1576 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:47:57.372421 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-d5d0cd46-e556-4db4-9777-155fbc5662ba tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1636624588", "imageRef": "028cad80-8f50-4139-b345-dfdca694dc6b", "flavorRef": "452", "networks": [{"uuid": "ab367598-f3ed-4c89-99f6-9fcae362690b"}]}} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:47:57.437329 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.network.neutron [None req-d5d0cd46-e556-4db4-9777-155fbc5662ba tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] validate_networks() for [('ab367598-f3ed-4c89-99f6-9fcae362690b', None, None, None, None, None)] {{(pid=124770) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 11:47:58.046402 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-c2698116-21f3-45bd-baaf-a8bd0140caeb tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:47:58.047061 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-c2698116-21f3-45bd-baaf-a8bd0140caeb tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] [instance: 6f3cd4ee-8f91-4184-8488-a9b249a6b468] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:47:58.057149 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-c2698116-21f3-45bd-baaf-a8bd0140caeb tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:47:58.057149 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-c2698116-21f3-45bd-baaf-a8bd0140caeb tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:47:58.057149 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-c2698116-21f3-45bd-baaf-a8bd0140caeb tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:47:58.057149 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-c2698116-21f3-45bd-baaf-a8bd0140caeb tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:47:58.058041 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-c2698116-21f3-45bd-baaf-a8bd0140caeb tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:47:58.059436 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-c2698116-21f3-45bd-baaf-a8bd0140caeb tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:47:58.156116 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-c2698116-21f3-45bd-baaf-a8bd0140caeb tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b82b6f568bd41fa9d6b44facb766e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ef3fc15a0147e39228729d2b5b2631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:47:58.164376 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-c2698116-21f3-45bd-baaf-a8bd0140caeb tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] 10.222.0.84 "GET /compute/v2.1/servers/6f3cd4ee-8f91-4184-8488-a9b249a6b468" status: 200 len: 1389 microversion: 2.1 time: 0.122622 Aug 24 11:47:58.165022 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 640/1240] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:47:58 2022] GET /compute/v2.1/servers/6f3cd4ee-8f91-4184-8488-a9b249a6b468 => generated 1389 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:47:58.207988 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.virt.hardware [None req-d5d0cd46-e556-4db4-9777-155fbc5662ba tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Flavor limits 0:0:0 {{(pid=124770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 11:47:58.208420 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.virt.hardware [None req-d5d0cd46-e556-4db4-9777-155fbc5662ba tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Image limits 0:0:0 {{(pid=124770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 11:47:58.208989 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.virt.hardware [None req-d5d0cd46-e556-4db4-9777-155fbc5662ba tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Flavor pref 0:0:0 {{(pid=124770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 11:47:58.209714 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.virt.hardware [None req-d5d0cd46-e556-4db4-9777-155fbc5662ba tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Image pref 0:0:0 {{(pid=124770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 11:47:58.210420 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.virt.hardware [None req-d5d0cd46-e556-4db4-9777-155fbc5662ba tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 11:47:58.227554 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [req-8edd2ec7-44cd-4440-b8d6-36ffffe8c3b2 req-a7eacbb3-5f35-459e-9942-da8d31709420 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f3cd4ee-8f91-4184-8488-a9b249a6b468", "name": "network-vif-deleted", "tag": "1be776cf-2b6b-4565-97c5-cf42d0be6f9c"}]} {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:47:58.231264 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d5d0cd46-e556-4db4-9777-155fbc5662ba tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:47:58.232103 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d5d0cd46-e556-4db4-9777-155fbc5662ba tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:47:58.233168 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d5d0cd46-e556-4db4-9777-155fbc5662ba tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:47:58.234669 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d5d0cd46-e556-4db4-9777-155fbc5662ba tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:47:58.239367 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d5d0cd46-e556-4db4-9777-155fbc5662ba tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:47:58.239367 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d5d0cd46-e556-4db4-9777-155fbc5662ba tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:47:58.239811 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [req-8edd2ec7-44cd-4440-b8d6-36ffffe8c3b2 req-a7eacbb3-5f35-459e-9942-da8d31709420 service nova] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:47:58.240272 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [req-8edd2ec7-44cd-4440-b8d6-36ffffe8c3b2 req-a7eacbb3-5f35-459e-9942-da8d31709420 service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:47:58.240790 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [req-8edd2ec7-44cd-4440-b8d6-36ffffe8c3b2 req-a7eacbb3-5f35-459e-9942-da8d31709420 service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:47:58.254450 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.compute.server_external_events [req-8edd2ec7-44cd-4440-b8d6-36ffffe8c3b2 req-a7eacbb3-5f35-459e-9942-da8d31709420 service nova] Creating event network-vif-deleted:1be776cf-2b6b-4565-97c5-cf42d0be6f9c for instance 6f3cd4ee-8f91-4184-8488-a9b249a6b468 on hv-cinder-85427 Aug 24 11:47:58.260519 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [req-8edd2ec7-44cd-4440-b8d6-36ffffe8c3b2 req-a7eacbb3-5f35-459e-9942-da8d31709420 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036691 Aug 24 11:47:58.261488 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 641/1241] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Aug 24 11:47:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:47:58.266959 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.quota [None req-d5d0cd46-e556-4db4-9777-155fbc5662ba tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Getting quotas for project 1d19d73eda154313be8539147f42ec11. Resources: {'ram', 'cores', 'instances'} {{(pid=124770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:47:58.271644 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.quota [None req-d5d0cd46-e556-4db4-9777-155fbc5662ba tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Getting quotas for user 3afc9f4d5bc3473c837926583d334d31 and project 1d19d73eda154313be8539147f42ec11. Resources: {'ram', 'cores', 'instances'} {{(pid=124770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:47:58.284584 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-d5d0cd46-e556-4db4-9777-155fbc5662ba tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Going to run 1 instances... {{(pid=124770) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 11:47:58.286929 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-d5d0cd46-e556-4db4-9777-155fbc5662ba tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] [instance: 1e63bdcd-3690-4de7-b6a5-f096d20c975f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='028cad80-8f50-4139-b345-dfdca694dc6b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124770) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 11:47:58.425063 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-d5d0cd46-e556-4db4-9777-155fbc5662ba tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] 10.222.0.84 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.057783 Aug 24 11:47:58.425726 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 601/1242] 10.222.0.84 () {60 vars in 1147 bytes} [Wed Aug 24 11:47:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 1060 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 11:47:58.438166 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-7f59cb7e-5db7-45b6-88dc-218c74b42976 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:47:58.438915 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-7f59cb7e-5db7-45b6-88dc-218c74b42976 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] [instance: 1e63bdcd-3690-4de7-b6a5-f096d20c975f] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:47:58.526212 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-7f59cb7e-5db7-45b6-88dc-218c74b42976 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3afc9f4d5bc3473c837926583d334d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d19d73eda154313be8539147f42ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:47:58.537634 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-7f59cb7e-5db7-45b6-88dc-218c74b42976 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] 10.222.0.84 "GET /compute/v2.1/servers/1e63bdcd-3690-4de7-b6a5-f096d20c975f" status: 200 len: 1214 microversion: 2.1 time: 0.104398 Aug 24 11:47:58.539130 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 642/1243] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:47:58 2022] GET /compute/v2.1/servers/1e63bdcd-3690-4de7-b6a5-f096d20c975f => generated 1214 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:47:59.191611 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-d72a13ff-f0d0-474d-a636-82e76b8654e1 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:47:59.192229 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-d72a13ff-f0d0-474d-a636-82e76b8654e1 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] [instance: 6f3cd4ee-8f91-4184-8488-a9b249a6b468] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:47:59.199621 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d72a13ff-f0d0-474d-a636-82e76b8654e1 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:47:59.200094 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d72a13ff-f0d0-474d-a636-82e76b8654e1 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:47:59.200551 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d72a13ff-f0d0-474d-a636-82e76b8654e1 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:47:59.201276 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d72a13ff-f0d0-474d-a636-82e76b8654e1 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:47:59.201724 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d72a13ff-f0d0-474d-a636-82e76b8654e1 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:47:59.202147 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d72a13ff-f0d0-474d-a636-82e76b8654e1 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:47:59.270019 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-d72a13ff-f0d0-474d-a636-82e76b8654e1 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b82b6f568bd41fa9d6b44facb766e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ef3fc15a0147e39228729d2b5b2631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:47:59.278602 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-d72a13ff-f0d0-474d-a636-82e76b8654e1 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] 10.222.0.84 "GET /compute/v2.1/servers/6f3cd4ee-8f91-4184-8488-a9b249a6b468" status: 200 len: 1389 microversion: 2.1 time: 0.090882 Aug 24 11:47:59.279164 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 602/1244] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:47:59 2022] GET /compute/v2.1/servers/6f3cd4ee-8f91-4184-8488-a9b249a6b468 => generated 1389 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:47:59.560500 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-445e2120-f781-459d-82e8-639d911d6ed2 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:47:59.561161 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-445e2120-f781-459d-82e8-639d911d6ed2 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] [instance: 1e63bdcd-3690-4de7-b6a5-f096d20c975f] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:47:59.617189 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-445e2120-f781-459d-82e8-639d911d6ed2 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3afc9f4d5bc3473c837926583d334d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d19d73eda154313be8539147f42ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:47:59.624944 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-445e2120-f781-459d-82e8-639d911d6ed2 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] 10.222.0.84 "GET /compute/v2.1/servers/1e63bdcd-3690-4de7-b6a5-f096d20c975f" status: 200 len: 1214 microversion: 2.1 time: 0.069381 Aug 24 11:47:59.625573 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 643/1245] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:47:59 2022] GET /compute/v2.1/servers/1e63bdcd-3690-4de7-b6a5-f096d20c975f => generated 1214 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:48:00.303420 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-ea096479-50a3-40a2-8ca6-e0c392494aa9 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:48:00.303420 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-ea096479-50a3-40a2-8ca6-e0c392494aa9 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] [instance: 6f3cd4ee-8f91-4184-8488-a9b249a6b468] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:48:00.307473 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ea096479-50a3-40a2-8ca6-e0c392494aa9 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:00.308038 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ea096479-50a3-40a2-8ca6-e0c392494aa9 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:00.308489 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ea096479-50a3-40a2-8ca6-e0c392494aa9 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:00.309246 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ea096479-50a3-40a2-8ca6-e0c392494aa9 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:00.309705 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ea096479-50a3-40a2-8ca6-e0c392494aa9 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:00.310165 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ea096479-50a3-40a2-8ca6-e0c392494aa9 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:00.375479 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-ea096479-50a3-40a2-8ca6-e0c392494aa9 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b82b6f568bd41fa9d6b44facb766e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ef3fc15a0147e39228729d2b5b2631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:48:00.383789 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-ea096479-50a3-40a2-8ca6-e0c392494aa9 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] 10.222.0.84 "GET /compute/v2.1/servers/6f3cd4ee-8f91-4184-8488-a9b249a6b468" status: 200 len: 1389 microversion: 2.1 time: 0.087786 Aug 24 11:48:00.384345 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 603/1246] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:48:00 2022] GET /compute/v2.1/servers/6f3cd4ee-8f91-4184-8488-a9b249a6b468 => generated 1389 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:48:00.646645 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-a7a3572a-b6ee-4deb-9adc-d8dd53baab50 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:48:00.647335 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-a7a3572a-b6ee-4deb-9adc-d8dd53baab50 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] [instance: 1e63bdcd-3690-4de7-b6a5-f096d20c975f] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:48:00.655029 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-a7a3572a-b6ee-4deb-9adc-d8dd53baab50 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:00.655525 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-a7a3572a-b6ee-4deb-9adc-d8dd53baab50 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:00.655970 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-a7a3572a-b6ee-4deb-9adc-d8dd53baab50 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:00.656710 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-a7a3572a-b6ee-4deb-9adc-d8dd53baab50 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:00.657198 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-a7a3572a-b6ee-4deb-9adc-d8dd53baab50 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:00.657630 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-a7a3572a-b6ee-4deb-9adc-d8dd53baab50 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:00.732626 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-a7a3572a-b6ee-4deb-9adc-d8dd53baab50 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3afc9f4d5bc3473c837926583d334d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d19d73eda154313be8539147f42ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:48:00.741306 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-a7a3572a-b6ee-4deb-9adc-d8dd53baab50 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] 10.222.0.84 "GET /compute/v2.1/servers/1e63bdcd-3690-4de7-b6a5-f096d20c975f" status: 200 len: 1218 microversion: 2.1 time: 0.098502 Aug 24 11:48:00.741894 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 644/1247] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:48:00 2022] GET /compute/v2.1/servers/1e63bdcd-3690-4de7-b6a5-f096d20c975f => generated 1218 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:48:01.406680 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-1d0f84c6-048b-4da8-ba9c-1b96256f2bfb tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:48:01.407376 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-1d0f84c6-048b-4da8-ba9c-1b96256f2bfb tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] [instance: 6f3cd4ee-8f91-4184-8488-a9b249a6b468] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:48:01.413969 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1d0f84c6-048b-4da8-ba9c-1b96256f2bfb tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:01.414449 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1d0f84c6-048b-4da8-ba9c-1b96256f2bfb tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:01.414885 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1d0f84c6-048b-4da8-ba9c-1b96256f2bfb tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:01.415870 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1d0f84c6-048b-4da8-ba9c-1b96256f2bfb tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:01.416339 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1d0f84c6-048b-4da8-ba9c-1b96256f2bfb tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:01.416761 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1d0f84c6-048b-4da8-ba9c-1b96256f2bfb tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:01.486240 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-1d0f84c6-048b-4da8-ba9c-1b96256f2bfb tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b82b6f568bd41fa9d6b44facb766e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ef3fc15a0147e39228729d2b5b2631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:48:01.497623 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-1d0f84c6-048b-4da8-ba9c-1b96256f2bfb tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] 10.222.0.84 "GET /compute/v2.1/servers/6f3cd4ee-8f91-4184-8488-a9b249a6b468" status: 200 len: 1389 microversion: 2.1 time: 0.095045 Aug 24 11:48:01.498347 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 604/1248] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:48:01 2022] GET /compute/v2.1/servers/6f3cd4ee-8f91-4184-8488-a9b249a6b468 => generated 1389 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:48:01.762852 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-5f362bdf-a970-4138-9061-93cb3aaf3416 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:48:01.763442 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-5f362bdf-a970-4138-9061-93cb3aaf3416 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] [instance: 1e63bdcd-3690-4de7-b6a5-f096d20c975f] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:48:01.770138 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-5f362bdf-a970-4138-9061-93cb3aaf3416 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:01.770610 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-5f362bdf-a970-4138-9061-93cb3aaf3416 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:01.771040 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-5f362bdf-a970-4138-9061-93cb3aaf3416 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:01.771724 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-5f362bdf-a970-4138-9061-93cb3aaf3416 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:01.772174 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-5f362bdf-a970-4138-9061-93cb3aaf3416 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:01.772595 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-5f362bdf-a970-4138-9061-93cb3aaf3416 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:01.838589 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-5f362bdf-a970-4138-9061-93cb3aaf3416 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3afc9f4d5bc3473c837926583d334d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d19d73eda154313be8539147f42ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:48:01.847117 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-5f362bdf-a970-4138-9061-93cb3aaf3416 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] 10.222.0.84 "GET /compute/v2.1/servers/1e63bdcd-3690-4de7-b6a5-f096d20c975f" status: 200 len: 1218 microversion: 2.1 time: 0.088716 Aug 24 11:48:01.847739 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 645/1249] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:48:01 2022] GET /compute/v2.1/servers/1e63bdcd-3690-4de7-b6a5-f096d20c975f => generated 1218 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:48:02.519838 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-4e505000-3b06-4a20-9cf7-adc9158853bc tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:48:02.520479 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-4e505000-3b06-4a20-9cf7-adc9158853bc tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] [instance: 6f3cd4ee-8f91-4184-8488-a9b249a6b468] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:48:02.527039 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4e505000-3b06-4a20-9cf7-adc9158853bc tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:02.527522 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4e505000-3b06-4a20-9cf7-adc9158853bc tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:02.527957 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4e505000-3b06-4a20-9cf7-adc9158853bc tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:02.528643 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4e505000-3b06-4a20-9cf7-adc9158853bc tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:02.529130 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4e505000-3b06-4a20-9cf7-adc9158853bc tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:02.529554 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4e505000-3b06-4a20-9cf7-adc9158853bc tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:02.593596 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-4e505000-3b06-4a20-9cf7-adc9158853bc tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b82b6f568bd41fa9d6b44facb766e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ef3fc15a0147e39228729d2b5b2631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:48:02.601273 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-4e505000-3b06-4a20-9cf7-adc9158853bc tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] 10.222.0.84 "GET /compute/v2.1/servers/6f3cd4ee-8f91-4184-8488-a9b249a6b468" status: 200 len: 1389 microversion: 2.1 time: 0.085477 Aug 24 11:48:02.601841 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 605/1250] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:48:02 2022] GET /compute/v2.1/servers/6f3cd4ee-8f91-4184-8488-a9b249a6b468 => generated 1389 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:48:02.868456 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-2ee4b391-0e3e-4a28-b039-41f91a10261c tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:48:02.869064 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-2ee4b391-0e3e-4a28-b039-41f91a10261c tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] [instance: 1e63bdcd-3690-4de7-b6a5-f096d20c975f] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:48:02.875394 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-2ee4b391-0e3e-4a28-b039-41f91a10261c tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:02.875865 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-2ee4b391-0e3e-4a28-b039-41f91a10261c tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:02.876297 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-2ee4b391-0e3e-4a28-b039-41f91a10261c tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:02.877270 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-2ee4b391-0e3e-4a28-b039-41f91a10261c tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:02.877717 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-2ee4b391-0e3e-4a28-b039-41f91a10261c tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:02.878134 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-2ee4b391-0e3e-4a28-b039-41f91a10261c tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:02.938746 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-2ee4b391-0e3e-4a28-b039-41f91a10261c tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3afc9f4d5bc3473c837926583d334d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d19d73eda154313be8539147f42ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:48:02.946433 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-2ee4b391-0e3e-4a28-b039-41f91a10261c tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] 10.222.0.84 "GET /compute/v2.1/servers/1e63bdcd-3690-4de7-b6a5-f096d20c975f" status: 200 len: 1218 microversion: 2.1 time: 0.081916 Aug 24 11:48:02.946983 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 646/1251] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:48:02 2022] GET /compute/v2.1/servers/1e63bdcd-3690-4de7-b6a5-f096d20c975f => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:48:03.623985 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-bc18b561-285b-4a77-94fc-f84fb9c3260a tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:48:03.624522 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-bc18b561-285b-4a77-94fc-f84fb9c3260a tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] [instance: 6f3cd4ee-8f91-4184-8488-a9b249a6b468] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:48:03.631386 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-bc18b561-285b-4a77-94fc-f84fb9c3260a tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:03.631878 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-bc18b561-285b-4a77-94fc-f84fb9c3260a tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:03.632323 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-bc18b561-285b-4a77-94fc-f84fb9c3260a tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:03.633055 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-bc18b561-285b-4a77-94fc-f84fb9c3260a tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:03.633515 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-bc18b561-285b-4a77-94fc-f84fb9c3260a tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:03.633942 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-bc18b561-285b-4a77-94fc-f84fb9c3260a tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:03.702607 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-bc18b561-285b-4a77-94fc-f84fb9c3260a tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b82b6f568bd41fa9d6b44facb766e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ef3fc15a0147e39228729d2b5b2631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:48:03.710648 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-bc18b561-285b-4a77-94fc-f84fb9c3260a tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] 10.222.0.84 "GET /compute/v2.1/servers/6f3cd4ee-8f91-4184-8488-a9b249a6b468" status: 200 len: 1389 microversion: 2.1 time: 0.091821 Aug 24 11:48:03.711230 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 606/1252] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:48:03 2022] GET /compute/v2.1/servers/6f3cd4ee-8f91-4184-8488-a9b249a6b468 => generated 1389 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:48:03.967020 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-68710a45-9f7b-4277-b136-4a996ceed42f tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:48:03.967560 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-68710a45-9f7b-4277-b136-4a996ceed42f tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] [instance: 1e63bdcd-3690-4de7-b6a5-f096d20c975f] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:48:03.974135 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-68710a45-9f7b-4277-b136-4a996ceed42f tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:03.974620 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-68710a45-9f7b-4277-b136-4a996ceed42f tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:03.975062 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-68710a45-9f7b-4277-b136-4a996ceed42f tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:03.975758 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-68710a45-9f7b-4277-b136-4a996ceed42f tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:03.976217 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-68710a45-9f7b-4277-b136-4a996ceed42f tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:03.976640 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-68710a45-9f7b-4277-b136-4a996ceed42f tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:04.041431 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-68710a45-9f7b-4277-b136-4a996ceed42f tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3afc9f4d5bc3473c837926583d334d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d19d73eda154313be8539147f42ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:48:04.049802 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-68710a45-9f7b-4277-b136-4a996ceed42f tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] 10.222.0.84 "GET /compute/v2.1/servers/1e63bdcd-3690-4de7-b6a5-f096d20c975f" status: 200 len: 1218 microversion: 2.1 time: 0.086924 Aug 24 11:48:04.050360 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 647/1253] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:48:03 2022] GET /compute/v2.1/servers/1e63bdcd-3690-4de7-b6a5-f096d20c975f => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:48:04.732590 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-251ff978-ae07-4b6f-b890-737eecd14596 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:48:04.733277 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-251ff978-ae07-4b6f-b890-737eecd14596 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] [instance: 6f3cd4ee-8f91-4184-8488-a9b249a6b468] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:48:04.739824 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-251ff978-ae07-4b6f-b890-737eecd14596 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:04.740319 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-251ff978-ae07-4b6f-b890-737eecd14596 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:04.740759 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-251ff978-ae07-4b6f-b890-737eecd14596 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:04.741623 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-251ff978-ae07-4b6f-b890-737eecd14596 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:04.742083 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-251ff978-ae07-4b6f-b890-737eecd14596 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:04.742509 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-251ff978-ae07-4b6f-b890-737eecd14596 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:04.806748 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-251ff978-ae07-4b6f-b890-737eecd14596 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b82b6f568bd41fa9d6b44facb766e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ef3fc15a0147e39228729d2b5b2631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:48:04.815330 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-251ff978-ae07-4b6f-b890-737eecd14596 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] 10.222.0.84 "GET /compute/v2.1/servers/6f3cd4ee-8f91-4184-8488-a9b249a6b468" status: 200 len: 1389 microversion: 2.1 time: 0.087521 Aug 24 11:48:04.815911 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 607/1254] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:48:04 2022] GET /compute/v2.1/servers/6f3cd4ee-8f91-4184-8488-a9b249a6b468 => generated 1389 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:48:05.071069 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-290d9b18-052b-4e79-94cc-bbbbfa34782f tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:48:05.071702 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-290d9b18-052b-4e79-94cc-bbbbfa34782f tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] [instance: 1e63bdcd-3690-4de7-b6a5-f096d20c975f] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:48:05.078106 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-290d9b18-052b-4e79-94cc-bbbbfa34782f tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:05.078577 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-290d9b18-052b-4e79-94cc-bbbbfa34782f tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:05.079012 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-290d9b18-052b-4e79-94cc-bbbbfa34782f tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:05.079689 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-290d9b18-052b-4e79-94cc-bbbbfa34782f tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:05.080133 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-290d9b18-052b-4e79-94cc-bbbbfa34782f tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:05.080548 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-290d9b18-052b-4e79-94cc-bbbbfa34782f tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:05.140202 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-290d9b18-052b-4e79-94cc-bbbbfa34782f tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3afc9f4d5bc3473c837926583d334d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d19d73eda154313be8539147f42ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:48:05.147821 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-290d9b18-052b-4e79-94cc-bbbbfa34782f tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] 10.222.0.84 "GET /compute/v2.1/servers/1e63bdcd-3690-4de7-b6a5-f096d20c975f" status: 200 len: 1218 microversion: 2.1 time: 0.080600 Aug 24 11:48:05.148376 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 648/1255] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:48:05 2022] GET /compute/v2.1/servers/1e63bdcd-3690-4de7-b6a5-f096d20c975f => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:48:05.836247 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-10db6980-5d33-4432-8336-975481db2f68 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:48:05.837045 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-10db6980-5d33-4432-8336-975481db2f68 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] [instance: 6f3cd4ee-8f91-4184-8488-a9b249a6b468] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:48:05.846133 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-10db6980-5d33-4432-8336-975481db2f68 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:05.846635 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-10db6980-5d33-4432-8336-975481db2f68 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:05.847083 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-10db6980-5d33-4432-8336-975481db2f68 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:05.847790 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-10db6980-5d33-4432-8336-975481db2f68 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:05.848255 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-10db6980-5d33-4432-8336-975481db2f68 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:05.848687 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-10db6980-5d33-4432-8336-975481db2f68 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:05.924308 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-10db6980-5d33-4432-8336-975481db2f68 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b82b6f568bd41fa9d6b44facb766e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ef3fc15a0147e39228729d2b5b2631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:48:05.938247 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-10db6980-5d33-4432-8336-975481db2f68 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] 10.222.0.84 "GET /compute/v2.1/servers/6f3cd4ee-8f91-4184-8488-a9b249a6b468" status: 200 len: 1224 microversion: 2.1 time: 0.105786 Aug 24 11:48:05.941199 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 608/1256] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:48:05 2022] GET /compute/v2.1/servers/6f3cd4ee-8f91-4184-8488-a9b249a6b468 => generated 1224 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:48:06.169427 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-984cdfe4-21d7-49d9-acc0-d61520f5b75d tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:48:06.170110 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-984cdfe4-21d7-49d9-acc0-d61520f5b75d tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] [instance: 1e63bdcd-3690-4de7-b6a5-f096d20c975f] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:48:06.178830 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-984cdfe4-21d7-49d9-acc0-d61520f5b75d tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:06.179315 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-984cdfe4-21d7-49d9-acc0-d61520f5b75d tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:06.179748 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-984cdfe4-21d7-49d9-acc0-d61520f5b75d tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:06.180439 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-984cdfe4-21d7-49d9-acc0-d61520f5b75d tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:06.181109 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-984cdfe4-21d7-49d9-acc0-d61520f5b75d tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:06.181540 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-984cdfe4-21d7-49d9-acc0-d61520f5b75d tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:06.265531 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-984cdfe4-21d7-49d9-acc0-d61520f5b75d tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3afc9f4d5bc3473c837926583d334d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d19d73eda154313be8539147f42ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:48:06.277566 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-984cdfe4-21d7-49d9-acc0-d61520f5b75d tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] 10.222.0.84 "GET /compute/v2.1/servers/1e63bdcd-3690-4de7-b6a5-f096d20c975f" status: 200 len: 1210 microversion: 2.1 time: 0.112371 Aug 24 11:48:06.278828 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 649/1257] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:48:06 2022] GET /compute/v2.1/servers/1e63bdcd-3690-4de7-b6a5-f096d20c975f => generated 1210 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:48:06.963654 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-140f68cd-f26b-43be-82c8-104c719ebea4 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:48:06.964634 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-140f68cd-f26b-43be-82c8-104c719ebea4 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] [instance: 6f3cd4ee-8f91-4184-8488-a9b249a6b468] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:48:06.972601 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-140f68cd-f26b-43be-82c8-104c719ebea4 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:06.973126 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-140f68cd-f26b-43be-82c8-104c719ebea4 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:06.973558 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-140f68cd-f26b-43be-82c8-104c719ebea4 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:06.974250 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-140f68cd-f26b-43be-82c8-104c719ebea4 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:06.974732 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-140f68cd-f26b-43be-82c8-104c719ebea4 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:06.975154 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-140f68cd-f26b-43be-82c8-104c719ebea4 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:07.043694 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-140f68cd-f26b-43be-82c8-104c719ebea4 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b82b6f568bd41fa9d6b44facb766e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ef3fc15a0147e39228729d2b5b2631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:48:07.051794 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-140f68cd-f26b-43be-82c8-104c719ebea4 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] 10.222.0.84 "GET /compute/v2.1/servers/6f3cd4ee-8f91-4184-8488-a9b249a6b468" status: 200 len: 1224 microversion: 2.1 time: 0.092032 Aug 24 11:48:07.052367 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 609/1258] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:48:06 2022] GET /compute/v2.1/servers/6f3cd4ee-8f91-4184-8488-a9b249a6b468 => generated 1224 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:48:07.304153 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-2e7d2b38-d508-4463-ad44-ac3b8901e156 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:48:07.305294 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-2e7d2b38-d508-4463-ad44-ac3b8901e156 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] [instance: 1e63bdcd-3690-4de7-b6a5-f096d20c975f] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:48:07.313634 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-2e7d2b38-d508-4463-ad44-ac3b8901e156 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:07.314485 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-2e7d2b38-d508-4463-ad44-ac3b8901e156 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:07.314977 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-2e7d2b38-d508-4463-ad44-ac3b8901e156 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:07.315748 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-2e7d2b38-d508-4463-ad44-ac3b8901e156 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:07.316406 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-2e7d2b38-d508-4463-ad44-ac3b8901e156 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:07.316901 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-2e7d2b38-d508-4463-ad44-ac3b8901e156 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:07.398072 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-2e7d2b38-d508-4463-ad44-ac3b8901e156 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3afc9f4d5bc3473c837926583d334d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d19d73eda154313be8539147f42ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:48:07.406364 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-2e7d2b38-d508-4463-ad44-ac3b8901e156 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] 10.222.0.84 "GET /compute/v2.1/servers/1e63bdcd-3690-4de7-b6a5-f096d20c975f" status: 200 len: 1274 microversion: 2.1 time: 0.106597 Aug 24 11:48:07.437147 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 650/1259] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:48:07 2022] GET /compute/v2.1/servers/1e63bdcd-3690-4de7-b6a5-f096d20c975f => generated 1274 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:48:08.073354 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-5d7074e9-63ce-42b1-8507-b043c3339c29 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:48:08.074078 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-5d7074e9-63ce-42b1-8507-b043c3339c29 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] [instance: 6f3cd4ee-8f91-4184-8488-a9b249a6b468] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:48:08.080491 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5d7074e9-63ce-42b1-8507-b043c3339c29 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:08.081009 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5d7074e9-63ce-42b1-8507-b043c3339c29 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:08.081494 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5d7074e9-63ce-42b1-8507-b043c3339c29 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:08.082190 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5d7074e9-63ce-42b1-8507-b043c3339c29 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:08.082764 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5d7074e9-63ce-42b1-8507-b043c3339c29 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:08.083190 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5d7074e9-63ce-42b1-8507-b043c3339c29 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:08.117744 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5d7074e9-63ce-42b1-8507-b043c3339c29 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:08.117980 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5d7074e9-63ce-42b1-8507-b043c3339c29 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:08.118399 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5d7074e9-63ce-42b1-8507-b043c3339c29 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:08.123039 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.objects.instance [None req-5d7074e9-63ce-42b1-8507-b043c3339c29 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lazy-loading 'fault' on Instance uuid 6f3cd4ee-8f91-4184-8488-a9b249a6b468 {{(pid=124770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:48:08.163702 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-5d7074e9-63ce-42b1-8507-b043c3339c29 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b82b6f568bd41fa9d6b44facb766e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ef3fc15a0147e39228729d2b5b2631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:48:08.172249 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-5d7074e9-63ce-42b1-8507-b043c3339c29 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] 10.222.0.84 "GET /compute/v2.1/servers/6f3cd4ee-8f91-4184-8488-a9b249a6b468" status: 200 len: 1229 microversion: 2.1 time: 0.102810 Aug 24 11:48:08.175327 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 610/1260] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:48:08 2022] GET /compute/v2.1/servers/6f3cd4ee-8f91-4184-8488-a9b249a6b468 => generated 1229 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:48:08.429160 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-734f9a06-3d90-4746-9f31-9a7cf08ac04a tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:48:08.429785 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-734f9a06-3d90-4746-9f31-9a7cf08ac04a tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] [instance: 1e63bdcd-3690-4de7-b6a5-f096d20c975f] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:48:08.437003 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-734f9a06-3d90-4746-9f31-9a7cf08ac04a tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:08.437586 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-734f9a06-3d90-4746-9f31-9a7cf08ac04a tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:08.438101 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-734f9a06-3d90-4746-9f31-9a7cf08ac04a tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:08.439008 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-734f9a06-3d90-4746-9f31-9a7cf08ac04a tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:08.439548 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-734f9a06-3d90-4746-9f31-9a7cf08ac04a tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:08.440058 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-734f9a06-3d90-4746-9f31-9a7cf08ac04a tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:08.582171 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-734f9a06-3d90-4746-9f31-9a7cf08ac04a tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3afc9f4d5bc3473c837926583d334d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d19d73eda154313be8539147f42ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:48:08.591373 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-734f9a06-3d90-4746-9f31-9a7cf08ac04a tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] 10.222.0.84 "GET /compute/v2.1/servers/1e63bdcd-3690-4de7-b6a5-f096d20c975f" status: 200 len: 1314 microversion: 2.1 time: 0.166384 Aug 24 11:48:08.591961 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 651/1261] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:48:08 2022] GET /compute/v2.1/servers/1e63bdcd-3690-4de7-b6a5-f096d20c975f => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:48:09.195084 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-84b4fff1-e5cf-4c07-b36c-329254f32df2 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:48:09.195695 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-84b4fff1-e5cf-4c07-b36c-329254f32df2 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] [instance: 6f3cd4ee-8f91-4184-8488-a9b249a6b468] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:48:09.198037 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_cell0:SELECT=2 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:48:09.199089 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_cell0:SELECT=6 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:48:09.204967 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-84b4fff1-e5cf-4c07-b36c-329254f32df2 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:09.205459 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-84b4fff1-e5cf-4c07-b36c-329254f32df2 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:09.205934 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-84b4fff1-e5cf-4c07-b36c-329254f32df2 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:09.206647 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-84b4fff1-e5cf-4c07-b36c-329254f32df2 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:09.207164 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-84b4fff1-e5cf-4c07-b36c-329254f32df2 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:09.207585 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-84b4fff1-e5cf-4c07-b36c-329254f32df2 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:09.222332 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.wsgi [None req-84b4fff1-e5cf-4c07-b36c-329254f32df2 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] HTTP exception thrown: Instance 6f3cd4ee-8f91-4184-8488-a9b249a6b468 could not be found. Aug 24 11:48:09.224031 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-84b4fff1-e5cf-4c07-b36c-329254f32df2 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Request method failure captured: Aug 24 11:48:09.224031 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: request: GET /compute/v2.1/servers/6f3cd4ee-8f91-4184-8488-a9b249a6b468 HTTP/1.1 Aug 24 11:48:09.224031 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Accept: application/json Aug 24 11:48:09.224031 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Accept-Encoding: identity Aug 24 11:48:09.224031 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Connection: close Aug 24 11:48:09.224031 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Content-Length: 0 Aug 24 11:48:09.224031 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Content-Type: application/json Aug 24 11:48:09.224031 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Host: 10.222.0.84 Aug 24 11:48:09.224031 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Openstack-System-Scope: None Aug 24 11:48:09.224031 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: User-Agent: python-urllib3/1.26.11 Aug 24 11:48:09.224031 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Auth-Token: gAAAAABjBg1BVDXXSs0s1p7mJJhsA-_dbfynZ8c-TDDDTvCbvPZxi5WW99T-jVhomvZ5jKdpwnQP32urIDCvYy1U3dTqN0EZ6FBpM94YOAVlxo_9OG_S8JWmQ7mh1AiLbYSVWkQ0NSDd8h_h8ondHXl5Z-LLBPbAzV0MxHq-RgCt4nVlgHKNvLw Aug 24 11:48:09.224031 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Domain-Id: None Aug 24 11:48:09.224031 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Domain-Name: None Aug 24 11:48:09.224031 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Identity-Status: Confirmed Aug 24 11:48:09.224031 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Is-Admin-Project: True Aug 24 11:48:09.224031 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Project-Domain-Id: default Aug 24 11:48:09.224031 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Project-Domain-Name: Default Aug 24 11:48:09.224031 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Project-Id: c4ef3fc15a0147e39228729d2b5b2631 Aug 24 11:48:09.224031 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Project-Name: tempest-TestVolumeBootPattern-334422239 Aug 24 11:48:09.224031 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Role: reader,member Aug 24 11:48:09.224031 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Roles: reader,member Aug 24 11:48:09.227035 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/volume/v3/c4ef3fc15a0147e39228729d2b5b2631"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/volume/v3/c4ef3fc15a0147e39228729d2b5b2631"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/compute/v2/c4ef3fc15a0147e39228729d2b5b2631"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84:8080/v1/AUTH_c4ef3fc15a0147e39228729d2b5b2631", "adminURL": "http://10.222.0.84:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/placement"}]}] Aug 24 11:48:09.227035 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Tenant: tempest-TestVolumeBootPattern-334422239 Aug 24 11:48:09.227035 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Tenant-Id: c4ef3fc15a0147e39228729d2b5b2631 Aug 24 11:48:09.227035 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Tenant-Name: tempest-TestVolumeBootPattern-334422239 Aug 24 11:48:09.227035 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User: tempest-TestVolumeBootPattern-334422239-project Aug 24 11:48:09.227035 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User-Domain-Id: default Aug 24 11:48:09.227035 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User-Domain-Name: Default Aug 24 11:48:09.227035 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User-Id: 0b82b6f568bd41fa9d6b44facb766e0b Aug 24 11:48:09.227035 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User-Name: tempest-TestVolumeBootPattern-334422239-project Aug 24 11:48:09.227035 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: method: > Aug 24 11:48:09.227035 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: exception: Instance 6f3cd4ee-8f91-4184-8488-a9b249a6b468 could not be found. Aug 24 11:48:09.227035 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: action_args: {'id': '6f3cd4ee-8f91-4184-8488-a9b249a6b468'} Aug 24 11:48:09.228668 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:48:09.228668 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:48:09.228668 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:48:09.228668 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:48:09.228668 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:48:09.228668 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:48:09.228668 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:48:09.228668 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:48:09.228668 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:48:09.228668 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:48:09.228668 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f3cd4ee-8f91-4184-8488-a9b249a6b468 could not be found. Aug 24 11:48:09.228668 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:48:09.228668 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:48:09.228668 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:48:09.228668 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:48:09.228668 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:48:09.228668 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:48:09.228668 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:48:09.228668 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:48:09.228668 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:48:09.231714 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:48:09.231714 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:48:09.231714 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:48:09.231714 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:48:09.231714 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:48:09.231714 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:48:09.231714 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:48:09.231714 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f3cd4ee-8f91-4184-8488-a9b249a6b468 could not be found. Aug 24 11:48:09.231714 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:48:09.231714 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:48:09.231714 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:48:09.231714 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:48:09.231714 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:48:09.231714 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:48:09.231714 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:48:09.231714 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:48:09.231714 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f3cd4ee-8f91-4184-8488-a9b249a6b468 could not be found. Aug 24 11:48:09.231714 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:48:09.238503 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-84b4fff1-e5cf-4c07-b36c-329254f32df2 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Returning 404 to user: Instance 6f3cd4ee-8f91-4184-8488-a9b249a6b468 could not be found. {{(pid=124770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:48:09.238503 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-84b4fff1-e5cf-4c07-b36c-329254f32df2 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] 10.222.0.84 "GET /compute/v2.1/servers/6f3cd4ee-8f91-4184-8488-a9b249a6b468" status: 404 len: 111 microversion: 2.1 time: 0.034728 Aug 24 11:48:09.238503 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 611/1262] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:48:09 2022] GET /compute/v2.1/servers/6f3cd4ee-8f91-4184-8488-a9b249a6b468 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:48:09.530512 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [req-3ee8337e-94e7-4b13-9c64-655b29ab2212 req-0b3c4301-e451-4a6b-95ad-bf9c313ad85b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e63bdcd-3690-4de7-b6a5-f096d20c975f", "tag": "f0efb3fa-d392-4e21-8896-15afb6251248"}]} {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:48:09.543170 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [req-3ee8337e-94e7-4b13-9c64-655b29ab2212 req-0b3c4301-e451-4a6b-95ad-bf9c313ad85b service nova] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:09.543170 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [req-3ee8337e-94e7-4b13-9c64-655b29ab2212 req-0b3c4301-e451-4a6b-95ad-bf9c313ad85b service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:09.543170 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [req-3ee8337e-94e7-4b13-9c64-655b29ab2212 req-0b3c4301-e451-4a6b-95ad-bf9c313ad85b service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:09.555766 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.compute.server_external_events [req-3ee8337e-94e7-4b13-9c64-655b29ab2212 req-0b3c4301-e451-4a6b-95ad-bf9c313ad85b service nova] Creating event network-changed:f0efb3fa-d392-4e21-8896-15afb6251248 for instance 1e63bdcd-3690-4de7-b6a5-f096d20c975f on hv-cinder-85427 Aug 24 11:48:09.561754 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [req-3ee8337e-94e7-4b13-9c64-655b29ab2212 req-0b3c4301-e451-4a6b-95ad-bf9c313ad85b service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035387 Aug 24 11:48:09.562361 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 652/1263] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Aug 24 11:48:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:48:09.612316 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-40608407-c12b-4b8d-82a5-95160fdea614 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:48:09.616951 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-40608407-c12b-4b8d-82a5-95160fdea614 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] [instance: 1e63bdcd-3690-4de7-b6a5-f096d20c975f] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:48:09.619635 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-40608407-c12b-4b8d-82a5-95160fdea614 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:09.620125 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-40608407-c12b-4b8d-82a5-95160fdea614 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:09.621179 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-40608407-c12b-4b8d-82a5-95160fdea614 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:09.621900 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-40608407-c12b-4b8d-82a5-95160fdea614 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:09.622356 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-40608407-c12b-4b8d-82a5-95160fdea614 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:09.622777 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-40608407-c12b-4b8d-82a5-95160fdea614 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:09.771880 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-40608407-c12b-4b8d-82a5-95160fdea614 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3afc9f4d5bc3473c837926583d334d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d19d73eda154313be8539147f42ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:48:09.780618 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-40608407-c12b-4b8d-82a5-95160fdea614 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] 10.222.0.84 "GET /compute/v2.1/servers/1e63bdcd-3690-4de7-b6a5-f096d20c975f" status: 200 len: 1314 microversion: 2.1 time: 0.172672 Aug 24 11:48:09.781516 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 612/1264] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:48:09 2022] GET /compute/v2.1/servers/1e63bdcd-3690-4de7-b6a5-f096d20c975f => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:48:10.803726 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-fcd8b749-fa65-42e6-8ea1-39fd0f09a9ea tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:48:10.804929 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-fcd8b749-fa65-42e6-8ea1-39fd0f09a9ea tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] [instance: 1e63bdcd-3690-4de7-b6a5-f096d20c975f] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:48:10.807441 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG dbcounter [-] [124769] Writing DB stats nova_cell0:SELECT=4 {{(pid=124769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:48:10.814151 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-fcd8b749-fa65-42e6-8ea1-39fd0f09a9ea tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:10.814780 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-fcd8b749-fa65-42e6-8ea1-39fd0f09a9ea tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:10.815318 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-fcd8b749-fa65-42e6-8ea1-39fd0f09a9ea tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:10.816049 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-fcd8b749-fa65-42e6-8ea1-39fd0f09a9ea tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:10.816521 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-fcd8b749-fa65-42e6-8ea1-39fd0f09a9ea tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:10.816973 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-fcd8b749-fa65-42e6-8ea1-39fd0f09a9ea tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:10.974517 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-fcd8b749-fa65-42e6-8ea1-39fd0f09a9ea tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3afc9f4d5bc3473c837926583d334d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d19d73eda154313be8539147f42ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:48:10.983000 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-fcd8b749-fa65-42e6-8ea1-39fd0f09a9ea tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] 10.222.0.84 "GET /compute/v2.1/servers/1e63bdcd-3690-4de7-b6a5-f096d20c975f" status: 200 len: 1314 microversion: 2.1 time: 0.184547 Aug 24 11:48:10.983594 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 653/1265] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:48:10 2022] GET /compute/v2.1/servers/1e63bdcd-3690-4de7-b6a5-f096d20c975f => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:48:12.004093 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-f8483877-58c0-4241-98a0-39021e9f5b0e tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:48:12.004920 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-f8483877-58c0-4241-98a0-39021e9f5b0e tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] [instance: 1e63bdcd-3690-4de7-b6a5-f096d20c975f] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:48:12.012078 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-f8483877-58c0-4241-98a0-39021e9f5b0e tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:12.012560 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-f8483877-58c0-4241-98a0-39021e9f5b0e tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:12.013028 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-f8483877-58c0-4241-98a0-39021e9f5b0e tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:12.013735 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-f8483877-58c0-4241-98a0-39021e9f5b0e tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:12.014183 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-f8483877-58c0-4241-98a0-39021e9f5b0e tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:12.014601 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-f8483877-58c0-4241-98a0-39021e9f5b0e tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:12.163632 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-f8483877-58c0-4241-98a0-39021e9f5b0e tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3afc9f4d5bc3473c837926583d334d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d19d73eda154313be8539147f42ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:48:12.167284 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:48:12.172423 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-f8483877-58c0-4241-98a0-39021e9f5b0e tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] 10.222.0.84 "GET /compute/v2.1/servers/1e63bdcd-3690-4de7-b6a5-f096d20c975f" status: 200 len: 1314 microversion: 2.1 time: 0.172586 Aug 24 11:48:12.173056 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 613/1266] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:48:11 2022] GET /compute/v2.1/servers/1e63bdcd-3690-4de7-b6a5-f096d20c975f => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:48:13.193498 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-e8c6586a-9a07-4ef6-8aaa-d81886048b3a tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:48:13.194049 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-e8c6586a-9a07-4ef6-8aaa-d81886048b3a tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] [instance: 1e63bdcd-3690-4de7-b6a5-f096d20c975f] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:48:13.201350 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-e8c6586a-9a07-4ef6-8aaa-d81886048b3a tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:13.201825 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-e8c6586a-9a07-4ef6-8aaa-d81886048b3a tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:13.202253 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-e8c6586a-9a07-4ef6-8aaa-d81886048b3a tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:13.202927 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-e8c6586a-9a07-4ef6-8aaa-d81886048b3a tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:13.203371 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-e8c6586a-9a07-4ef6-8aaa-d81886048b3a tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:13.203883 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-e8c6586a-9a07-4ef6-8aaa-d81886048b3a tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:13.342140 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-e8c6586a-9a07-4ef6-8aaa-d81886048b3a tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3afc9f4d5bc3473c837926583d334d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d19d73eda154313be8539147f42ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:48:13.352326 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-e8c6586a-9a07-4ef6-8aaa-d81886048b3a tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] 10.222.0.84 "GET /compute/v2.1/servers/1e63bdcd-3690-4de7-b6a5-f096d20c975f" status: 200 len: 1314 microversion: 2.1 time: 0.160346 Aug 24 11:48:13.352326 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 654/1267] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:48:13 2022] GET /compute/v2.1/servers/1e63bdcd-3690-4de7-b6a5-f096d20c975f => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:48:14.371554 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-1e26c728-398d-4b3a-827c-8c3fe1926627 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:48:14.372172 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-1e26c728-398d-4b3a-827c-8c3fe1926627 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] [instance: 1e63bdcd-3690-4de7-b6a5-f096d20c975f] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:48:14.379276 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1e26c728-398d-4b3a-827c-8c3fe1926627 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:14.379757 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1e26c728-398d-4b3a-827c-8c3fe1926627 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:14.380194 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1e26c728-398d-4b3a-827c-8c3fe1926627 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:14.380909 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1e26c728-398d-4b3a-827c-8c3fe1926627 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:14.381357 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1e26c728-398d-4b3a-827c-8c3fe1926627 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:14.381779 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1e26c728-398d-4b3a-827c-8c3fe1926627 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:14.517739 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-1e26c728-398d-4b3a-827c-8c3fe1926627 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3afc9f4d5bc3473c837926583d334d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d19d73eda154313be8539147f42ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:48:14.525639 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-1e26c728-398d-4b3a-827c-8c3fe1926627 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] 10.222.0.84 "GET /compute/v2.1/servers/1e63bdcd-3690-4de7-b6a5-f096d20c975f" status: 200 len: 1314 microversion: 2.1 time: 0.158588 Aug 24 11:48:14.526201 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 614/1268] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:48:14 2022] GET /compute/v2.1/servers/1e63bdcd-3690-4de7-b6a5-f096d20c975f => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:48:15.547522 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-a39be3bd-beb4-454b-b5ea-efba02ade801 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:48:15.548154 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-a39be3bd-beb4-454b-b5ea-efba02ade801 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] [instance: 1e63bdcd-3690-4de7-b6a5-f096d20c975f] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:48:15.554871 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-a39be3bd-beb4-454b-b5ea-efba02ade801 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:15.555347 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-a39be3bd-beb4-454b-b5ea-efba02ade801 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:15.555776 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-a39be3bd-beb4-454b-b5ea-efba02ade801 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:15.556458 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-a39be3bd-beb4-454b-b5ea-efba02ade801 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:15.557163 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-a39be3bd-beb4-454b-b5ea-efba02ade801 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:15.557514 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-a39be3bd-beb4-454b-b5ea-efba02ade801 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:15.705080 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-a39be3bd-beb4-454b-b5ea-efba02ade801 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3afc9f4d5bc3473c837926583d334d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d19d73eda154313be8539147f42ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:48:15.713035 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-a39be3bd-beb4-454b-b5ea-efba02ade801 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] 10.222.0.84 "GET /compute/v2.1/servers/1e63bdcd-3690-4de7-b6a5-f096d20c975f" status: 200 len: 1314 microversion: 2.1 time: 0.169274 Aug 24 11:48:15.713638 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 655/1269] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:48:15 2022] GET /compute/v2.1/servers/1e63bdcd-3690-4de7-b6a5-f096d20c975f => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:48:16.734726 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-2a979485-0e1c-43c2-8515-9d3776d77b6c tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:48:16.735584 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-2a979485-0e1c-43c2-8515-9d3776d77b6c tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] [instance: 1e63bdcd-3690-4de7-b6a5-f096d20c975f] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:48:16.742401 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-2a979485-0e1c-43c2-8515-9d3776d77b6c tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:16.742884 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-2a979485-0e1c-43c2-8515-9d3776d77b6c tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:16.743311 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-2a979485-0e1c-43c2-8515-9d3776d77b6c tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:16.744001 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-2a979485-0e1c-43c2-8515-9d3776d77b6c tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:16.744447 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-2a979485-0e1c-43c2-8515-9d3776d77b6c tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:16.744895 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-2a979485-0e1c-43c2-8515-9d3776d77b6c tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:16.891883 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-2a979485-0e1c-43c2-8515-9d3776d77b6c tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3afc9f4d5bc3473c837926583d334d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d19d73eda154313be8539147f42ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:48:16.901421 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-2a979485-0e1c-43c2-8515-9d3776d77b6c tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] 10.222.0.84 "GET /compute/v2.1/servers/1e63bdcd-3690-4de7-b6a5-f096d20c975f" status: 200 len: 1314 microversion: 2.1 time: 0.170734 Aug 24 11:48:16.902646 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 615/1270] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:48:16 2022] GET /compute/v2.1/servers/1e63bdcd-3690-4de7-b6a5-f096d20c975f => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:48:17.923896 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-cebc73ca-6df9-49aa-a9a2-32ee81e0054e tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:48:17.924573 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-cebc73ca-6df9-49aa-a9a2-32ee81e0054e tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] [instance: 1e63bdcd-3690-4de7-b6a5-f096d20c975f] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:48:17.931529 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-cebc73ca-6df9-49aa-a9a2-32ee81e0054e tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:17.932195 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-cebc73ca-6df9-49aa-a9a2-32ee81e0054e tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:17.932784 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-cebc73ca-6df9-49aa-a9a2-32ee81e0054e tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:17.933816 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-cebc73ca-6df9-49aa-a9a2-32ee81e0054e tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:17.934452 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-cebc73ca-6df9-49aa-a9a2-32ee81e0054e tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:17.934882 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-cebc73ca-6df9-49aa-a9a2-32ee81e0054e tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:17.956018 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG dbcounter [-] [124769] Writing DB stats nova_cell1:SELECT=100 {{(pid=124769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:48:18.142762 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-cebc73ca-6df9-49aa-a9a2-32ee81e0054e tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3afc9f4d5bc3473c837926583d334d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d19d73eda154313be8539147f42ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:48:18.151366 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-cebc73ca-6df9-49aa-a9a2-32ee81e0054e tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] 10.222.0.84 "GET /compute/v2.1/servers/1e63bdcd-3690-4de7-b6a5-f096d20c975f" status: 200 len: 1314 microversion: 2.1 time: 0.230962 Aug 24 11:48:18.153129 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 656/1271] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:48:17 2022] GET /compute/v2.1/servers/1e63bdcd-3690-4de7-b6a5-f096d20c975f => generated 1314 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:48:18.291487 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-b28a1956-d6c3-4ddb-aea2-3773d363c038 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:48:18.292066 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-b28a1956-d6c3-4ddb-aea2-3773d363c038 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] [instance: fef25575-f211-4db2-8c1f-e1cd8e73e69d] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:48:18.301018 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [req-dfec33bf-213d-4f40-9ac0-09820dfef855 req-99e4d431-c4f1-4986-82e3-a3410333b6cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fef25575-f211-4db2-8c1f-e1cd8e73e69d", "tag": "f074715e-37e5-4ad1-955b-cb3c250052f0"}]} {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:48:18.306200 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b28a1956-d6c3-4ddb-aea2-3773d363c038 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:18.306837 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b28a1956-d6c3-4ddb-aea2-3773d363c038 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:18.307428 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b28a1956-d6c3-4ddb-aea2-3773d363c038 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:18.308232 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b28a1956-d6c3-4ddb-aea2-3773d363c038 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:18.308812 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b28a1956-d6c3-4ddb-aea2-3773d363c038 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:18.309465 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b28a1956-d6c3-4ddb-aea2-3773d363c038 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:18.313035 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [req-dfec33bf-213d-4f40-9ac0-09820dfef855 req-99e4d431-c4f1-4986-82e3-a3410333b6cc service nova] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:18.313736 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [req-dfec33bf-213d-4f40-9ac0-09820dfef855 req-99e4d431-c4f1-4986-82e3-a3410333b6cc service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:18.314251 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [req-dfec33bf-213d-4f40-9ac0-09820dfef855 req-99e4d431-c4f1-4986-82e3-a3410333b6cc service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:18.327348 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.compute.server_external_events [req-dfec33bf-213d-4f40-9ac0-09820dfef855 req-99e4d431-c4f1-4986-82e3-a3410333b6cc service nova] Creating event network-changed:f074715e-37e5-4ad1-955b-cb3c250052f0 for instance fef25575-f211-4db2-8c1f-e1cd8e73e69d on hv-cinder-85427 Aug 24 11:48:18.336296 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [req-dfec33bf-213d-4f40-9ac0-09820dfef855 req-99e4d431-c4f1-4986-82e3-a3410333b6cc service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039369 Aug 24 11:48:18.343022 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 657/1272] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Aug 24 11:48:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:48:18.344984 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-b28a1956-d6c3-4ddb-aea2-3773d363c038 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] [instance: fef25575-f211-4db2-8c1f-e1cd8e73e69d] Going to try to terminate instance {{(pid=124770) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 11:48:18.827077 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-b28a1956-d6c3-4ddb-aea2-3773d363c038 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] 10.222.0.84 "DELETE /compute/v2.1/servers/fef25575-f211-4db2-8c1f-e1cd8e73e69d" status: 204 len: 0 microversion: 2.1 time: 0.539930 Aug 24 11:48:18.828385 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 616/1273] 10.222.0.84 () {58 vars in 1239 bytes} [Wed Aug 24 11:48:18 2022] DELETE /compute/v2.1/servers/fef25575-f211-4db2-8c1f-e1cd8e73e69d => generated 0 bytes in 542 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 11:48:18.841227 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-33b9b494-04fc-4b21-8474-d1d14ffd9e08 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:48:18.842171 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-33b9b494-04fc-4b21-8474-d1d14ffd9e08 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] [instance: fef25575-f211-4db2-8c1f-e1cd8e73e69d] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:48:18.850688 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-33b9b494-04fc-4b21-8474-d1d14ffd9e08 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:18.851355 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-33b9b494-04fc-4b21-8474-d1d14ffd9e08 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:18.852049 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-33b9b494-04fc-4b21-8474-d1d14ffd9e08 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:18.853814 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-33b9b494-04fc-4b21-8474-d1d14ffd9e08 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:18.854445 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-33b9b494-04fc-4b21-8474-d1d14ffd9e08 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:18.855695 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-33b9b494-04fc-4b21-8474-d1d14ffd9e08 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:19.046297 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-33b9b494-04fc-4b21-8474-d1d14ffd9e08 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b82b6f568bd41fa9d6b44facb766e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ef3fc15a0147e39228729d2b5b2631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:48:19.055026 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-33b9b494-04fc-4b21-8474-d1d14ffd9e08 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] 10.222.0.84 "GET /compute/v2.1/servers/fef25575-f211-4db2-8c1f-e1cd8e73e69d" status: 200 len: 1578 microversion: 2.1 time: 0.221007 Aug 24 11:48:19.055630 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 658/1274] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:48:18 2022] GET /compute/v2.1/servers/fef25575-f211-4db2-8c1f-e1cd8e73e69d => generated 1578 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:48:19.177097 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-0009dde2-8f70-4eb9-b323-46251e82e38d tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:48:19.177913 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-0009dde2-8f70-4eb9-b323-46251e82e38d tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] [instance: 1e63bdcd-3690-4de7-b6a5-f096d20c975f] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:48:19.186636 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-0009dde2-8f70-4eb9-b323-46251e82e38d tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:19.189724 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-0009dde2-8f70-4eb9-b323-46251e82e38d tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:19.189724 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-0009dde2-8f70-4eb9-b323-46251e82e38d tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:19.189724 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-0009dde2-8f70-4eb9-b323-46251e82e38d tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:19.189724 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-0009dde2-8f70-4eb9-b323-46251e82e38d tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:19.190313 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-0009dde2-8f70-4eb9-b323-46251e82e38d tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:19.383013 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-0009dde2-8f70-4eb9-b323-46251e82e38d tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3afc9f4d5bc3473c837926583d334d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d19d73eda154313be8539147f42ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:48:19.395989 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-0009dde2-8f70-4eb9-b323-46251e82e38d tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] 10.222.0.84 "GET /compute/v2.1/servers/1e63bdcd-3690-4de7-b6a5-f096d20c975f" status: 200 len: 1314 microversion: 2.1 time: 0.223778 Aug 24 11:48:19.396581 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 617/1275] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:48:19 2022] GET /compute/v2.1/servers/1e63bdcd-3690-4de7-b6a5-f096d20c975f => generated 1314 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:48:20.078137 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-c65e235f-5c10-4d83-803a-46745093236c tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:48:20.078731 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-c65e235f-5c10-4d83-803a-46745093236c tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] [instance: fef25575-f211-4db2-8c1f-e1cd8e73e69d] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:48:20.085240 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-c65e235f-5c10-4d83-803a-46745093236c tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:20.085719 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-c65e235f-5c10-4d83-803a-46745093236c tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:20.086155 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-c65e235f-5c10-4d83-803a-46745093236c tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:20.086834 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-c65e235f-5c10-4d83-803a-46745093236c tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:20.087282 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-c65e235f-5c10-4d83-803a-46745093236c tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:20.087702 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-c65e235f-5c10-4d83-803a-46745093236c tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:20.229562 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-c65e235f-5c10-4d83-803a-46745093236c tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b82b6f568bd41fa9d6b44facb766e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ef3fc15a0147e39228729d2b5b2631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:48:20.238783 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-c65e235f-5c10-4d83-803a-46745093236c tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] 10.222.0.84 "GET /compute/v2.1/servers/fef25575-f211-4db2-8c1f-e1cd8e73e69d" status: 200 len: 1578 microversion: 2.1 time: 0.165525 Aug 24 11:48:20.239341 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 659/1276] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:48:20 2022] GET /compute/v2.1/servers/fef25575-f211-4db2-8c1f-e1cd8e73e69d => generated 1578 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:48:20.418360 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-d97c7ab4-0ea2-4063-996c-12bac52e290f tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:48:20.418955 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-d97c7ab4-0ea2-4063-996c-12bac52e290f tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] [instance: 1e63bdcd-3690-4de7-b6a5-f096d20c975f] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:48:20.425705 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d97c7ab4-0ea2-4063-996c-12bac52e290f tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:20.426187 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d97c7ab4-0ea2-4063-996c-12bac52e290f tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:20.426618 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d97c7ab4-0ea2-4063-996c-12bac52e290f tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:20.427312 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d97c7ab4-0ea2-4063-996c-12bac52e290f tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:20.427763 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d97c7ab4-0ea2-4063-996c-12bac52e290f tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:20.428189 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d97c7ab4-0ea2-4063-996c-12bac52e290f tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:20.616001 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-d97c7ab4-0ea2-4063-996c-12bac52e290f tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3afc9f4d5bc3473c837926583d334d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d19d73eda154313be8539147f42ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:48:20.623916 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-d97c7ab4-0ea2-4063-996c-12bac52e290f tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] 10.222.0.84 "GET /compute/v2.1/servers/1e63bdcd-3690-4de7-b6a5-f096d20c975f" status: 200 len: 1314 microversion: 2.1 time: 0.210053 Aug 24 11:48:20.624607 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 618/1277] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:48:20 2022] GET /compute/v2.1/servers/1e63bdcd-3690-4de7-b6a5-f096d20c975f => generated 1314 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:48:21.260588 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-97491b98-7a05-4352-86dc-68252723679c tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:48:21.261290 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-97491b98-7a05-4352-86dc-68252723679c tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] [instance: fef25575-f211-4db2-8c1f-e1cd8e73e69d] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:48:21.268033 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-97491b98-7a05-4352-86dc-68252723679c tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:21.268525 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-97491b98-7a05-4352-86dc-68252723679c tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:21.269021 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-97491b98-7a05-4352-86dc-68252723679c tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:21.269701 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-97491b98-7a05-4352-86dc-68252723679c tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:21.270157 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-97491b98-7a05-4352-86dc-68252723679c tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:21.270674 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-97491b98-7a05-4352-86dc-68252723679c tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:21.413487 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-97491b98-7a05-4352-86dc-68252723679c tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b82b6f568bd41fa9d6b44facb766e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ef3fc15a0147e39228729d2b5b2631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:48:21.423773 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-97491b98-7a05-4352-86dc-68252723679c tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] 10.222.0.84 "GET /compute/v2.1/servers/fef25575-f211-4db2-8c1f-e1cd8e73e69d" status: 200 len: 1459 microversion: 2.1 time: 0.166973 Aug 24 11:48:21.424365 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 660/1278] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:48:21 2022] GET /compute/v2.1/servers/fef25575-f211-4db2-8c1f-e1cd8e73e69d => generated 1459 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:48:21.645779 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-82f77f73-7a5b-42bc-b93c-60ff8ee24c05 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:48:21.646382 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-82f77f73-7a5b-42bc-b93c-60ff8ee24c05 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] [instance: 1e63bdcd-3690-4de7-b6a5-f096d20c975f] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:48:21.648824 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:48:21.654337 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-82f77f73-7a5b-42bc-b93c-60ff8ee24c05 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:21.654824 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-82f77f73-7a5b-42bc-b93c-60ff8ee24c05 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:21.655392 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-82f77f73-7a5b-42bc-b93c-60ff8ee24c05 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:21.656092 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-82f77f73-7a5b-42bc-b93c-60ff8ee24c05 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:21.656543 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-82f77f73-7a5b-42bc-b93c-60ff8ee24c05 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:21.656992 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-82f77f73-7a5b-42bc-b93c-60ff8ee24c05 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:21.802127 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-82f77f73-7a5b-42bc-b93c-60ff8ee24c05 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3afc9f4d5bc3473c837926583d334d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d19d73eda154313be8539147f42ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:48:21.811019 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-82f77f73-7a5b-42bc-b93c-60ff8ee24c05 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] 10.222.0.84 "GET /compute/v2.1/servers/1e63bdcd-3690-4de7-b6a5-f096d20c975f" status: 200 len: 1314 microversion: 2.1 time: 0.168950 Aug 24 11:48:21.811629 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 619/1279] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:48:21 2022] GET /compute/v2.1/servers/1e63bdcd-3690-4de7-b6a5-f096d20c975f => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:48:22.445623 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-d1188b21-1a7f-4acf-ab8d-0cf325da011f tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:48:22.446226 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-d1188b21-1a7f-4acf-ab8d-0cf325da011f tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] [instance: fef25575-f211-4db2-8c1f-e1cd8e73e69d] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:48:22.449313 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG dbcounter [-] [124769] Writing DB stats nova_api:SELECT=60 {{(pid=124769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:48:22.454428 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-d1188b21-1a7f-4acf-ab8d-0cf325da011f tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:22.454915 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-d1188b21-1a7f-4acf-ab8d-0cf325da011f tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:22.455492 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-d1188b21-1a7f-4acf-ab8d-0cf325da011f tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:22.456197 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-d1188b21-1a7f-4acf-ab8d-0cf325da011f tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:22.456650 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-d1188b21-1a7f-4acf-ab8d-0cf325da011f tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:22.457180 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-d1188b21-1a7f-4acf-ab8d-0cf325da011f tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:22.605252 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-d1188b21-1a7f-4acf-ab8d-0cf325da011f tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b82b6f568bd41fa9d6b44facb766e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ef3fc15a0147e39228729d2b5b2631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:48:22.615521 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-d1188b21-1a7f-4acf-ab8d-0cf325da011f tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] 10.222.0.84 "GET /compute/v2.1/servers/fef25575-f211-4db2-8c1f-e1cd8e73e69d" status: 200 len: 1459 microversion: 2.1 time: 0.173672 Aug 24 11:48:22.616201 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 661/1280] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:48:22 2022] GET /compute/v2.1/servers/fef25575-f211-4db2-8c1f-e1cd8e73e69d => generated 1459 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:48:22.832065 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-241169a9-03fd-473e-84f0-5f109ca87a7b tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:48:22.832693 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-241169a9-03fd-473e-84f0-5f109ca87a7b tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] [instance: 1e63bdcd-3690-4de7-b6a5-f096d20c975f] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:48:22.840897 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-241169a9-03fd-473e-84f0-5f109ca87a7b tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:22.841413 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-241169a9-03fd-473e-84f0-5f109ca87a7b tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:22.841856 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-241169a9-03fd-473e-84f0-5f109ca87a7b tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:22.842583 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-241169a9-03fd-473e-84f0-5f109ca87a7b tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:22.843043 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-241169a9-03fd-473e-84f0-5f109ca87a7b tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:22.843473 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-241169a9-03fd-473e-84f0-5f109ca87a7b tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:22.994430 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-241169a9-03fd-473e-84f0-5f109ca87a7b tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3afc9f4d5bc3473c837926583d334d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d19d73eda154313be8539147f42ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:48:23.003397 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-241169a9-03fd-473e-84f0-5f109ca87a7b tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] 10.222.0.84 "GET /compute/v2.1/servers/1e63bdcd-3690-4de7-b6a5-f096d20c975f" status: 200 len: 1314 microversion: 2.1 time: 0.175249 Aug 24 11:48:23.003977 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 620/1281] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:48:22 2022] GET /compute/v2.1/servers/1e63bdcd-3690-4de7-b6a5-f096d20c975f => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:48:23.613906 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 11:48:23.614482 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Wed Aug 24 11:48:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 11:48:23.637706 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-a3c669a5-119a-42f3-8919-7ff395def5e9 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:48:23.638319 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-a3c669a5-119a-42f3-8919-7ff395def5e9 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] [instance: fef25575-f211-4db2-8c1f-e1cd8e73e69d] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:48:23.645074 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-a3c669a5-119a-42f3-8919-7ff395def5e9 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:23.645559 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-a3c669a5-119a-42f3-8919-7ff395def5e9 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:23.645994 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-a3c669a5-119a-42f3-8919-7ff395def5e9 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:23.646708 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-a3c669a5-119a-42f3-8919-7ff395def5e9 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:23.647162 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-a3c669a5-119a-42f3-8919-7ff395def5e9 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:23.647587 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-a3c669a5-119a-42f3-8919-7ff395def5e9 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:23.779594 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-a3c669a5-119a-42f3-8919-7ff395def5e9 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b82b6f568bd41fa9d6b44facb766e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ef3fc15a0147e39228729d2b5b2631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:48:23.787272 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-a3c669a5-119a-42f3-8919-7ff395def5e9 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] 10.222.0.84 "GET /compute/v2.1/servers/fef25575-f211-4db2-8c1f-e1cd8e73e69d" status: 200 len: 1459 microversion: 2.1 time: 0.153903 Aug 24 11:48:23.787830 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 662/1282] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:48:23 2022] GET /compute/v2.1/servers/fef25575-f211-4db2-8c1f-e1cd8e73e69d => generated 1459 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:48:24.029229 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-4bed6437-8423-4a9f-951f-4d1822f00fda tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:48:24.029839 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-4bed6437-8423-4a9f-951f-4d1822f00fda tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] [instance: 1e63bdcd-3690-4de7-b6a5-f096d20c975f] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:48:24.036132 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4bed6437-8423-4a9f-951f-4d1822f00fda tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:24.036619 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4bed6437-8423-4a9f-951f-4d1822f00fda tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:24.037089 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4bed6437-8423-4a9f-951f-4d1822f00fda tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:24.037831 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4bed6437-8423-4a9f-951f-4d1822f00fda tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:24.038337 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4bed6437-8423-4a9f-951f-4d1822f00fda tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:24.038797 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4bed6437-8423-4a9f-951f-4d1822f00fda tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:24.197286 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-4bed6437-8423-4a9f-951f-4d1822f00fda tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3afc9f4d5bc3473c837926583d334d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d19d73eda154313be8539147f42ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:48:24.209034 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-4bed6437-8423-4a9f-951f-4d1822f00fda tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] 10.222.0.84 "GET /compute/v2.1/servers/1e63bdcd-3690-4de7-b6a5-f096d20c975f" status: 200 len: 1314 microversion: 2.1 time: 0.187693 Aug 24 11:48:24.209793 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 621/1283] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:48:24 2022] GET /compute/v2.1/servers/1e63bdcd-3690-4de7-b6a5-f096d20c975f => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:48:24.809275 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-9393fe98-4bef-47b3-9fa4-fffb18dcf41a tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:48:24.809935 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-9393fe98-4bef-47b3-9fa4-fffb18dcf41a tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] [instance: fef25575-f211-4db2-8c1f-e1cd8e73e69d] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:48:24.816468 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-9393fe98-4bef-47b3-9fa4-fffb18dcf41a tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:24.816987 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-9393fe98-4bef-47b3-9fa4-fffb18dcf41a tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:24.817433 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-9393fe98-4bef-47b3-9fa4-fffb18dcf41a tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:24.818127 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-9393fe98-4bef-47b3-9fa4-fffb18dcf41a tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:24.818584 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-9393fe98-4bef-47b3-9fa4-fffb18dcf41a tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:24.819013 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-9393fe98-4bef-47b3-9fa4-fffb18dcf41a tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:24.999397 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-9393fe98-4bef-47b3-9fa4-fffb18dcf41a tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b82b6f568bd41fa9d6b44facb766e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ef3fc15a0147e39228729d2b5b2631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:48:25.007762 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-9393fe98-4bef-47b3-9fa4-fffb18dcf41a tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] 10.222.0.84 "GET /compute/v2.1/servers/fef25575-f211-4db2-8c1f-e1cd8e73e69d" status: 200 len: 1459 microversion: 2.1 time: 0.202277 Aug 24 11:48:25.008663 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 663/1284] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:48:24 2022] GET /compute/v2.1/servers/fef25575-f211-4db2-8c1f-e1cd8e73e69d => generated 1459 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:48:25.230692 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-d2d0beba-2ea3-4fce-a055-7425207e7bd4 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:48:25.232688 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-d2d0beba-2ea3-4fce-a055-7425207e7bd4 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] [instance: 1e63bdcd-3690-4de7-b6a5-f096d20c975f] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:48:25.239879 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d2d0beba-2ea3-4fce-a055-7425207e7bd4 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:25.240493 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d2d0beba-2ea3-4fce-a055-7425207e7bd4 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:25.241033 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d2d0beba-2ea3-4fce-a055-7425207e7bd4 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:25.241808 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d2d0beba-2ea3-4fce-a055-7425207e7bd4 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:25.242314 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d2d0beba-2ea3-4fce-a055-7425207e7bd4 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:25.242909 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d2d0beba-2ea3-4fce-a055-7425207e7bd4 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:25.391099 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-d2d0beba-2ea3-4fce-a055-7425207e7bd4 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3afc9f4d5bc3473c837926583d334d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d19d73eda154313be8539147f42ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:48:25.400486 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-d2d0beba-2ea3-4fce-a055-7425207e7bd4 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] 10.222.0.84 "GET /compute/v2.1/servers/1e63bdcd-3690-4de7-b6a5-f096d20c975f" status: 200 len: 1314 microversion: 2.1 time: 0.174127 Aug 24 11:48:25.401111 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 622/1285] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:48:25 2022] GET /compute/v2.1/servers/1e63bdcd-3690-4de7-b6a5-f096d20c975f => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:48:25.576858 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [req-39fc3271-3968-4141-8b32-4079cb48ee06 req-f6340865-1c66-4e29-b2bb-c300231f5a22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fef25575-f211-4db2-8c1f-e1cd8e73e69d", "name": "network-vif-deleted", "tag": "f074715e-37e5-4ad1-955b-cb3c250052f0"}]} {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:48:25.587309 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [req-39fc3271-3968-4141-8b32-4079cb48ee06 req-f6340865-1c66-4e29-b2bb-c300231f5a22 service nova] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:25.587785 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [req-39fc3271-3968-4141-8b32-4079cb48ee06 req-f6340865-1c66-4e29-b2bb-c300231f5a22 service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:25.588231 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [req-39fc3271-3968-4141-8b32-4079cb48ee06 req-f6340865-1c66-4e29-b2bb-c300231f5a22 service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:25.604729 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.compute.server_external_events [req-39fc3271-3968-4141-8b32-4079cb48ee06 req-f6340865-1c66-4e29-b2bb-c300231f5a22 service nova] Creating event network-vif-deleted:f074715e-37e5-4ad1-955b-cb3c250052f0 for instance fef25575-f211-4db2-8c1f-e1cd8e73e69d on hv-cinder-85427 Aug 24 11:48:25.611476 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [req-39fc3271-3968-4141-8b32-4079cb48ee06 req-f6340865-1c66-4e29-b2bb-c300231f5a22 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103240 Aug 24 11:48:25.612120 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 664/1286] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Aug 24 11:48:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:48:26.030529 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-5c2c0488-476f-4846-a6a5-915d06da5995 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:48:26.031078 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-5c2c0488-476f-4846-a6a5-915d06da5995 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] [instance: fef25575-f211-4db2-8c1f-e1cd8e73e69d] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:48:26.037221 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5c2c0488-476f-4846-a6a5-915d06da5995 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:26.037695 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5c2c0488-476f-4846-a6a5-915d06da5995 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:26.038132 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5c2c0488-476f-4846-a6a5-915d06da5995 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:26.038822 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5c2c0488-476f-4846-a6a5-915d06da5995 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:26.039270 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5c2c0488-476f-4846-a6a5-915d06da5995 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:26.039691 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5c2c0488-476f-4846-a6a5-915d06da5995 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:26.109866 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-5c2c0488-476f-4846-a6a5-915d06da5995 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b82b6f568bd41fa9d6b44facb766e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ef3fc15a0147e39228729d2b5b2631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:48:26.118445 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-5c2c0488-476f-4846-a6a5-915d06da5995 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] 10.222.0.84 "GET /compute/v2.1/servers/fef25575-f211-4db2-8c1f-e1cd8e73e69d" status: 200 len: 1225 microversion: 2.1 time: 0.092709 Aug 24 11:48:26.119038 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 623/1287] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:48:26 2022] GET /compute/v2.1/servers/fef25575-f211-4db2-8c1f-e1cd8e73e69d => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:48:26.435997 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-9ee58476-97f2-47ea-8bf7-9aba628e20dc tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:48:26.436897 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-9ee58476-97f2-47ea-8bf7-9aba628e20dc tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] [instance: 1e63bdcd-3690-4de7-b6a5-f096d20c975f] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:48:26.443675 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-9ee58476-97f2-47ea-8bf7-9aba628e20dc tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:26.444160 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-9ee58476-97f2-47ea-8bf7-9aba628e20dc tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:26.444600 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-9ee58476-97f2-47ea-8bf7-9aba628e20dc tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:26.445601 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-9ee58476-97f2-47ea-8bf7-9aba628e20dc tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:26.446056 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-9ee58476-97f2-47ea-8bf7-9aba628e20dc tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:26.446478 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-9ee58476-97f2-47ea-8bf7-9aba628e20dc tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:26.601880 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-9ee58476-97f2-47ea-8bf7-9aba628e20dc tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3afc9f4d5bc3473c837926583d334d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d19d73eda154313be8539147f42ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:48:26.610816 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-9ee58476-97f2-47ea-8bf7-9aba628e20dc tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] 10.222.0.84 "GET /compute/v2.1/servers/1e63bdcd-3690-4de7-b6a5-f096d20c975f" status: 200 len: 1314 microversion: 2.1 time: 0.180741 Aug 24 11:48:26.611477 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 665/1288] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:48:26 2022] GET /compute/v2.1/servers/1e63bdcd-3690-4de7-b6a5-f096d20c975f => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:48:26.713521 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [req-338a60bb-ecdf-4bb1-be37-9cc9aa36eded req-473f22dc-a212-4aca-a7c1-e8df2a6a8cae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e63bdcd-3690-4de7-b6a5-f096d20c975f", "name": "network-vif-plugged", "status": "completed", "tag": "f0efb3fa-d392-4e21-8896-15afb6251248"}]} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:48:26.724534 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-338a60bb-ecdf-4bb1-be37-9cc9aa36eded req-473f22dc-a212-4aca-a7c1-e8df2a6a8cae service nova] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:26.725054 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-338a60bb-ecdf-4bb1-be37-9cc9aa36eded req-473f22dc-a212-4aca-a7c1-e8df2a6a8cae service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:26.725495 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-338a60bb-ecdf-4bb1-be37-9cc9aa36eded req-473f22dc-a212-4aca-a7c1-e8df2a6a8cae service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:26.738590 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.compute.server_external_events [req-338a60bb-ecdf-4bb1-be37-9cc9aa36eded req-473f22dc-a212-4aca-a7c1-e8df2a6a8cae service nova] Creating event network-vif-plugged:f0efb3fa-d392-4e21-8896-15afb6251248 for instance 1e63bdcd-3690-4de7-b6a5-f096d20c975f on hv-cinder-85427 Aug 24 11:48:26.745398 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [req-338a60bb-ecdf-4bb1-be37-9cc9aa36eded req-473f22dc-a212-4aca-a7c1-e8df2a6a8cae service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105350 Aug 24 11:48:26.746016 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 624/1289] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Aug 24 11:48:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:48:27.142403 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-df3b149f-a357-4c9d-8f9f-8e1c8ed1efcb tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:48:27.143019 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-df3b149f-a357-4c9d-8f9f-8e1c8ed1efcb tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] [instance: fef25575-f211-4db2-8c1f-e1cd8e73e69d] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:48:27.149214 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-df3b149f-a357-4c9d-8f9f-8e1c8ed1efcb tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:27.149695 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-df3b149f-a357-4c9d-8f9f-8e1c8ed1efcb tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:27.150124 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-df3b149f-a357-4c9d-8f9f-8e1c8ed1efcb tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:27.150819 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-df3b149f-a357-4c9d-8f9f-8e1c8ed1efcb tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:27.151265 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-df3b149f-a357-4c9d-8f9f-8e1c8ed1efcb tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:27.151681 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-df3b149f-a357-4c9d-8f9f-8e1c8ed1efcb tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:27.220298 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-df3b149f-a357-4c9d-8f9f-8e1c8ed1efcb tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b82b6f568bd41fa9d6b44facb766e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ef3fc15a0147e39228729d2b5b2631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:48:27.228674 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-df3b149f-a357-4c9d-8f9f-8e1c8ed1efcb tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] 10.222.0.84 "GET /compute/v2.1/servers/fef25575-f211-4db2-8c1f-e1cd8e73e69d" status: 200 len: 1225 microversion: 2.1 time: 0.090575 Aug 24 11:48:27.229330 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 666/1290] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:48:27 2022] GET /compute/v2.1/servers/fef25575-f211-4db2-8c1f-e1cd8e73e69d => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:48:27.634273 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-bf77c599-ee39-47d6-b8c3-c8c698fe87d3 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:48:27.635010 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-bf77c599-ee39-47d6-b8c3-c8c698fe87d3 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] [instance: 1e63bdcd-3690-4de7-b6a5-f096d20c975f] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:48:27.642171 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-bf77c599-ee39-47d6-b8c3-c8c698fe87d3 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:27.642662 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-bf77c599-ee39-47d6-b8c3-c8c698fe87d3 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:27.643099 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-bf77c599-ee39-47d6-b8c3-c8c698fe87d3 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:27.643803 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-bf77c599-ee39-47d6-b8c3-c8c698fe87d3 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:27.644433 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-bf77c599-ee39-47d6-b8c3-c8c698fe87d3 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:27.644685 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-bf77c599-ee39-47d6-b8c3-c8c698fe87d3 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:27.785991 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-bf77c599-ee39-47d6-b8c3-c8c698fe87d3 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3afc9f4d5bc3473c837926583d334d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d19d73eda154313be8539147f42ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:48:27.793727 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-bf77c599-ee39-47d6-b8c3-c8c698fe87d3 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] 10.222.0.84 "GET /compute/v2.1/servers/1e63bdcd-3690-4de7-b6a5-f096d20c975f" status: 200 len: 1314 microversion: 2.1 time: 0.163689 Aug 24 11:48:27.794285 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 625/1291] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:48:27 2022] GET /compute/v2.1/servers/1e63bdcd-3690-4de7-b6a5-f096d20c975f => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:48:28.251163 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-6604527e-6cc0-4b57-a509-3e8b7939ea49 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:48:28.251799 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-6604527e-6cc0-4b57-a509-3e8b7939ea49 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] [instance: fef25575-f211-4db2-8c1f-e1cd8e73e69d] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:48:28.258618 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-6604527e-6cc0-4b57-a509-3e8b7939ea49 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:28.259098 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-6604527e-6cc0-4b57-a509-3e8b7939ea49 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:28.259534 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-6604527e-6cc0-4b57-a509-3e8b7939ea49 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:28.260228 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-6604527e-6cc0-4b57-a509-3e8b7939ea49 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:28.260679 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-6604527e-6cc0-4b57-a509-3e8b7939ea49 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:28.261155 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-6604527e-6cc0-4b57-a509-3e8b7939ea49 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:28.328437 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-6604527e-6cc0-4b57-a509-3e8b7939ea49 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b82b6f568bd41fa9d6b44facb766e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ef3fc15a0147e39228729d2b5b2631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:48:28.336447 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-6604527e-6cc0-4b57-a509-3e8b7939ea49 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] 10.222.0.84 "GET /compute/v2.1/servers/fef25575-f211-4db2-8c1f-e1cd8e73e69d" status: 200 len: 1225 microversion: 2.1 time: 0.089756 Aug 24 11:48:28.337055 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 667/1292] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:48:28 2022] GET /compute/v2.1/servers/fef25575-f211-4db2-8c1f-e1cd8e73e69d => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:48:28.814921 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-cd9e843b-ee4e-4016-ae6b-2b7a8f66e0dd tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:48:28.815524 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-cd9e843b-ee4e-4016-ae6b-2b7a8f66e0dd tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] [instance: 1e63bdcd-3690-4de7-b6a5-f096d20c975f] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:48:28.822436 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-cd9e843b-ee4e-4016-ae6b-2b7a8f66e0dd tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:28.822921 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-cd9e843b-ee4e-4016-ae6b-2b7a8f66e0dd tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:28.823359 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-cd9e843b-ee4e-4016-ae6b-2b7a8f66e0dd tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:28.824056 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-cd9e843b-ee4e-4016-ae6b-2b7a8f66e0dd tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:28.824506 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-cd9e843b-ee4e-4016-ae6b-2b7a8f66e0dd tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:28.824963 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-cd9e843b-ee4e-4016-ae6b-2b7a8f66e0dd tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:28.963666 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-cd9e843b-ee4e-4016-ae6b-2b7a8f66e0dd tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3afc9f4d5bc3473c837926583d334d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d19d73eda154313be8539147f42ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:48:28.972676 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-cd9e843b-ee4e-4016-ae6b-2b7a8f66e0dd tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] 10.222.0.84 "GET /compute/v2.1/servers/1e63bdcd-3690-4de7-b6a5-f096d20c975f" status: 200 len: 1314 microversion: 2.1 time: 0.162049 Aug 24 11:48:28.973314 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 626/1293] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:48:28 2022] GET /compute/v2.1/servers/1e63bdcd-3690-4de7-b6a5-f096d20c975f => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:48:29.358278 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-37212dea-7453-45a0-876b-ad95b31e04d9 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:48:29.358950 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-37212dea-7453-45a0-876b-ad95b31e04d9 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] [instance: fef25575-f211-4db2-8c1f-e1cd8e73e69d] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:48:29.365560 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-37212dea-7453-45a0-876b-ad95b31e04d9 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:29.365952 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-37212dea-7453-45a0-876b-ad95b31e04d9 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:29.366394 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-37212dea-7453-45a0-876b-ad95b31e04d9 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:29.367084 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-37212dea-7453-45a0-876b-ad95b31e04d9 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:29.367878 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-37212dea-7453-45a0-876b-ad95b31e04d9 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:29.368029 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-37212dea-7453-45a0-876b-ad95b31e04d9 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:29.439746 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-37212dea-7453-45a0-876b-ad95b31e04d9 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b82b6f568bd41fa9d6b44facb766e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ef3fc15a0147e39228729d2b5b2631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:48:29.448843 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-37212dea-7453-45a0-876b-ad95b31e04d9 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] 10.222.0.84 "GET /compute/v2.1/servers/fef25575-f211-4db2-8c1f-e1cd8e73e69d" status: 200 len: 1225 microversion: 2.1 time: 0.094849 Aug 24 11:48:29.449431 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 668/1294] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:48:29 2022] GET /compute/v2.1/servers/fef25575-f211-4db2-8c1f-e1cd8e73e69d => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:48:29.994425 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-e011a1c4-fae5-4e9e-91d9-729cb9df0271 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:48:29.994998 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-e011a1c4-fae5-4e9e-91d9-729cb9df0271 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] [instance: 1e63bdcd-3690-4de7-b6a5-f096d20c975f] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:48:30.002735 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e011a1c4-fae5-4e9e-91d9-729cb9df0271 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:30.003224 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e011a1c4-fae5-4e9e-91d9-729cb9df0271 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:30.003850 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e011a1c4-fae5-4e9e-91d9-729cb9df0271 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:30.004357 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e011a1c4-fae5-4e9e-91d9-729cb9df0271 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:30.004834 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e011a1c4-fae5-4e9e-91d9-729cb9df0271 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:30.005265 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e011a1c4-fae5-4e9e-91d9-729cb9df0271 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:30.143972 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-e011a1c4-fae5-4e9e-91d9-729cb9df0271 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3afc9f4d5bc3473c837926583d334d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d19d73eda154313be8539147f42ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:48:30.153866 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-e011a1c4-fae5-4e9e-91d9-729cb9df0271 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] 10.222.0.84 "GET /compute/v2.1/servers/1e63bdcd-3690-4de7-b6a5-f096d20c975f" status: 200 len: 1497 microversion: 2.1 time: 0.163482 Aug 24 11:48:30.154532 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 627/1295] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:48:29 2022] GET /compute/v2.1/servers/1e63bdcd-3690-4de7-b6a5-f096d20c975f => generated 1497 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:48:30.471028 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-75782714-8b14-4a0e-94ca-a5b3ad599c4c tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:48:30.471640 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-75782714-8b14-4a0e-94ca-a5b3ad599c4c tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] [instance: fef25575-f211-4db2-8c1f-e1cd8e73e69d] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:48:30.479262 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-75782714-8b14-4a0e-94ca-a5b3ad599c4c tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:30.479764 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-75782714-8b14-4a0e-94ca-a5b3ad599c4c tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:30.482827 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-75782714-8b14-4a0e-94ca-a5b3ad599c4c tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:30.482827 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-75782714-8b14-4a0e-94ca-a5b3ad599c4c tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:30.482827 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-75782714-8b14-4a0e-94ca-a5b3ad599c4c tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:30.482827 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-75782714-8b14-4a0e-94ca-a5b3ad599c4c tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:30.518477 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-75782714-8b14-4a0e-94ca-a5b3ad599c4c tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:30.518971 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-75782714-8b14-4a0e-94ca-a5b3ad599c4c tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:30.519433 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-75782714-8b14-4a0e-94ca-a5b3ad599c4c tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:30.519930 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.objects.instance [None req-75782714-8b14-4a0e-94ca-a5b3ad599c4c tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lazy-loading 'fault' on Instance uuid fef25575-f211-4db2-8c1f-e1cd8e73e69d {{(pid=124769) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:48:30.566206 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-75782714-8b14-4a0e-94ca-a5b3ad599c4c tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b82b6f568bd41fa9d6b44facb766e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ef3fc15a0147e39228729d2b5b2631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:48:30.574544 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-75782714-8b14-4a0e-94ca-a5b3ad599c4c tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] 10.222.0.84 "GET /compute/v2.1/servers/fef25575-f211-4db2-8c1f-e1cd8e73e69d" status: 200 len: 1230 microversion: 2.1 time: 0.108139 Aug 24 11:48:30.575134 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 669/1296] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:48:30 2022] GET /compute/v2.1/servers/fef25575-f211-4db2-8c1f-e1cd8e73e69d => generated 1230 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:48:31.265835 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-375c00ca-d775-46af-857b-46209d9ff33e tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:48:31.266425 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-375c00ca-d775-46af-857b-46209d9ff33e tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] [instance: 1e63bdcd-3690-4de7-b6a5-f096d20c975f] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:48:31.273403 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-375c00ca-d775-46af-857b-46209d9ff33e tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:31.274040 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-375c00ca-d775-46af-857b-46209d9ff33e tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:31.274543 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-375c00ca-d775-46af-857b-46209d9ff33e tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:31.275237 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-375c00ca-d775-46af-857b-46209d9ff33e tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:31.275683 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-375c00ca-d775-46af-857b-46209d9ff33e tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:31.276098 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-375c00ca-d775-46af-857b-46209d9ff33e tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:31.305346 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-375c00ca-d775-46af-857b-46209d9ff33e tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] [instance: 1e63bdcd-3690-4de7-b6a5-f096d20c975f] Going to try to terminate instance {{(pid=124770) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 11:48:31.333107 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:48:31.599415 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-2f75d25d-700b-465f-8790-280d40044e44 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:48:31.600028 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-2f75d25d-700b-465f-8790-280d40044e44 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] [instance: fef25575-f211-4db2-8c1f-e1cd8e73e69d] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:48:31.606653 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-2f75d25d-700b-465f-8790-280d40044e44 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:31.607134 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-2f75d25d-700b-465f-8790-280d40044e44 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:31.608358 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-2f75d25d-700b-465f-8790-280d40044e44 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:31.609083 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-2f75d25d-700b-465f-8790-280d40044e44 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:31.609564 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-2f75d25d-700b-465f-8790-280d40044e44 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:31.609961 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-2f75d25d-700b-465f-8790-280d40044e44 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:31.623760 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.wsgi [None req-2f75d25d-700b-465f-8790-280d40044e44 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] HTTP exception thrown: Instance fef25575-f211-4db2-8c1f-e1cd8e73e69d could not be found. Aug 24 11:48:31.625543 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-2f75d25d-700b-465f-8790-280d40044e44 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Request method failure captured: Aug 24 11:48:31.625543 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: request: GET /compute/v2.1/servers/fef25575-f211-4db2-8c1f-e1cd8e73e69d HTTP/1.1 Aug 24 11:48:31.625543 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Accept: application/json Aug 24 11:48:31.625543 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Accept-Encoding: identity Aug 24 11:48:31.625543 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Connection: close Aug 24 11:48:31.625543 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Content-Length: 0 Aug 24 11:48:31.625543 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Content-Type: application/json Aug 24 11:48:31.625543 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Host: 10.222.0.84 Aug 24 11:48:31.625543 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Openstack-System-Scope: None Aug 24 11:48:31.625543 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: User-Agent: python-urllib3/1.26.11 Aug 24 11:48:31.625543 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Auth-Token: gAAAAABjBg1BVDXXSs0s1p7mJJhsA-_dbfynZ8c-TDDDTvCbvPZxi5WW99T-jVhomvZ5jKdpwnQP32urIDCvYy1U3dTqN0EZ6FBpM94YOAVlxo_9OG_S8JWmQ7mh1AiLbYSVWkQ0NSDd8h_h8ondHXl5Z-LLBPbAzV0MxHq-RgCt4nVlgHKNvLw Aug 24 11:48:31.625543 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Domain-Id: None Aug 24 11:48:31.625543 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Domain-Name: None Aug 24 11:48:31.625543 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Identity-Status: Confirmed Aug 24 11:48:31.625543 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Is-Admin-Project: True Aug 24 11:48:31.625543 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Project-Domain-Id: default Aug 24 11:48:31.625543 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Project-Domain-Name: Default Aug 24 11:48:31.625543 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Project-Id: c4ef3fc15a0147e39228729d2b5b2631 Aug 24 11:48:31.625543 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Project-Name: tempest-TestVolumeBootPattern-334422239 Aug 24 11:48:31.625543 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Role: reader,member Aug 24 11:48:31.625543 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Roles: reader,member Aug 24 11:48:31.627577 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/volume/v3/c4ef3fc15a0147e39228729d2b5b2631"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/volume/v3/c4ef3fc15a0147e39228729d2b5b2631"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/compute/v2/c4ef3fc15a0147e39228729d2b5b2631"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84:8080/v1/AUTH_c4ef3fc15a0147e39228729d2b5b2631", "adminURL": "http://10.222.0.84:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/placement"}]}] Aug 24 11:48:31.627577 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Tenant: tempest-TestVolumeBootPattern-334422239 Aug 24 11:48:31.627577 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Tenant-Id: c4ef3fc15a0147e39228729d2b5b2631 Aug 24 11:48:31.627577 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Tenant-Name: tempest-TestVolumeBootPattern-334422239 Aug 24 11:48:31.627577 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-User: tempest-TestVolumeBootPattern-334422239-project Aug 24 11:48:31.627577 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-User-Domain-Id: default Aug 24 11:48:31.627577 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-User-Domain-Name: Default Aug 24 11:48:31.627577 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-User-Id: 0b82b6f568bd41fa9d6b44facb766e0b Aug 24 11:48:31.627577 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-User-Name: tempest-TestVolumeBootPattern-334422239-project Aug 24 11:48:31.627577 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: method: > Aug 24 11:48:31.627577 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: exception: Instance fef25575-f211-4db2-8c1f-e1cd8e73e69d could not be found. Aug 24 11:48:31.627577 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: action_args: {'id': 'fef25575-f211-4db2-8c1f-e1cd8e73e69d'} Aug 24 11:48:31.628516 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:48:31.628516 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:48:31.628516 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:48:31.628516 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:48:31.628516 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:48:31.628516 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:48:31.628516 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:48:31.628516 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:48:31.628516 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:48:31.628516 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:48:31.628516 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fef25575-f211-4db2-8c1f-e1cd8e73e69d could not be found. Aug 24 11:48:31.628516 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Aug 24 11:48:31.628516 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:48:31.628516 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Aug 24 11:48:31.628516 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:48:31.628516 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:48:31.628516 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:48:31.628516 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:48:31.628516 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:48:31.628516 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:48:31.630177 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:48:31.630177 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:48:31.630177 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:48:31.630177 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:48:31.630177 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:48:31.630177 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:48:31.630177 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:48:31.630177 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fef25575-f211-4db2-8c1f-e1cd8e73e69d could not be found. Aug 24 11:48:31.630177 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Aug 24 11:48:31.630177 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:48:31.630177 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Aug 24 11:48:31.630177 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:48:31.630177 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:48:31.630177 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:48:31.630177 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:48:31.630177 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:48:31.630177 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fef25575-f211-4db2-8c1f-e1cd8e73e69d could not be found. Aug 24 11:48:31.630177 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Aug 24 11:48:31.631719 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-2f75d25d-700b-465f-8790-280d40044e44 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Returning 404 to user: Instance fef25575-f211-4db2-8c1f-e1cd8e73e69d could not be found. {{(pid=124769) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:48:31.631814 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-375c00ca-d775-46af-857b-46209d9ff33e tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] 10.222.0.84 "DELETE /compute/v2.1/servers/1e63bdcd-3690-4de7-b6a5-f096d20c975f" status: 204 len: 0 microversion: 2.1 time: 0.367926 Aug 24 11:48:31.631814 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 628/1297] 10.222.0.84 () {58 vars in 1239 bytes} [Wed Aug 24 11:48:31 2022] DELETE /compute/v2.1/servers/1e63bdcd-3690-4de7-b6a5-f096d20c975f => generated 0 bytes in 369 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 11:48:31.632068 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-2f75d25d-700b-465f-8790-280d40044e44 tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] 10.222.0.84 "GET /compute/v2.1/servers/fef25575-f211-4db2-8c1f-e1cd8e73e69d" status: 404 len: 111 microversion: 2.1 time: 0.031327 Aug 24 11:48:31.632372 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 670/1298] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:48:31 2022] GET /compute/v2.1/servers/fef25575-f211-4db2-8c1f-e1cd8e73e69d => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 11:48:31.641345 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-4adc0ca6-bac1-4da7-a785-7e422f55bed5 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:48:31.642381 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-4adc0ca6-bac1-4da7-a785-7e422f55bed5 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] [instance: 1e63bdcd-3690-4de7-b6a5-f096d20c975f] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:48:31.677449 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4adc0ca6-bac1-4da7-a785-7e422f55bed5 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:31.678087 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4adc0ca6-bac1-4da7-a785-7e422f55bed5 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:31.678726 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4adc0ca6-bac1-4da7-a785-7e422f55bed5 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:31.679424 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4adc0ca6-bac1-4da7-a785-7e422f55bed5 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:31.680147 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4adc0ca6-bac1-4da7-a785-7e422f55bed5 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:31.680646 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4adc0ca6-bac1-4da7-a785-7e422f55bed5 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:31.936566 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-4adc0ca6-bac1-4da7-a785-7e422f55bed5 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3afc9f4d5bc3473c837926583d334d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d19d73eda154313be8539147f42ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:48:31.948272 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-4adc0ca6-bac1-4da7-a785-7e422f55bed5 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] 10.222.0.84 "GET /compute/v2.1/servers/1e63bdcd-3690-4de7-b6a5-f096d20c975f" status: 200 len: 1503 microversion: 2.1 time: 0.312046 Aug 24 11:48:31.949534 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 629/1299] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:48:31 2022] GET /compute/v2.1/servers/1e63bdcd-3690-4de7-b6a5-f096d20c975f => generated 1503 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:48:32.570419 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-80ecc3b7-c073-47b5-a0c8-b37a049387cb tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:48:32.570932 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-80ecc3b7-c073-47b5-a0c8-b37a049387cb tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] [instance: be34b51d-aa45-4540-959d-a0f61d775992] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:48:32.578962 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-80ecc3b7-c073-47b5-a0c8-b37a049387cb tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:32.578962 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-80ecc3b7-c073-47b5-a0c8-b37a049387cb tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:32.578962 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-80ecc3b7-c073-47b5-a0c8-b37a049387cb tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:32.579677 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-80ecc3b7-c073-47b5-a0c8-b37a049387cb tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:32.580197 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-80ecc3b7-c073-47b5-a0c8-b37a049387cb tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:32.580547 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-80ecc3b7-c073-47b5-a0c8-b37a049387cb tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:32.596551 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.wsgi [None req-80ecc3b7-c073-47b5-a0c8-b37a049387cb tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] HTTP exception thrown: Instance be34b51d-aa45-4540-959d-a0f61d775992 could not be found. Aug 24 11:48:32.598944 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-80ecc3b7-c073-47b5-a0c8-b37a049387cb tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Request method failure captured: Aug 24 11:48:32.598944 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: request: DELETE /compute/v2.1/servers/be34b51d-aa45-4540-959d-a0f61d775992 HTTP/1.1 Aug 24 11:48:32.598944 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Accept: application/json Aug 24 11:48:32.598944 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Accept-Encoding: identity Aug 24 11:48:32.598944 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Connection: close Aug 24 11:48:32.598944 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Content-Length: 0 Aug 24 11:48:32.598944 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Content-Type: application/json Aug 24 11:48:32.598944 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Host: 10.222.0.84 Aug 24 11:48:32.598944 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Openstack-System-Scope: None Aug 24 11:48:32.598944 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: User-Agent: python-urllib3/1.26.11 Aug 24 11:48:32.598944 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Auth-Token: gAAAAABjBg1BVDXXSs0s1p7mJJhsA-_dbfynZ8c-TDDDTvCbvPZxi5WW99T-jVhomvZ5jKdpwnQP32urIDCvYy1U3dTqN0EZ6FBpM94YOAVlxo_9OG_S8JWmQ7mh1AiLbYSVWkQ0NSDd8h_h8ondHXl5Z-LLBPbAzV0MxHq-RgCt4nVlgHKNvLw Aug 24 11:48:32.598944 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Domain-Id: None Aug 24 11:48:32.598944 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Domain-Name: None Aug 24 11:48:32.598944 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Identity-Status: Confirmed Aug 24 11:48:32.598944 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Is-Admin-Project: True Aug 24 11:48:32.598944 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Project-Domain-Id: default Aug 24 11:48:32.598944 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Project-Domain-Name: Default Aug 24 11:48:32.598944 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Project-Id: c4ef3fc15a0147e39228729d2b5b2631 Aug 24 11:48:32.598944 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Project-Name: tempest-TestVolumeBootPattern-334422239 Aug 24 11:48:32.598944 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Role: reader,member Aug 24 11:48:32.598944 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Roles: reader,member Aug 24 11:48:32.602810 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/volume/v3/c4ef3fc15a0147e39228729d2b5b2631"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/volume/v3/c4ef3fc15a0147e39228729d2b5b2631"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/compute/v2/c4ef3fc15a0147e39228729d2b5b2631"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84:8080/v1/AUTH_c4ef3fc15a0147e39228729d2b5b2631", "adminURL": "http://10.222.0.84:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/placement"}]}] Aug 24 11:48:32.602810 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Tenant: tempest-TestVolumeBootPattern-334422239 Aug 24 11:48:32.602810 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Tenant-Id: c4ef3fc15a0147e39228729d2b5b2631 Aug 24 11:48:32.602810 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Tenant-Name: tempest-TestVolumeBootPattern-334422239 Aug 24 11:48:32.602810 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-User: tempest-TestVolumeBootPattern-334422239-project Aug 24 11:48:32.602810 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-User-Domain-Id: default Aug 24 11:48:32.602810 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-User-Domain-Name: Default Aug 24 11:48:32.602810 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-User-Id: 0b82b6f568bd41fa9d6b44facb766e0b Aug 24 11:48:32.602810 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-User-Name: tempest-TestVolumeBootPattern-334422239-project Aug 24 11:48:32.602810 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: method: > Aug 24 11:48:32.602810 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: exception: Instance be34b51d-aa45-4540-959d-a0f61d775992 could not be found. Aug 24 11:48:32.602810 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: action_args: {'id': 'be34b51d-aa45-4540-959d-a0f61d775992'} Aug 24 11:48:32.604339 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:48:32.604339 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:48:32.604339 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:48:32.604339 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:48:32.604339 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:48:32.604339 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:48:32.604339 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:48:32.604339 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:48:32.604339 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:48:32.604339 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:48:32.604339 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be34b51d-aa45-4540-959d-a0f61d775992 could not be found. Aug 24 11:48:32.604339 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Aug 24 11:48:32.604339 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:48:32.604339 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Aug 24 11:48:32.604339 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:48:32.604339 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:48:32.604339 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:48:32.604339 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:48:32.604339 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:48:32.604339 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:48:32.606119 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:48:32.606119 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 11:48:32.606119 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 11:48:32.606119 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 11:48:32.606119 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 11:48:32.606119 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:48:32.606119 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:48:32.606119 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:48:32.606119 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:48:32.606119 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be34b51d-aa45-4540-959d-a0f61d775992 could not be found. Aug 24 11:48:32.606119 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Aug 24 11:48:32.606119 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:48:32.606119 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Aug 24 11:48:32.606119 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:48:32.606119 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:48:32.606119 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:48:32.606119 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:48:32.606119 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:48:32.606119 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be34b51d-aa45-4540-959d-a0f61d775992 could not be found. Aug 24 11:48:32.606119 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Aug 24 11:48:32.607893 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-80ecc3b7-c073-47b5-a0c8-b37a049387cb tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Returning 404 to user: Instance be34b51d-aa45-4540-959d-a0f61d775992 could not be found. {{(pid=124769) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:48:32.607893 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-80ecc3b7-c073-47b5-a0c8-b37a049387cb tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] 10.222.0.84 "DELETE /compute/v2.1/servers/be34b51d-aa45-4540-959d-a0f61d775992" status: 404 len: 111 microversion: 2.1 time: 0.036526 Aug 24 11:48:32.607893 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 671/1300] 10.222.0.84 () {58 vars in 1239 bytes} [Wed Aug 24 11:48:32 2022] DELETE /compute/v2.1/servers/be34b51d-aa45-4540-959d-a0f61d775992 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:48:32.611174 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-fc681f25-9e48-49c8-aad8-01abf4a58a6b tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:48:32.611794 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-fc681f25-9e48-49c8-aad8-01abf4a58a6b tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] [instance: be34b51d-aa45-4540-959d-a0f61d775992] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:48:32.619430 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-fc681f25-9e48-49c8-aad8-01abf4a58a6b tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:32.619937 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-fc681f25-9e48-49c8-aad8-01abf4a58a6b tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:32.620382 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-fc681f25-9e48-49c8-aad8-01abf4a58a6b tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:32.621128 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-fc681f25-9e48-49c8-aad8-01abf4a58a6b tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:32.621799 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-fc681f25-9e48-49c8-aad8-01abf4a58a6b tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:32.622232 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-fc681f25-9e48-49c8-aad8-01abf4a58a6b tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:32.640631 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.wsgi [None req-fc681f25-9e48-49c8-aad8-01abf4a58a6b tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] HTTP exception thrown: Instance be34b51d-aa45-4540-959d-a0f61d775992 could not be found. Aug 24 11:48:32.642384 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-fc681f25-9e48-49c8-aad8-01abf4a58a6b tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Request method failure captured: Aug 24 11:48:32.642384 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: request: GET /compute/v2.1/servers/be34b51d-aa45-4540-959d-a0f61d775992 HTTP/1.1 Aug 24 11:48:32.642384 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Accept: application/json Aug 24 11:48:32.642384 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Accept-Encoding: identity Aug 24 11:48:32.642384 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Connection: close Aug 24 11:48:32.642384 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Content-Length: 0 Aug 24 11:48:32.642384 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Content-Type: application/json Aug 24 11:48:32.642384 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Host: 10.222.0.84 Aug 24 11:48:32.642384 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Openstack-System-Scope: None Aug 24 11:48:32.642384 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: User-Agent: python-urllib3/1.26.11 Aug 24 11:48:32.642384 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Auth-Token: gAAAAABjBg1BVDXXSs0s1p7mJJhsA-_dbfynZ8c-TDDDTvCbvPZxi5WW99T-jVhomvZ5jKdpwnQP32urIDCvYy1U3dTqN0EZ6FBpM94YOAVlxo_9OG_S8JWmQ7mh1AiLbYSVWkQ0NSDd8h_h8ondHXl5Z-LLBPbAzV0MxHq-RgCt4nVlgHKNvLw Aug 24 11:48:32.642384 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Domain-Id: None Aug 24 11:48:32.642384 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Domain-Name: None Aug 24 11:48:32.642384 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Identity-Status: Confirmed Aug 24 11:48:32.642384 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Is-Admin-Project: True Aug 24 11:48:32.642384 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Project-Domain-Id: default Aug 24 11:48:32.642384 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Project-Domain-Name: Default Aug 24 11:48:32.642384 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Project-Id: c4ef3fc15a0147e39228729d2b5b2631 Aug 24 11:48:32.642384 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Project-Name: tempest-TestVolumeBootPattern-334422239 Aug 24 11:48:32.642384 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Role: reader,member Aug 24 11:48:32.642384 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Roles: reader,member Aug 24 11:48:32.645363 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/volume/v3/c4ef3fc15a0147e39228729d2b5b2631"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/volume/v3/c4ef3fc15a0147e39228729d2b5b2631"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/compute/v2/c4ef3fc15a0147e39228729d2b5b2631"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84:8080/v1/AUTH_c4ef3fc15a0147e39228729d2b5b2631", "adminURL": "http://10.222.0.84:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/placement"}]}] Aug 24 11:48:32.645363 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Tenant: tempest-TestVolumeBootPattern-334422239 Aug 24 11:48:32.645363 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Tenant-Id: c4ef3fc15a0147e39228729d2b5b2631 Aug 24 11:48:32.645363 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Tenant-Name: tempest-TestVolumeBootPattern-334422239 Aug 24 11:48:32.645363 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User: tempest-TestVolumeBootPattern-334422239-project Aug 24 11:48:32.645363 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User-Domain-Id: default Aug 24 11:48:32.645363 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User-Domain-Name: Default Aug 24 11:48:32.645363 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User-Id: 0b82b6f568bd41fa9d6b44facb766e0b Aug 24 11:48:32.645363 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User-Name: tempest-TestVolumeBootPattern-334422239-project Aug 24 11:48:32.645363 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: method: > Aug 24 11:48:32.645363 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: exception: Instance be34b51d-aa45-4540-959d-a0f61d775992 could not be found. Aug 24 11:48:32.645363 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: action_args: {'id': 'be34b51d-aa45-4540-959d-a0f61d775992'} Aug 24 11:48:32.646841 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:48:32.646841 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:48:32.646841 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:48:32.646841 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:48:32.646841 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:48:32.646841 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:48:32.646841 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:48:32.646841 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:48:32.646841 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:48:32.646841 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:48:32.646841 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be34b51d-aa45-4540-959d-a0f61d775992 could not be found. Aug 24 11:48:32.646841 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:48:32.646841 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:48:32.646841 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:48:32.646841 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:48:32.646841 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:48:32.646841 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:48:32.646841 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:48:32.646841 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:48:32.646841 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:48:32.648354 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:48:32.648354 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:48:32.648354 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:48:32.648354 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:48:32.648354 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:48:32.648354 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:48:32.648354 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:48:32.648354 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be34b51d-aa45-4540-959d-a0f61d775992 could not be found. Aug 24 11:48:32.648354 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:48:32.648354 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:48:32.648354 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:48:32.648354 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:48:32.648354 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:48:32.648354 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:48:32.648354 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:48:32.648354 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:48:32.648354 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be34b51d-aa45-4540-959d-a0f61d775992 could not be found. Aug 24 11:48:32.648354 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:48:32.649837 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-fc681f25-9e48-49c8-aad8-01abf4a58a6b tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Returning 404 to user: Instance be34b51d-aa45-4540-959d-a0f61d775992 could not be found. {{(pid=124770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:48:32.649837 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-fc681f25-9e48-49c8-aad8-01abf4a58a6b tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] 10.222.0.84 "GET /compute/v2.1/servers/be34b51d-aa45-4540-959d-a0f61d775992" status: 404 len: 111 microversion: 2.1 time: 0.037321 Aug 24 11:48:32.649837 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 630/1301] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:48:32 2022] GET /compute/v2.1/servers/be34b51d-aa45-4540-959d-a0f61d775992 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:48:32.973162 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-b67bbc87-2ce2-42b3-abf7-9cad714d9d31 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:48:32.973162 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-b67bbc87-2ce2-42b3-abf7-9cad714d9d31 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] [instance: 1e63bdcd-3690-4de7-b6a5-f096d20c975f] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:48:32.980156 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-b67bbc87-2ce2-42b3-abf7-9cad714d9d31 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:32.980651 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-b67bbc87-2ce2-42b3-abf7-9cad714d9d31 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:32.981121 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-b67bbc87-2ce2-42b3-abf7-9cad714d9d31 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:32.981829 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-b67bbc87-2ce2-42b3-abf7-9cad714d9d31 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:32.982281 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-b67bbc87-2ce2-42b3-abf7-9cad714d9d31 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:32.983407 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-b67bbc87-2ce2-42b3-abf7-9cad714d9d31 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:33.144781 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-b67bbc87-2ce2-42b3-abf7-9cad714d9d31 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3afc9f4d5bc3473c837926583d334d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d19d73eda154313be8539147f42ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:48:33.155246 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-b67bbc87-2ce2-42b3-abf7-9cad714d9d31 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] 10.222.0.84 "GET /compute/v2.1/servers/1e63bdcd-3690-4de7-b6a5-f096d20c975f" status: 200 len: 1503 microversion: 2.1 time: 0.186490 Aug 24 11:48:33.161080 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 672/1302] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:48:32 2022] GET /compute/v2.1/servers/1e63bdcd-3690-4de7-b6a5-f096d20c975f => generated 1503 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:48:34.181689 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-093e6abf-9c28-4f94-a191-55fde0dcf108 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:48:34.182917 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [req-6303e2f4-6546-4c9d-a698-ff53b52e51d5 req-d8b088cd-812f-4f63-8e01-e359842a25f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e63bdcd-3690-4de7-b6a5-f096d20c975f", "name": "network-vif-deleted", "tag": "f0efb3fa-d392-4e21-8896-15afb6251248"}]} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:48:34.185559 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-093e6abf-9c28-4f94-a191-55fde0dcf108 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] [instance: 1e63bdcd-3690-4de7-b6a5-f096d20c975f] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:48:34.197141 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-093e6abf-9c28-4f94-a191-55fde0dcf108 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:34.197818 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-093e6abf-9c28-4f94-a191-55fde0dcf108 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:34.198261 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-093e6abf-9c28-4f94-a191-55fde0dcf108 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:34.198964 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-093e6abf-9c28-4f94-a191-55fde0dcf108 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:34.199417 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-093e6abf-9c28-4f94-a191-55fde0dcf108 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:34.200045 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-093e6abf-9c28-4f94-a191-55fde0dcf108 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:34.201759 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-6303e2f4-6546-4c9d-a698-ff53b52e51d5 req-d8b088cd-812f-4f63-8e01-e359842a25f0 service nova] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:34.202174 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-6303e2f4-6546-4c9d-a698-ff53b52e51d5 req-d8b088cd-812f-4f63-8e01-e359842a25f0 service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:34.203326 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-6303e2f4-6546-4c9d-a698-ff53b52e51d5 req-d8b088cd-812f-4f63-8e01-e359842a25f0 service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:34.217786 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.compute.server_external_events [req-6303e2f4-6546-4c9d-a698-ff53b52e51d5 req-d8b088cd-812f-4f63-8e01-e359842a25f0 service nova] Creating event network-vif-deleted:f0efb3fa-d392-4e21-8896-15afb6251248 for instance 1e63bdcd-3690-4de7-b6a5-f096d20c975f on hv-cinder-85427 Aug 24 11:48:34.223265 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [req-6303e2f4-6546-4c9d-a698-ff53b52e51d5 req-d8b088cd-812f-4f63-8e01-e359842a25f0 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049752 Aug 24 11:48:34.224068 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 631/1303] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Aug 24 11:48:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:48:34.268616 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-093e6abf-9c28-4f94-a191-55fde0dcf108 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3afc9f4d5bc3473c837926583d334d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d19d73eda154313be8539147f42ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:48:34.276874 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-093e6abf-9c28-4f94-a191-55fde0dcf108 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] 10.222.0.84 "GET /compute/v2.1/servers/1e63bdcd-3690-4de7-b6a5-f096d20c975f" status: 200 len: 1461 microversion: 2.1 time: 0.098821 Aug 24 11:48:34.277737 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 673/1304] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:48:34 2022] GET /compute/v2.1/servers/1e63bdcd-3690-4de7-b6a5-f096d20c975f => generated 1461 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:48:34.333279 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-941d1bbe-7ffe-4209-8638-32c43cdb3fbe tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] Calling method '.version_select at 0x7f0e2a557b80>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:48:34.464674 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-941d1bbe-7ffe-4209-8638-32c43cdb3fbe tempest-TestVolumeBootPattern-334422239 tempest-TestVolumeBootPattern-334422239-project] 10.222.0.84 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1852951757" status: 202 len: 0 microversion: 2.1 time: 0.135977 Aug 24 11:48:34.465442 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 632/1305] 10.222.0.84 () {58 vars in 1263 bytes} [Wed Aug 24 11:48:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1852951757 => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:48:35.303686 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-2077db2f-5af4-4472-bd7d-3a70b32a47be tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:48:35.304360 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-2077db2f-5af4-4472-bd7d-3a70b32a47be tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] [instance: 1e63bdcd-3690-4de7-b6a5-f096d20c975f] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:48:35.312983 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-2077db2f-5af4-4472-bd7d-3a70b32a47be tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:35.313485 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-2077db2f-5af4-4472-bd7d-3a70b32a47be tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:35.313927 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-2077db2f-5af4-4472-bd7d-3a70b32a47be tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:35.314635 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-2077db2f-5af4-4472-bd7d-3a70b32a47be tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:35.315202 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-2077db2f-5af4-4472-bd7d-3a70b32a47be tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:35.315631 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-2077db2f-5af4-4472-bd7d-3a70b32a47be tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:35.331602 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.wsgi [None req-2077db2f-5af4-4472-bd7d-3a70b32a47be tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] HTTP exception thrown: Instance 1e63bdcd-3690-4de7-b6a5-f096d20c975f could not be found. Aug 24 11:48:35.333332 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-2077db2f-5af4-4472-bd7d-3a70b32a47be tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Request method failure captured: Aug 24 11:48:35.333332 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: request: GET /compute/v2.1/servers/1e63bdcd-3690-4de7-b6a5-f096d20c975f HTTP/1.1 Aug 24 11:48:35.333332 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Accept: application/json Aug 24 11:48:35.333332 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Accept-Encoding: identity Aug 24 11:48:35.333332 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Connection: close Aug 24 11:48:35.333332 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Content-Length: 0 Aug 24 11:48:35.333332 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Content-Type: application/json Aug 24 11:48:35.333332 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Host: 10.222.0.84 Aug 24 11:48:35.333332 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Openstack-System-Scope: None Aug 24 11:48:35.333332 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: User-Agent: python-urllib3/1.26.11 Aug 24 11:48:35.333332 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Auth-Token: gAAAAABjBg_hIcKxq5EpE-EbVNOmeXgvjAOSJAbdqsX05iwx4DLQ0gqAvDMuwCLMJNiGhcGv-an0orimOFmdk3qHdrVep4M6nUcHW8pJCF5Yy16Dn5w6GaZ15hukQWkNkfQ-Q-oYhatsLDiAnYOS09TB95gUClEJf7dNEN1-QF7bAwdiRXFIAu4 Aug 24 11:48:35.333332 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Domain-Id: None Aug 24 11:48:35.333332 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Domain-Name: None Aug 24 11:48:35.333332 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Identity-Status: Confirmed Aug 24 11:48:35.333332 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Is-Admin-Project: True Aug 24 11:48:35.333332 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Project-Domain-Id: default Aug 24 11:48:35.333332 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Project-Domain-Name: Default Aug 24 11:48:35.333332 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Project-Id: 1d19d73eda154313be8539147f42ec11 Aug 24 11:48:35.333332 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Project-Name: tempest-VolumesActionsTest-1741375855 Aug 24 11:48:35.333332 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Role: reader,member Aug 24 11:48:35.333332 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Roles: reader,member Aug 24 11:48:35.335252 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/volume/v3/1d19d73eda154313be8539147f42ec11"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/volume/v3/1d19d73eda154313be8539147f42ec11"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/compute/v2/1d19d73eda154313be8539147f42ec11"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84:8080/v1/AUTH_1d19d73eda154313be8539147f42ec11", "adminURL": "http://10.222.0.84:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/placement"}]}] Aug 24 11:48:35.335252 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Tenant: tempest-VolumesActionsTest-1741375855 Aug 24 11:48:35.335252 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Tenant-Id: 1d19d73eda154313be8539147f42ec11 Aug 24 11:48:35.335252 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Tenant-Name: tempest-VolumesActionsTest-1741375855 Aug 24 11:48:35.335252 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-User: tempest-VolumesActionsTest-1741375855-project Aug 24 11:48:35.335252 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-User-Domain-Id: default Aug 24 11:48:35.335252 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-User-Domain-Name: Default Aug 24 11:48:35.335252 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-User-Id: 3afc9f4d5bc3473c837926583d334d31 Aug 24 11:48:35.335252 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-User-Name: tempest-VolumesActionsTest-1741375855-project Aug 24 11:48:35.335252 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: method: > Aug 24 11:48:35.335252 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: exception: Instance 1e63bdcd-3690-4de7-b6a5-f096d20c975f could not be found. Aug 24 11:48:35.335252 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: action_args: {'id': '1e63bdcd-3690-4de7-b6a5-f096d20c975f'} Aug 24 11:48:35.336144 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:48:35.336144 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:48:35.336144 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:48:35.336144 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:48:35.336144 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:48:35.336144 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:48:35.336144 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:48:35.336144 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:48:35.336144 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:48:35.336144 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:48:35.336144 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e63bdcd-3690-4de7-b6a5-f096d20c975f could not be found. Aug 24 11:48:35.336144 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Aug 24 11:48:35.336144 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:48:35.336144 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Aug 24 11:48:35.336144 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:48:35.336144 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:48:35.336144 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:48:35.336144 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:48:35.336144 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:48:35.336144 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:48:35.337621 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:48:35.337621 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:48:35.337621 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:48:35.337621 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:48:35.337621 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:48:35.337621 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:48:35.337621 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:48:35.337621 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e63bdcd-3690-4de7-b6a5-f096d20c975f could not be found. Aug 24 11:48:35.337621 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Aug 24 11:48:35.337621 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:48:35.337621 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Aug 24 11:48:35.337621 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:48:35.337621 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:48:35.337621 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:48:35.337621 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:48:35.337621 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:48:35.337621 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e63bdcd-3690-4de7-b6a5-f096d20c975f could not be found. Aug 24 11:48:35.337621 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Aug 24 11:48:35.346541 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-2077db2f-5af4-4472-bd7d-3a70b32a47be tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Returning 404 to user: Instance 1e63bdcd-3690-4de7-b6a5-f096d20c975f could not be found. {{(pid=124769) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:48:35.346541 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-2077db2f-5af4-4472-bd7d-3a70b32a47be tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] 10.222.0.84 "GET /compute/v2.1/servers/1e63bdcd-3690-4de7-b6a5-f096d20c975f" status: 404 len: 111 microversion: 2.1 time: 0.035492 Aug 24 11:48:35.346541 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 674/1306] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:48:35 2022] GET /compute/v2.1/servers/1e63bdcd-3690-4de7-b6a5-f096d20c975f => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:48:35.446504 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-f8882f7f-43bf-4d7e-b7f7-c489496ff282 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1920122328", "imageRef": "028cad80-8f50-4139-b345-dfdca694dc6b", "flavorRef": "452", "networks": [{"uuid": "ab367598-f3ed-4c89-99f6-9fcae362690b"}]}} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:48:35.504443 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.network.neutron [None req-f8882f7f-43bf-4d7e-b7f7-c489496ff282 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] validate_networks() for [('ab367598-f3ed-4c89-99f6-9fcae362690b', None, None, None, None, None)] {{(pid=124770) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 11:48:36.229053 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.virt.hardware [None req-f8882f7f-43bf-4d7e-b7f7-c489496ff282 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Flavor limits 0:0:0 {{(pid=124770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 11:48:36.229509 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.virt.hardware [None req-f8882f7f-43bf-4d7e-b7f7-c489496ff282 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Image limits 0:0:0 {{(pid=124770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 11:48:36.230015 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.virt.hardware [None req-f8882f7f-43bf-4d7e-b7f7-c489496ff282 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Flavor pref 0:0:0 {{(pid=124770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 11:48:36.230428 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.virt.hardware [None req-f8882f7f-43bf-4d7e-b7f7-c489496ff282 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Image pref 0:0:0 {{(pid=124770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 11:48:36.231113 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.virt.hardware [None req-f8882f7f-43bf-4d7e-b7f7-c489496ff282 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 11:48:36.246557 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-f8882f7f-43bf-4d7e-b7f7-c489496ff282 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:36.246557 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-f8882f7f-43bf-4d7e-b7f7-c489496ff282 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:36.246833 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-f8882f7f-43bf-4d7e-b7f7-c489496ff282 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:36.247551 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-f8882f7f-43bf-4d7e-b7f7-c489496ff282 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:36.248734 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-f8882f7f-43bf-4d7e-b7f7-c489496ff282 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:36.249870 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-f8882f7f-43bf-4d7e-b7f7-c489496ff282 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:36.270216 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.quota [None req-f8882f7f-43bf-4d7e-b7f7-c489496ff282 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Getting quotas for project 1d19d73eda154313be8539147f42ec11. Resources: {'ram', 'cores', 'instances'} {{(pid=124770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:48:36.275446 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.quota [None req-f8882f7f-43bf-4d7e-b7f7-c489496ff282 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Getting quotas for user 3afc9f4d5bc3473c837926583d334d31 and project 1d19d73eda154313be8539147f42ec11. Resources: {'ram', 'cores', 'instances'} {{(pid=124770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:48:36.288835 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-f8882f7f-43bf-4d7e-b7f7-c489496ff282 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Going to run 1 instances... {{(pid=124770) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 11:48:36.291929 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-f8882f7f-43bf-4d7e-b7f7-c489496ff282 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] [instance: 6a2fc30d-9d51-45ec-aab2-bedec62daf38] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='028cad80-8f50-4139-b345-dfdca694dc6b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124770) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 11:48:36.523267 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-f8882f7f-43bf-4d7e-b7f7-c489496ff282 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] 10.222.0.84 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.081084 Aug 24 11:48:36.531962 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 633/1307] 10.222.0.84 () {60 vars in 1147 bytes} [Wed Aug 24 11:48:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 1085 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 11:48:36.538637 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-19d03b78-5029-471f-8265-4868e471e69d tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:48:36.539311 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-19d03b78-5029-471f-8265-4868e471e69d tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] [instance: 6a2fc30d-9d51-45ec-aab2-bedec62daf38] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:48:36.611712 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-19d03b78-5029-471f-8265-4868e471e69d tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3afc9f4d5bc3473c837926583d334d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d19d73eda154313be8539147f42ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:48:36.622499 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-19d03b78-5029-471f-8265-4868e471e69d tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] 10.222.0.84 "GET /compute/v2.1/servers/6a2fc30d-9d51-45ec-aab2-bedec62daf38" status: 200 len: 1214 microversion: 2.1 time: 0.086921 Aug 24 11:48:36.636300 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 675/1308] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:48:36 2022] GET /compute/v2.1/servers/6a2fc30d-9d51-45ec-aab2-bedec62daf38 => generated 1214 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:48:37.643478 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-03c55636-8ba6-4aff-acff-6e4a3792ef30 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:48:37.650774 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-03c55636-8ba6-4aff-acff-6e4a3792ef30 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] [instance: 6a2fc30d-9d51-45ec-aab2-bedec62daf38] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:48:37.666668 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-03c55636-8ba6-4aff-acff-6e4a3792ef30 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:37.667280 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-03c55636-8ba6-4aff-acff-6e4a3792ef30 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:37.667822 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-03c55636-8ba6-4aff-acff-6e4a3792ef30 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:37.669334 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-03c55636-8ba6-4aff-acff-6e4a3792ef30 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:37.671013 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-03c55636-8ba6-4aff-acff-6e4a3792ef30 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:37.671524 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-03c55636-8ba6-4aff-acff-6e4a3792ef30 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:37.776402 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-03c55636-8ba6-4aff-acff-6e4a3792ef30 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3afc9f4d5bc3473c837926583d334d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d19d73eda154313be8539147f42ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:48:37.792333 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-03c55636-8ba6-4aff-acff-6e4a3792ef30 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] 10.222.0.84 "GET /compute/v2.1/servers/6a2fc30d-9d51-45ec-aab2-bedec62daf38" status: 200 len: 1218 microversion: 2.1 time: 0.152548 Aug 24 11:48:37.805942 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 634/1309] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:48:37 2022] GET /compute/v2.1/servers/6a2fc30d-9d51-45ec-aab2-bedec62daf38 => generated 1218 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:48:38.815715 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-0c4c7ce9-34c3-4d2e-b2c1-6b805e093220 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:48:38.817813 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-0c4c7ce9-34c3-4d2e-b2c1-6b805e093220 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] [instance: 6a2fc30d-9d51-45ec-aab2-bedec62daf38] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:48:38.833206 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-0c4c7ce9-34c3-4d2e-b2c1-6b805e093220 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:38.835891 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-0c4c7ce9-34c3-4d2e-b2c1-6b805e093220 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:38.839449 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-0c4c7ce9-34c3-4d2e-b2c1-6b805e093220 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:38.840647 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-0c4c7ce9-34c3-4d2e-b2c1-6b805e093220 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:38.846618 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-0c4c7ce9-34c3-4d2e-b2c1-6b805e093220 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:38.846618 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-0c4c7ce9-34c3-4d2e-b2c1-6b805e093220 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:38.935194 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-0c4c7ce9-34c3-4d2e-b2c1-6b805e093220 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3afc9f4d5bc3473c837926583d334d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d19d73eda154313be8539147f42ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:48:38.946086 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-0c4c7ce9-34c3-4d2e-b2c1-6b805e093220 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] 10.222.0.84 "GET /compute/v2.1/servers/6a2fc30d-9d51-45ec-aab2-bedec62daf38" status: 200 len: 1218 microversion: 2.1 time: 0.134748 Aug 24 11:48:38.950368 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 676/1310] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:48:38 2022] GET /compute/v2.1/servers/6a2fc30d-9d51-45ec-aab2-bedec62daf38 => generated 1218 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:48:39.976823 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-77112533-8485-4f0c-b963-9bbbcf4dc24d tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:48:39.977753 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-77112533-8485-4f0c-b963-9bbbcf4dc24d tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] [instance: 6a2fc30d-9d51-45ec-aab2-bedec62daf38] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:48:39.985276 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-77112533-8485-4f0c-b963-9bbbcf4dc24d tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:39.985951 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-77112533-8485-4f0c-b963-9bbbcf4dc24d tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:39.986419 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-77112533-8485-4f0c-b963-9bbbcf4dc24d tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:39.987184 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-77112533-8485-4f0c-b963-9bbbcf4dc24d tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:39.987875 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-77112533-8485-4f0c-b963-9bbbcf4dc24d tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:39.988472 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-77112533-8485-4f0c-b963-9bbbcf4dc24d tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:40.127091 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-77112533-8485-4f0c-b963-9bbbcf4dc24d tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3afc9f4d5bc3473c837926583d334d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d19d73eda154313be8539147f42ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:48:40.144009 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-77112533-8485-4f0c-b963-9bbbcf4dc24d tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] 10.222.0.84 "GET /compute/v2.1/servers/6a2fc30d-9d51-45ec-aab2-bedec62daf38" status: 200 len: 1210 microversion: 2.1 time: 0.169666 Aug 24 11:48:40.144009 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 635/1311] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:48:39 2022] GET /compute/v2.1/servers/6a2fc30d-9d51-45ec-aab2-bedec62daf38 => generated 1210 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:48:41.165773 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-1d9e0c96-3dc8-418a-84b8-eb6db9fc56e1 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:48:41.166396 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-1d9e0c96-3dc8-418a-84b8-eb6db9fc56e1 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] [instance: 6a2fc30d-9d51-45ec-aab2-bedec62daf38] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:48:41.177538 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-1d9e0c96-3dc8-418a-84b8-eb6db9fc56e1 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:41.179071 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-1d9e0c96-3dc8-418a-84b8-eb6db9fc56e1 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:41.179820 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-1d9e0c96-3dc8-418a-84b8-eb6db9fc56e1 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:41.181063 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-1d9e0c96-3dc8-418a-84b8-eb6db9fc56e1 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:41.181806 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-1d9e0c96-3dc8-418a-84b8-eb6db9fc56e1 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:41.182729 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-1d9e0c96-3dc8-418a-84b8-eb6db9fc56e1 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:41.190325 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG dbcounter [-] [124769] Writing DB stats nova_cell1:SELECT=100 {{(pid=124769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:48:41.261515 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-1d9e0c96-3dc8-418a-84b8-eb6db9fc56e1 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3afc9f4d5bc3473c837926583d334d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d19d73eda154313be8539147f42ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:48:41.288871 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-1d9e0c96-3dc8-418a-84b8-eb6db9fc56e1 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] 10.222.0.84 "GET /compute/v2.1/servers/6a2fc30d-9d51-45ec-aab2-bedec62daf38" status: 200 len: 1284 microversion: 2.1 time: 0.120270 Aug 24 11:48:41.288871 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 677/1312] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:48:41 2022] GET /compute/v2.1/servers/6a2fc30d-9d51-45ec-aab2-bedec62daf38 => generated 1284 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:48:42.316066 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-c457632c-20b6-4514-be33-d7da498fe461 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:48:42.322839 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-c457632c-20b6-4514-be33-d7da498fe461 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] [instance: 6a2fc30d-9d51-45ec-aab2-bedec62daf38] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:48:42.343028 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c457632c-20b6-4514-be33-d7da498fe461 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:42.344231 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c457632c-20b6-4514-be33-d7da498fe461 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:42.345362 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c457632c-20b6-4514-be33-d7da498fe461 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:42.346301 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c457632c-20b6-4514-be33-d7da498fe461 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:42.347670 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c457632c-20b6-4514-be33-d7da498fe461 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:42.348383 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c457632c-20b6-4514-be33-d7da498fe461 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:42.597447 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-c457632c-20b6-4514-be33-d7da498fe461 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3afc9f4d5bc3473c837926583d334d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d19d73eda154313be8539147f42ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:48:42.605512 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-c457632c-20b6-4514-be33-d7da498fe461 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] 10.222.0.84 "GET /compute/v2.1/servers/6a2fc30d-9d51-45ec-aab2-bedec62daf38" status: 200 len: 1314 microversion: 2.1 time: 0.299062 Aug 24 11:48:42.622740 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 636/1313] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:48:42 2022] GET /compute/v2.1/servers/6a2fc30d-9d51-45ec-aab2-bedec62daf38 => generated 1314 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:48:43.132581 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [req-e29f7954-956d-48eb-9261-95cefcbd91ce req-e0ca1bc1-7c34-496c-ab59-099c030c6585 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a2fc30d-9d51-45ec-aab2-bedec62daf38", "tag": "97a2c8ea-edb9-40d7-b4e6-34030019f2e2"}]} {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:48:43.156157 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [req-e29f7954-956d-48eb-9261-95cefcbd91ce req-e0ca1bc1-7c34-496c-ab59-099c030c6585 service nova] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:43.160570 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [req-e29f7954-956d-48eb-9261-95cefcbd91ce req-e0ca1bc1-7c34-496c-ab59-099c030c6585 service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:43.160570 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [req-e29f7954-956d-48eb-9261-95cefcbd91ce req-e0ca1bc1-7c34-496c-ab59-099c030c6585 service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:43.173159 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.compute.server_external_events [req-e29f7954-956d-48eb-9261-95cefcbd91ce req-e0ca1bc1-7c34-496c-ab59-099c030c6585 service nova] Creating event network-changed:97a2c8ea-edb9-40d7-b4e6-34030019f2e2 for instance 6a2fc30d-9d51-45ec-aab2-bedec62daf38 on hv-cinder-85427 Aug 24 11:48:43.184733 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [req-e29f7954-956d-48eb-9261-95cefcbd91ce req-e0ca1bc1-7c34-496c-ab59-099c030c6585 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057961 Aug 24 11:48:43.186440 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 678/1314] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Aug 24 11:48:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:48:43.629175 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-03de7407-68d9-40c2-a286-b2a37b356304 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:48:43.630403 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-03de7407-68d9-40c2-a286-b2a37b356304 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] [instance: 6a2fc30d-9d51-45ec-aab2-bedec62daf38] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:48:43.637358 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-03de7407-68d9-40c2-a286-b2a37b356304 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:43.637966 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-03de7407-68d9-40c2-a286-b2a37b356304 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:43.639002 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-03de7407-68d9-40c2-a286-b2a37b356304 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:43.640117 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-03de7407-68d9-40c2-a286-b2a37b356304 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:43.640651 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-03de7407-68d9-40c2-a286-b2a37b356304 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:43.641171 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-03de7407-68d9-40c2-a286-b2a37b356304 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:43.963213 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-03de7407-68d9-40c2-a286-b2a37b356304 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3afc9f4d5bc3473c837926583d334d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d19d73eda154313be8539147f42ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:48:43.978904 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-03de7407-68d9-40c2-a286-b2a37b356304 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] 10.222.0.84 "GET /compute/v2.1/servers/6a2fc30d-9d51-45ec-aab2-bedec62daf38" status: 200 len: 1314 microversion: 2.1 time: 0.355055 Aug 24 11:48:43.980062 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 637/1315] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:48:43 2022] GET /compute/v2.1/servers/6a2fc30d-9d51-45ec-aab2-bedec62daf38 => generated 1314 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:48:45.006761 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-a313d158-6a27-466b-8af7-9eebb9eee449 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:48:45.008673 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-a313d158-6a27-466b-8af7-9eebb9eee449 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] [instance: 6a2fc30d-9d51-45ec-aab2-bedec62daf38] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:48:45.018948 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-a313d158-6a27-466b-8af7-9eebb9eee449 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:45.019720 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-a313d158-6a27-466b-8af7-9eebb9eee449 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:45.020381 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-a313d158-6a27-466b-8af7-9eebb9eee449 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:45.021720 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-a313d158-6a27-466b-8af7-9eebb9eee449 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:45.023963 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-a313d158-6a27-466b-8af7-9eebb9eee449 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:45.024826 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-a313d158-6a27-466b-8af7-9eebb9eee449 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:45.348206 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-a313d158-6a27-466b-8af7-9eebb9eee449 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3afc9f4d5bc3473c837926583d334d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d19d73eda154313be8539147f42ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:48:45.356191 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-a313d158-6a27-466b-8af7-9eebb9eee449 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] 10.222.0.84 "GET /compute/v2.1/servers/6a2fc30d-9d51-45ec-aab2-bedec62daf38" status: 200 len: 1314 microversion: 2.1 time: 0.356796 Aug 24 11:48:45.356889 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 679/1316] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:48:44 2022] GET /compute/v2.1/servers/6a2fc30d-9d51-45ec-aab2-bedec62daf38 => generated 1314 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:48:46.374642 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_cell0:SELECT=2 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:48:46.375504 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_cell0:SELECT=6 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:48:46.379744 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-e0ab46ec-dbc2-4536-9d01-992abe50843a tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:48:46.380436 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-e0ab46ec-dbc2-4536-9d01-992abe50843a tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] [instance: 6a2fc30d-9d51-45ec-aab2-bedec62daf38] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:48:46.386474 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e0ab46ec-dbc2-4536-9d01-992abe50843a tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:46.386982 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e0ab46ec-dbc2-4536-9d01-992abe50843a tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:46.387606 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e0ab46ec-dbc2-4536-9d01-992abe50843a tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:46.389135 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e0ab46ec-dbc2-4536-9d01-992abe50843a tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:46.389674 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e0ab46ec-dbc2-4536-9d01-992abe50843a tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:46.390107 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e0ab46ec-dbc2-4536-9d01-992abe50843a tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:46.617482 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-e0ab46ec-dbc2-4536-9d01-992abe50843a tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3afc9f4d5bc3473c837926583d334d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d19d73eda154313be8539147f42ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:48:46.632259 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-e0ab46ec-dbc2-4536-9d01-992abe50843a tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] 10.222.0.84 "GET /compute/v2.1/servers/6a2fc30d-9d51-45ec-aab2-bedec62daf38" status: 200 len: 1314 microversion: 2.1 time: 0.259368 Aug 24 11:48:46.633407 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 638/1317] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:48:46 2022] GET /compute/v2.1/servers/6a2fc30d-9d51-45ec-aab2-bedec62daf38 => generated 1314 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:48:47.658883 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-a6db1530-1f26-40f8-be3d-7192331fa2a8 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:48:47.660340 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-a6db1530-1f26-40f8-be3d-7192331fa2a8 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] [instance: 6a2fc30d-9d51-45ec-aab2-bedec62daf38] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:48:47.664251 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG dbcounter [-] [124769] Writing DB stats nova_cell0:SELECT=2 {{(pid=124769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:48:47.676256 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-a6db1530-1f26-40f8-be3d-7192331fa2a8 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:47.679936 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-a6db1530-1f26-40f8-be3d-7192331fa2a8 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:47.680671 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-a6db1530-1f26-40f8-be3d-7192331fa2a8 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:47.681740 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-a6db1530-1f26-40f8-be3d-7192331fa2a8 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:47.683289 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-a6db1530-1f26-40f8-be3d-7192331fa2a8 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:47.683727 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-a6db1530-1f26-40f8-be3d-7192331fa2a8 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:48.250556 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-a6db1530-1f26-40f8-be3d-7192331fa2a8 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3afc9f4d5bc3473c837926583d334d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d19d73eda154313be8539147f42ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:48:48.260151 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-a6db1530-1f26-40f8-be3d-7192331fa2a8 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] 10.222.0.84 "GET /compute/v2.1/servers/6a2fc30d-9d51-45ec-aab2-bedec62daf38" status: 200 len: 1314 microversion: 2.1 time: 0.606226 Aug 24 11:48:48.260651 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 680/1318] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:48:47 2022] GET /compute/v2.1/servers/6a2fc30d-9d51-45ec-aab2-bedec62daf38 => generated 1314 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:48:49.287056 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-1a442777-873e-4968-858f-e4b084aa8335 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:48:49.288357 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-1a442777-873e-4968-858f-e4b084aa8335 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] [instance: 6a2fc30d-9d51-45ec-aab2-bedec62daf38] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:48:49.296277 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1a442777-873e-4968-858f-e4b084aa8335 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:49.296770 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1a442777-873e-4968-858f-e4b084aa8335 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:49.298464 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1a442777-873e-4968-858f-e4b084aa8335 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:49.298464 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1a442777-873e-4968-858f-e4b084aa8335 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:49.298464 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1a442777-873e-4968-858f-e4b084aa8335 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:49.298857 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1a442777-873e-4968-858f-e4b084aa8335 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:49.607784 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-1a442777-873e-4968-858f-e4b084aa8335 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3afc9f4d5bc3473c837926583d334d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d19d73eda154313be8539147f42ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:48:49.620976 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-1a442777-873e-4968-858f-e4b084aa8335 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] 10.222.0.84 "GET /compute/v2.1/servers/6a2fc30d-9d51-45ec-aab2-bedec62daf38" status: 200 len: 1314 microversion: 2.1 time: 0.341344 Aug 24 11:48:49.621590 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 639/1319] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:48:49 2022] GET /compute/v2.1/servers/6a2fc30d-9d51-45ec-aab2-bedec62daf38 => generated 1314 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:48:50.666330 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-5392727b-2d37-4bc6-9a6b-bd34103a6bbb tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:48:50.667017 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-5392727b-2d37-4bc6-9a6b-bd34103a6bbb tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] [instance: 6a2fc30d-9d51-45ec-aab2-bedec62daf38] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:48:50.678049 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-5392727b-2d37-4bc6-9a6b-bd34103a6bbb tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:50.678646 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-5392727b-2d37-4bc6-9a6b-bd34103a6bbb tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:50.679100 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-5392727b-2d37-4bc6-9a6b-bd34103a6bbb tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:50.680406 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-5392727b-2d37-4bc6-9a6b-bd34103a6bbb tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:50.680895 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-5392727b-2d37-4bc6-9a6b-bd34103a6bbb tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:50.681329 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-5392727b-2d37-4bc6-9a6b-bd34103a6bbb tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:50.697470 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [req-bd50632d-4ca7-452b-8ae4-91df7f198b0d req-ec68837d-cc9e-47c1-96b1-45dc4dec9985 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a2fc30d-9d51-45ec-aab2-bedec62daf38", "name": "network-vif-plugged", "status": "completed", "tag": "97a2c8ea-edb9-40d7-b4e6-34030019f2e2"}]} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:48:50.718491 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-bd50632d-4ca7-452b-8ae4-91df7f198b0d req-ec68837d-cc9e-47c1-96b1-45dc4dec9985 service nova] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:50.722947 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-bd50632d-4ca7-452b-8ae4-91df7f198b0d req-ec68837d-cc9e-47c1-96b1-45dc4dec9985 service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:50.723931 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-bd50632d-4ca7-452b-8ae4-91df7f198b0d req-ec68837d-cc9e-47c1-96b1-45dc4dec9985 service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:50.742067 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.compute.server_external_events [req-bd50632d-4ca7-452b-8ae4-91df7f198b0d req-ec68837d-cc9e-47c1-96b1-45dc4dec9985 service nova] Creating event network-vif-plugged:97a2c8ea-edb9-40d7-b4e6-34030019f2e2 for instance 6a2fc30d-9d51-45ec-aab2-bedec62daf38 on hv-cinder-85427 Aug 24 11:48:50.750372 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [req-bd50632d-4ca7-452b-8ae4-91df7f198b0d req-ec68837d-cc9e-47c1-96b1-45dc4dec9985 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057296 Aug 24 11:48:50.752865 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 640/1320] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Aug 24 11:48:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:48:50.957909 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-5392727b-2d37-4bc6-9a6b-bd34103a6bbb tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3afc9f4d5bc3473c837926583d334d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d19d73eda154313be8539147f42ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:48:50.968414 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-5392727b-2d37-4bc6-9a6b-bd34103a6bbb tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] 10.222.0.84 "GET /compute/v2.1/servers/6a2fc30d-9d51-45ec-aab2-bedec62daf38" status: 200 len: 1314 microversion: 2.1 time: 0.320507 Aug 24 11:48:50.970284 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 681/1321] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:48:50 2022] GET /compute/v2.1/servers/6a2fc30d-9d51-45ec-aab2-bedec62daf38 => generated 1314 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:48:51.992238 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-dbd80e96-a9a0-4b75-94d1-4f05ef2e32bd tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:48:51.993130 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-dbd80e96-a9a0-4b75-94d1-4f05ef2e32bd tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] [instance: 6a2fc30d-9d51-45ec-aab2-bedec62daf38] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:48:52.003683 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:48:52.007156 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-dbd80e96-a9a0-4b75-94d1-4f05ef2e32bd tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:52.007600 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-dbd80e96-a9a0-4b75-94d1-4f05ef2e32bd tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:52.008148 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-dbd80e96-a9a0-4b75-94d1-4f05ef2e32bd tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:52.009012 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-dbd80e96-a9a0-4b75-94d1-4f05ef2e32bd tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:52.009820 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-dbd80e96-a9a0-4b75-94d1-4f05ef2e32bd tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:52.010331 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-dbd80e96-a9a0-4b75-94d1-4f05ef2e32bd tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:52.165956 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-dbd80e96-a9a0-4b75-94d1-4f05ef2e32bd tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3afc9f4d5bc3473c837926583d334d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d19d73eda154313be8539147f42ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:48:52.175713 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-dbd80e96-a9a0-4b75-94d1-4f05ef2e32bd tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] 10.222.0.84 "GET /compute/v2.1/servers/6a2fc30d-9d51-45ec-aab2-bedec62daf38" status: 200 len: 1314 microversion: 2.1 time: 0.189255 Aug 24 11:48:52.199748 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 641/1322] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:48:51 2022] GET /compute/v2.1/servers/6a2fc30d-9d51-45ec-aab2-bedec62daf38 => generated 1314 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:48:53.200527 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-c1c9d4cc-fbcc-411c-8719-1c593be3668e tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:48:53.202307 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-c1c9d4cc-fbcc-411c-8719-1c593be3668e tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] [instance: 6a2fc30d-9d51-45ec-aab2-bedec62daf38] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:48:53.204366 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG dbcounter [-] [124769] Writing DB stats nova_api:SELECT=46 {{(pid=124769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:48:53.209626 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-c1c9d4cc-fbcc-411c-8719-1c593be3668e tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:53.210484 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-c1c9d4cc-fbcc-411c-8719-1c593be3668e tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:53.211260 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-c1c9d4cc-fbcc-411c-8719-1c593be3668e tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:53.215230 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-c1c9d4cc-fbcc-411c-8719-1c593be3668e tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:53.215230 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-c1c9d4cc-fbcc-411c-8719-1c593be3668e tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:53.215230 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-c1c9d4cc-fbcc-411c-8719-1c593be3668e tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:53.379301 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-c1c9d4cc-fbcc-411c-8719-1c593be3668e tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3afc9f4d5bc3473c837926583d334d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d19d73eda154313be8539147f42ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:48:53.387061 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-c1c9d4cc-fbcc-411c-8719-1c593be3668e tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] 10.222.0.84 "GET /compute/v2.1/servers/6a2fc30d-9d51-45ec-aab2-bedec62daf38" status: 200 len: 1497 microversion: 2.1 time: 0.192870 Aug 24 11:48:53.387625 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 682/1323] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:48:53 2022] GET /compute/v2.1/servers/6a2fc30d-9d51-45ec-aab2-bedec62daf38 => generated 1497 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:48:53.628978 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-bd08f7f5-e887-4755-b3da-72815f36cf96 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-333787362", "imageRef": "028cad80-8f50-4139-b345-dfdca694dc6b", "flavorRef": "452"}} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:48:53.725801 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.network.neutron [None req-bd08f7f5-e887-4755-b3da-72815f36cf96 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] validate_networks() for None {{(pid=124770) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 11:48:54.256608 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.virt.hardware [None req-bd08f7f5-e887-4755-b3da-72815f36cf96 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Flavor limits 0:0:0 {{(pid=124770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 11:48:54.257508 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.virt.hardware [None req-bd08f7f5-e887-4755-b3da-72815f36cf96 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Image limits 0:0:0 {{(pid=124770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 11:48:54.257988 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.virt.hardware [None req-bd08f7f5-e887-4755-b3da-72815f36cf96 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Flavor pref 0:0:0 {{(pid=124770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 11:48:54.274961 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.virt.hardware [None req-bd08f7f5-e887-4755-b3da-72815f36cf96 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Image pref 0:0:0 {{(pid=124770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 11:48:54.274961 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.virt.hardware [None req-bd08f7f5-e887-4755-b3da-72815f36cf96 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 11:48:54.274961 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-bd08f7f5-e887-4755-b3da-72815f36cf96 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:54.274961 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-bd08f7f5-e887-4755-b3da-72815f36cf96 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:54.275429 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-bd08f7f5-e887-4755-b3da-72815f36cf96 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:54.275429 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-bd08f7f5-e887-4755-b3da-72815f36cf96 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:54.275429 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-bd08f7f5-e887-4755-b3da-72815f36cf96 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:54.275429 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-bd08f7f5-e887-4755-b3da-72815f36cf96 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:54.291341 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.quota [None req-bd08f7f5-e887-4755-b3da-72815f36cf96 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Getting quotas for project 71a2d9f0a96b4c8b82f343ecc8cc26ba. Resources: {'ram', 'cores', 'instances'} {{(pid=124770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:48:54.297299 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.quota [None req-bd08f7f5-e887-4755-b3da-72815f36cf96 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Getting quotas for user c7974c9be50c4a05b8d067fa0e4d0a96 and project 71a2d9f0a96b4c8b82f343ecc8cc26ba. Resources: {'ram', 'cores', 'instances'} {{(pid=124770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:48:54.317356 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-bd08f7f5-e887-4755-b3da-72815f36cf96 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Going to run 1 instances... {{(pid=124770) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 11:48:54.320050 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-bd08f7f5-e887-4755-b3da-72815f36cf96 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] [instance: df3120c6-fa78-4576-acb8-7f8565f160b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='028cad80-8f50-4139-b345-dfdca694dc6b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124770) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 11:48:54.477196 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-bd08f7f5-e887-4755-b3da-72815f36cf96 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] 10.222.0.84 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.851405 Aug 24 11:48:54.478814 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 642/1324] 10.222.0.84 () {60 vars in 1147 bytes} [Wed Aug 24 11:48:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 855 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 11:48:54.493879 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-f2470a10-81ee-4cb6-92de-da8ecc0af9b1 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:48:54.494688 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-f2470a10-81ee-4cb6-92de-da8ecc0af9b1 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] [instance: df3120c6-fa78-4576-acb8-7f8565f160b1] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:48:54.551700 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-831f9027-bb8c-4f6d-810e-3bd775006953 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:48:54.552534 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-831f9027-bb8c-4f6d-810e-3bd775006953 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] [instance: 6a2fc30d-9d51-45ec-aab2-bedec62daf38] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:48:54.566451 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-f2470a10-81ee-4cb6-92de-da8ecc0af9b1 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7974c9be50c4a05b8d067fa0e4d0a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a2d9f0a96b4c8b82f343ecc8cc26ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:48:54.567929 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-831f9027-bb8c-4f6d-810e-3bd775006953 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:54.568710 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-831f9027-bb8c-4f6d-810e-3bd775006953 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:54.570090 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-831f9027-bb8c-4f6d-810e-3bd775006953 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:54.572931 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-831f9027-bb8c-4f6d-810e-3bd775006953 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:54.574207 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-831f9027-bb8c-4f6d-810e-3bd775006953 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:54.574567 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-f2470a10-81ee-4cb6-92de-da8ecc0af9b1 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] 10.222.0.84 "GET /compute/v2.1/servers/df3120c6-fa78-4576-acb8-7f8565f160b1" status: 200 len: 1214 microversion: 2.1 time: 0.085634 Aug 24 11:48:54.576326 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 683/1325] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:48:54 2022] GET /compute/v2.1/servers/df3120c6-fa78-4576-acb8-7f8565f160b1 => generated 1214 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:48:54.577072 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-831f9027-bb8c-4f6d-810e-3bd775006953 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:54.629460 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-831f9027-bb8c-4f6d-810e-3bd775006953 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] [instance: 6a2fc30d-9d51-45ec-aab2-bedec62daf38] Going to try to terminate instance {{(pid=124770) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 11:48:55.000740 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-831f9027-bb8c-4f6d-810e-3bd775006953 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] 10.222.0.84 "DELETE /compute/v2.1/servers/6a2fc30d-9d51-45ec-aab2-bedec62daf38" status: 204 len: 0 microversion: 2.1 time: 0.453869 Aug 24 11:48:55.005466 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 643/1326] 10.222.0.84 () {58 vars in 1239 bytes} [Wed Aug 24 11:48:54 2022] DELETE /compute/v2.1/servers/6a2fc30d-9d51-45ec-aab2-bedec62daf38 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 11:48:55.015161 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-878483bf-4e45-4367-993b-4ccc5b0af285 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:48:55.016105 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-878483bf-4e45-4367-993b-4ccc5b0af285 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] [instance: 6a2fc30d-9d51-45ec-aab2-bedec62daf38] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:48:55.023745 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-878483bf-4e45-4367-993b-4ccc5b0af285 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:55.024238 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-878483bf-4e45-4367-993b-4ccc5b0af285 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:55.024679 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-878483bf-4e45-4367-993b-4ccc5b0af285 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:55.025462 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-878483bf-4e45-4367-993b-4ccc5b0af285 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:55.025969 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-878483bf-4e45-4367-993b-4ccc5b0af285 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:55.029946 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-878483bf-4e45-4367-993b-4ccc5b0af285 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:55.251145 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-878483bf-4e45-4367-993b-4ccc5b0af285 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3afc9f4d5bc3473c837926583d334d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d19d73eda154313be8539147f42ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:48:55.265789 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-878483bf-4e45-4367-993b-4ccc5b0af285 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] 10.222.0.84 "GET /compute/v2.1/servers/6a2fc30d-9d51-45ec-aab2-bedec62daf38" status: 200 len: 1503 microversion: 2.1 time: 0.254760 Aug 24 11:48:55.267422 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 684/1327] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:48:55 2022] GET /compute/v2.1/servers/6a2fc30d-9d51-45ec-aab2-bedec62daf38 => generated 1503 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:48:55.596068 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-f6e0827e-184e-4c29-bfb4-1a777cf18536 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:48:55.596983 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-f6e0827e-184e-4c29-bfb4-1a777cf18536 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] [instance: df3120c6-fa78-4576-acb8-7f8565f160b1] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:48:55.669447 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-f6e0827e-184e-4c29-bfb4-1a777cf18536 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7974c9be50c4a05b8d067fa0e4d0a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a2d9f0a96b4c8b82f343ecc8cc26ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:48:55.680019 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-f6e0827e-184e-4c29-bfb4-1a777cf18536 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] 10.222.0.84 "GET /compute/v2.1/servers/df3120c6-fa78-4576-acb8-7f8565f160b1" status: 200 len: 1214 microversion: 2.1 time: 0.087087 Aug 24 11:48:55.692928 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 644/1328] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:48:55 2022] GET /compute/v2.1/servers/df3120c6-fa78-4576-acb8-7f8565f160b1 => generated 1214 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:48:56.295571 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-35c45097-1df1-4359-844c-43e066a327f8 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:48:56.297744 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-35c45097-1df1-4359-844c-43e066a327f8 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] [instance: 6a2fc30d-9d51-45ec-aab2-bedec62daf38] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:48:56.307717 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-35c45097-1df1-4359-844c-43e066a327f8 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:56.315371 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-35c45097-1df1-4359-844c-43e066a327f8 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:56.316974 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-35c45097-1df1-4359-844c-43e066a327f8 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:56.318661 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-35c45097-1df1-4359-844c-43e066a327f8 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:56.319615 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-35c45097-1df1-4359-844c-43e066a327f8 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:56.320100 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-35c45097-1df1-4359-844c-43e066a327f8 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:56.531546 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-35c45097-1df1-4359-844c-43e066a327f8 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3afc9f4d5bc3473c837926583d334d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d19d73eda154313be8539147f42ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:48:56.541495 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-35c45097-1df1-4359-844c-43e066a327f8 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] 10.222.0.84 "GET /compute/v2.1/servers/6a2fc30d-9d51-45ec-aab2-bedec62daf38" status: 200 len: 1503 microversion: 2.1 time: 0.254328 Aug 24 11:48:56.542808 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 685/1329] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:48:56 2022] GET /compute/v2.1/servers/6a2fc30d-9d51-45ec-aab2-bedec62daf38 => generated 1503 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:48:56.705653 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-2b9f69e7-5c62-40d3-848e-910a16beca66 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:48:56.706576 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-2b9f69e7-5c62-40d3-848e-910a16beca66 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] [instance: df3120c6-fa78-4576-acb8-7f8565f160b1] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:48:56.727970 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-2b9f69e7-5c62-40d3-848e-910a16beca66 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:56.728769 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-2b9f69e7-5c62-40d3-848e-910a16beca66 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:56.729431 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-2b9f69e7-5c62-40d3-848e-910a16beca66 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:56.730461 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-2b9f69e7-5c62-40d3-848e-910a16beca66 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:56.731095 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-2b9f69e7-5c62-40d3-848e-910a16beca66 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:56.731746 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-2b9f69e7-5c62-40d3-848e-910a16beca66 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:56.829491 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-2b9f69e7-5c62-40d3-848e-910a16beca66 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7974c9be50c4a05b8d067fa0e4d0a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a2d9f0a96b4c8b82f343ecc8cc26ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:48:56.840738 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-2b9f69e7-5c62-40d3-848e-910a16beca66 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] 10.222.0.84 "GET /compute/v2.1/servers/df3120c6-fa78-4576-acb8-7f8565f160b1" status: 200 len: 1218 microversion: 2.1 time: 0.140665 Aug 24 11:48:56.842052 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 645/1330] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:48:56 2022] GET /compute/v2.1/servers/df3120c6-fa78-4576-acb8-7f8565f160b1 => generated 1218 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:48:57.564223 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-b01ee04f-6f6b-4bf5-ae9f-8bbaae80a347 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:48:57.565837 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-b01ee04f-6f6b-4bf5-ae9f-8bbaae80a347 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] [instance: 6a2fc30d-9d51-45ec-aab2-bedec62daf38] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:48:57.580994 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-b01ee04f-6f6b-4bf5-ae9f-8bbaae80a347 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:57.584094 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-b01ee04f-6f6b-4bf5-ae9f-8bbaae80a347 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:57.585156 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-b01ee04f-6f6b-4bf5-ae9f-8bbaae80a347 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:57.586819 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-b01ee04f-6f6b-4bf5-ae9f-8bbaae80a347 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:57.587836 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-b01ee04f-6f6b-4bf5-ae9f-8bbaae80a347 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:57.588775 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-b01ee04f-6f6b-4bf5-ae9f-8bbaae80a347 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:57.713926 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-b01ee04f-6f6b-4bf5-ae9f-8bbaae80a347 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3afc9f4d5bc3473c837926583d334d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d19d73eda154313be8539147f42ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:48:57.743567 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [req-9a94a4f0-d157-4b26-90a9-7189b4a6c3aa req-ddabc985-2f29-4e16-8574-999a69e30771 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a2fc30d-9d51-45ec-aab2-bedec62daf38", "name": "network-vif-deleted", "tag": "97a2c8ea-edb9-40d7-b4e6-34030019f2e2"}]} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:48:57.753917 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-b01ee04f-6f6b-4bf5-ae9f-8bbaae80a347 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] 10.222.0.84 "GET /compute/v2.1/servers/6a2fc30d-9d51-45ec-aab2-bedec62daf38" status: 200 len: 1461 microversion: 2.1 time: 0.178169 Aug 24 11:48:57.754812 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 686/1331] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:48:57 2022] GET /compute/v2.1/servers/6a2fc30d-9d51-45ec-aab2-bedec62daf38 => generated 1461 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:48:57.768047 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-9a94a4f0-d157-4b26-90a9-7189b4a6c3aa req-ddabc985-2f29-4e16-8574-999a69e30771 service nova] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:57.768865 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-9a94a4f0-d157-4b26-90a9-7189b4a6c3aa req-ddabc985-2f29-4e16-8574-999a69e30771 service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:57.770029 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-9a94a4f0-d157-4b26-90a9-7189b4a6c3aa req-ddabc985-2f29-4e16-8574-999a69e30771 service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:57.786813 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.compute.server_external_events [req-9a94a4f0-d157-4b26-90a9-7189b4a6c3aa req-ddabc985-2f29-4e16-8574-999a69e30771 service nova] Creating event network-vif-deleted:97a2c8ea-edb9-40d7-b4e6-34030019f2e2 for instance 6a2fc30d-9d51-45ec-aab2-bedec62daf38 on hv-cinder-85427 Aug 24 11:48:57.796609 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [req-9a94a4f0-d157-4b26-90a9-7189b4a6c3aa req-ddabc985-2f29-4e16-8574-999a69e30771 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056023 Aug 24 11:48:57.798780 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 646/1332] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Aug 24 11:48:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:48:57.864426 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-71904e62-a01e-479f-85bc-8437e4100fa1 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:48:57.865410 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-71904e62-a01e-479f-85bc-8437e4100fa1 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] [instance: df3120c6-fa78-4576-acb8-7f8565f160b1] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:48:57.877437 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-71904e62-a01e-479f-85bc-8437e4100fa1 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:57.878657 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-71904e62-a01e-479f-85bc-8437e4100fa1 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:57.881346 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-71904e62-a01e-479f-85bc-8437e4100fa1 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:57.888513 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-71904e62-a01e-479f-85bc-8437e4100fa1 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:57.888513 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-71904e62-a01e-479f-85bc-8437e4100fa1 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:57.888513 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-71904e62-a01e-479f-85bc-8437e4100fa1 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:58.005853 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-71904e62-a01e-479f-85bc-8437e4100fa1 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7974c9be50c4a05b8d067fa0e4d0a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a2d9f0a96b4c8b82f343ecc8cc26ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:48:58.026585 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-71904e62-a01e-479f-85bc-8437e4100fa1 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] 10.222.0.84 "GET /compute/v2.1/servers/df3120c6-fa78-4576-acb8-7f8565f160b1" status: 200 len: 1266 microversion: 2.1 time: 0.166279 Aug 24 11:48:58.040938 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 687/1333] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:48:57 2022] GET /compute/v2.1/servers/df3120c6-fa78-4576-acb8-7f8565f160b1 => generated 1266 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:48:58.779751 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-e1ac8cbc-5c8e-4814-b897-d3a4327e98a3 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:48:58.780853 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-e1ac8cbc-5c8e-4814-b897-d3a4327e98a3 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] [instance: 6a2fc30d-9d51-45ec-aab2-bedec62daf38] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:48:58.792020 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e1ac8cbc-5c8e-4814-b897-d3a4327e98a3 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:58.792985 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e1ac8cbc-5c8e-4814-b897-d3a4327e98a3 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:58.793686 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e1ac8cbc-5c8e-4814-b897-d3a4327e98a3 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:58.795163 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e1ac8cbc-5c8e-4814-b897-d3a4327e98a3 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:58.795883 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e1ac8cbc-5c8e-4814-b897-d3a4327e98a3 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:58.796750 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e1ac8cbc-5c8e-4814-b897-d3a4327e98a3 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:58.844958 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e1ac8cbc-5c8e-4814-b897-d3a4327e98a3 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:58.845899 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e1ac8cbc-5c8e-4814-b897-d3a4327e98a3 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:58.846978 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e1ac8cbc-5c8e-4814-b897-d3a4327e98a3 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:58.847842 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.objects.instance [None req-e1ac8cbc-5c8e-4814-b897-d3a4327e98a3 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lazy-loading 'fault' on Instance uuid 6a2fc30d-9d51-45ec-aab2-bedec62daf38 {{(pid=124770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:48:58.905121 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-e1ac8cbc-5c8e-4814-b897-d3a4327e98a3 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3afc9f4d5bc3473c837926583d334d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d19d73eda154313be8539147f42ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:48:58.915778 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-e1ac8cbc-5c8e-4814-b897-d3a4327e98a3 tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] 10.222.0.84 "GET /compute/v2.1/servers/6a2fc30d-9d51-45ec-aab2-bedec62daf38" status: 200 len: 1304 microversion: 2.1 time: 0.142129 Aug 24 11:48:58.917168 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 647/1334] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:48:58 2022] GET /compute/v2.1/servers/6a2fc30d-9d51-45ec-aab2-bedec62daf38 => generated 1304 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:48:59.048979 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-0dc7ff01-6605-43aa-8e83-9bf9ec4fd016 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:48:59.049594 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-0dc7ff01-6605-43aa-8e83-9bf9ec4fd016 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] [instance: df3120c6-fa78-4576-acb8-7f8565f160b1] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:48:59.058436 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-0dc7ff01-6605-43aa-8e83-9bf9ec4fd016 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:59.059009 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-0dc7ff01-6605-43aa-8e83-9bf9ec4fd016 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:59.059533 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-0dc7ff01-6605-43aa-8e83-9bf9ec4fd016 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:59.061021 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-0dc7ff01-6605-43aa-8e83-9bf9ec4fd016 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:59.062074 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-0dc7ff01-6605-43aa-8e83-9bf9ec4fd016 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:59.062517 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-0dc7ff01-6605-43aa-8e83-9bf9ec4fd016 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:59.153222 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-0dc7ff01-6605-43aa-8e83-9bf9ec4fd016 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7974c9be50c4a05b8d067fa0e4d0a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a2d9f0a96b4c8b82f343ecc8cc26ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:48:59.163223 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-0dc7ff01-6605-43aa-8e83-9bf9ec4fd016 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] 10.222.0.84 "GET /compute/v2.1/servers/df3120c6-fa78-4576-acb8-7f8565f160b1" status: 200 len: 1272 microversion: 2.1 time: 0.118829 Aug 24 11:48:59.178499 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 688/1335] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:48:59 2022] GET /compute/v2.1/servers/df3120c6-fa78-4576-acb8-7f8565f160b1 => generated 1272 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:48:59.942504 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-2caf12ef-4535-40c0-b8ff-57f14a0f45bf tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:48:59.944031 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-2caf12ef-4535-40c0-b8ff-57f14a0f45bf tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] [instance: 6a2fc30d-9d51-45ec-aab2-bedec62daf38] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:48:59.954243 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-2caf12ef-4535-40c0-b8ff-57f14a0f45bf tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:59.955367 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-2caf12ef-4535-40c0-b8ff-57f14a0f45bf tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:59.956070 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-2caf12ef-4535-40c0-b8ff-57f14a0f45bf tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:59.957053 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-2caf12ef-4535-40c0-b8ff-57f14a0f45bf tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:48:59.957758 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-2caf12ef-4535-40c0-b8ff-57f14a0f45bf tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:48:59.958401 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-2caf12ef-4535-40c0-b8ff-57f14a0f45bf tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:48:59.989086 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.wsgi [None req-2caf12ef-4535-40c0-b8ff-57f14a0f45bf tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] HTTP exception thrown: Instance 6a2fc30d-9d51-45ec-aab2-bedec62daf38 could not be found. Aug 24 11:48:59.991734 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-2caf12ef-4535-40c0-b8ff-57f14a0f45bf tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Request method failure captured: Aug 24 11:48:59.991734 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: request: GET /compute/v2.1/servers/6a2fc30d-9d51-45ec-aab2-bedec62daf38 HTTP/1.1 Aug 24 11:48:59.991734 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Accept: application/json Aug 24 11:48:59.991734 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Accept-Encoding: identity Aug 24 11:48:59.991734 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Connection: close Aug 24 11:48:59.991734 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Content-Length: 0 Aug 24 11:48:59.991734 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Content-Type: application/json Aug 24 11:48:59.991734 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Host: 10.222.0.84 Aug 24 11:48:59.991734 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Openstack-System-Scope: None Aug 24 11:48:59.991734 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: User-Agent: python-urllib3/1.26.11 Aug 24 11:48:59.991734 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Auth-Token: gAAAAABjBg_hIcKxq5EpE-EbVNOmeXgvjAOSJAbdqsX05iwx4DLQ0gqAvDMuwCLMJNiGhcGv-an0orimOFmdk3qHdrVep4M6nUcHW8pJCF5Yy16Dn5w6GaZ15hukQWkNkfQ-Q-oYhatsLDiAnYOS09TB95gUClEJf7dNEN1-QF7bAwdiRXFIAu4 Aug 24 11:48:59.991734 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Domain-Id: None Aug 24 11:48:59.991734 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Domain-Name: None Aug 24 11:48:59.991734 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Identity-Status: Confirmed Aug 24 11:48:59.991734 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Is-Admin-Project: True Aug 24 11:48:59.991734 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Project-Domain-Id: default Aug 24 11:48:59.991734 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Project-Domain-Name: Default Aug 24 11:48:59.991734 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Project-Id: 1d19d73eda154313be8539147f42ec11 Aug 24 11:48:59.991734 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Project-Name: tempest-VolumesActionsTest-1741375855 Aug 24 11:48:59.991734 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Role: reader,member Aug 24 11:48:59.991734 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Roles: reader,member Aug 24 11:48:59.993519 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/volume/v3/1d19d73eda154313be8539147f42ec11"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/volume/v3/1d19d73eda154313be8539147f42ec11"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/compute/v2/1d19d73eda154313be8539147f42ec11"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84:8080/v1/AUTH_1d19d73eda154313be8539147f42ec11", "adminURL": "http://10.222.0.84:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/placement"}]}] Aug 24 11:48:59.993519 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Tenant: tempest-VolumesActionsTest-1741375855 Aug 24 11:48:59.993519 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Tenant-Id: 1d19d73eda154313be8539147f42ec11 Aug 24 11:48:59.993519 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Tenant-Name: tempest-VolumesActionsTest-1741375855 Aug 24 11:48:59.993519 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User: tempest-VolumesActionsTest-1741375855-project Aug 24 11:48:59.993519 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User-Domain-Id: default Aug 24 11:48:59.993519 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User-Domain-Name: Default Aug 24 11:48:59.993519 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User-Id: 3afc9f4d5bc3473c837926583d334d31 Aug 24 11:48:59.993519 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User-Name: tempest-VolumesActionsTest-1741375855-project Aug 24 11:48:59.993519 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: method: > Aug 24 11:48:59.993519 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: exception: Instance 6a2fc30d-9d51-45ec-aab2-bedec62daf38 could not be found. Aug 24 11:48:59.993519 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: action_args: {'id': '6a2fc30d-9d51-45ec-aab2-bedec62daf38'} Aug 24 11:48:59.994562 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:48:59.994562 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:48:59.994562 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:48:59.994562 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:48:59.994562 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:48:59.994562 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:48:59.994562 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:48:59.994562 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:48:59.994562 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:48:59.994562 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:48:59.994562 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a2fc30d-9d51-45ec-aab2-bedec62daf38 could not be found. Aug 24 11:48:59.994562 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:48:59.994562 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:48:59.994562 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:48:59.994562 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:48:59.994562 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:48:59.994562 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:48:59.994562 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:48:59.994562 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:48:59.994562 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:49:00.000870 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:49:00.000870 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:49:00.000870 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:49:00.000870 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:49:00.000870 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:49:00.000870 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:49:00.000870 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:49:00.000870 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a2fc30d-9d51-45ec-aab2-bedec62daf38 could not be found. Aug 24 11:49:00.000870 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:49:00.000870 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:49:00.000870 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:49:00.000870 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:49:00.000870 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:49:00.000870 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:49:00.000870 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:49:00.000870 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:49:00.000870 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a2fc30d-9d51-45ec-aab2-bedec62daf38 could not be found. Aug 24 11:49:00.000870 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:49:00.003229 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-2caf12ef-4535-40c0-b8ff-57f14a0f45bf tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] Returning 404 to user: Instance 6a2fc30d-9d51-45ec-aab2-bedec62daf38 could not be found. {{(pid=124770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:49:00.003229 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-2caf12ef-4535-40c0-b8ff-57f14a0f45bf tempest-VolumesActionsTest-1741375855 tempest-VolumesActionsTest-1741375855-project] 10.222.0.84 "GET /compute/v2.1/servers/6a2fc30d-9d51-45ec-aab2-bedec62daf38" status: 404 len: 111 microversion: 2.1 time: 0.055411 Aug 24 11:49:00.003229 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 648/1336] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:48:59 2022] GET /compute/v2.1/servers/6a2fc30d-9d51-45ec-aab2-bedec62daf38 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:49:00.191868 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-515efa5a-87fe-4a0f-8d86-7b9a037f6b1f tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:49:00.192489 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-515efa5a-87fe-4a0f-8d86-7b9a037f6b1f tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] [instance: df3120c6-fa78-4576-acb8-7f8565f160b1] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:49:00.198679 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-515efa5a-87fe-4a0f-8d86-7b9a037f6b1f tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:49:00.199528 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-515efa5a-87fe-4a0f-8d86-7b9a037f6b1f tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:49:00.201220 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-515efa5a-87fe-4a0f-8d86-7b9a037f6b1f tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:49:00.202120 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-515efa5a-87fe-4a0f-8d86-7b9a037f6b1f tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:49:00.202748 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-515efa5a-87fe-4a0f-8d86-7b9a037f6b1f tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:49:00.203432 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-515efa5a-87fe-4a0f-8d86-7b9a037f6b1f tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:49:00.371555 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-515efa5a-87fe-4a0f-8d86-7b9a037f6b1f tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7974c9be50c4a05b8d067fa0e4d0a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a2d9f0a96b4c8b82f343ecc8cc26ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:49:00.380223 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-515efa5a-87fe-4a0f-8d86-7b9a037f6b1f tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] 10.222.0.84 "GET /compute/v2.1/servers/df3120c6-fa78-4576-acb8-7f8565f160b1" status: 200 len: 1314 microversion: 2.1 time: 0.192254 Aug 24 11:49:00.393388 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 689/1337] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:49:00 2022] GET /compute/v2.1/servers/df3120c6-fa78-4576-acb8-7f8565f160b1 => generated 1314 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:49:00.848754 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [req-1abc5311-cf01-4d83-aa1b-b38eea134649 req-4c60ce3e-7478-4543-8fc6-e10191bc1122 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df3120c6-fa78-4576-acb8-7f8565f160b1", "tag": "f2ab5dd0-0773-40fa-b50a-a510662962a5"}]} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:49:00.858912 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-1abc5311-cf01-4d83-aa1b-b38eea134649 req-4c60ce3e-7478-4543-8fc6-e10191bc1122 service nova] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:49:00.859652 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-1abc5311-cf01-4d83-aa1b-b38eea134649 req-4c60ce3e-7478-4543-8fc6-e10191bc1122 service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:49:00.860266 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-1abc5311-cf01-4d83-aa1b-b38eea134649 req-4c60ce3e-7478-4543-8fc6-e10191bc1122 service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:49:00.864676 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:49:00.873272 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.compute.server_external_events [req-1abc5311-cf01-4d83-aa1b-b38eea134649 req-4c60ce3e-7478-4543-8fc6-e10191bc1122 service nova] Creating event network-changed:f2ab5dd0-0773-40fa-b50a-a510662962a5 for instance df3120c6-fa78-4576-acb8-7f8565f160b1 on hv-cinder-85427 Aug 24 11:49:00.892381 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [req-1abc5311-cf01-4d83-aa1b-b38eea134649 req-4c60ce3e-7478-4543-8fc6-e10191bc1122 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053751 Aug 24 11:49:00.893049 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 649/1338] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Aug 24 11:49:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:49:01.402729 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-327939b0-c4f5-4d16-a109-e32d0d827b10 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:49:01.405209 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-327939b0-c4f5-4d16-a109-e32d0d827b10 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] [instance: df3120c6-fa78-4576-acb8-7f8565f160b1] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:49:01.412693 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-327939b0-c4f5-4d16-a109-e32d0d827b10 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:49:01.413238 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-327939b0-c4f5-4d16-a109-e32d0d827b10 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:49:01.413686 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-327939b0-c4f5-4d16-a109-e32d0d827b10 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:49:01.414381 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-327939b0-c4f5-4d16-a109-e32d0d827b10 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:49:01.414845 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-327939b0-c4f5-4d16-a109-e32d0d827b10 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:49:01.415260 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-327939b0-c4f5-4d16-a109-e32d0d827b10 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:49:01.894914 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-327939b0-c4f5-4d16-a109-e32d0d827b10 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7974c9be50c4a05b8d067fa0e4d0a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a2d9f0a96b4c8b82f343ecc8cc26ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:49:01.904432 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-327939b0-c4f5-4d16-a109-e32d0d827b10 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] 10.222.0.84 "GET /compute/v2.1/servers/df3120c6-fa78-4576-acb8-7f8565f160b1" status: 200 len: 1314 microversion: 2.1 time: 0.505430 Aug 24 11:49:01.905831 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 690/1339] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:49:01 2022] GET /compute/v2.1/servers/df3120c6-fa78-4576-acb8-7f8565f160b1 => generated 1314 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:49:02.927085 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-e4579345-60e9-4fa7-a013-f07d810c1dfd tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:49:02.927698 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-e4579345-60e9-4fa7-a013-f07d810c1dfd tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] [instance: df3120c6-fa78-4576-acb8-7f8565f160b1] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:49:02.935595 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e4579345-60e9-4fa7-a013-f07d810c1dfd tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:49:02.936501 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e4579345-60e9-4fa7-a013-f07d810c1dfd tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:49:02.937140 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e4579345-60e9-4fa7-a013-f07d810c1dfd tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:49:02.937847 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e4579345-60e9-4fa7-a013-f07d810c1dfd tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:49:02.938547 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e4579345-60e9-4fa7-a013-f07d810c1dfd tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:49:02.938978 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e4579345-60e9-4fa7-a013-f07d810c1dfd tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:49:03.089934 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-e4579345-60e9-4fa7-a013-f07d810c1dfd tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7974c9be50c4a05b8d067fa0e4d0a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a2d9f0a96b4c8b82f343ecc8cc26ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:49:03.098770 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-e4579345-60e9-4fa7-a013-f07d810c1dfd tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] 10.222.0.84 "GET /compute/v2.1/servers/df3120c6-fa78-4576-acb8-7f8565f160b1" status: 200 len: 1314 microversion: 2.1 time: 0.176372 Aug 24 11:49:03.099364 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 650/1340] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:49:02 2022] GET /compute/v2.1/servers/df3120c6-fa78-4576-acb8-7f8565f160b1 => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:49:04.120389 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-e7bd1d3d-0ff1-4841-a043-ba6b75a51a8d tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:49:04.121053 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-e7bd1d3d-0ff1-4841-a043-ba6b75a51a8d tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] [instance: df3120c6-fa78-4576-acb8-7f8565f160b1] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:49:04.129503 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-e7bd1d3d-0ff1-4841-a043-ba6b75a51a8d tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:49:04.129996 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-e7bd1d3d-0ff1-4841-a043-ba6b75a51a8d tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:49:04.130437 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-e7bd1d3d-0ff1-4841-a043-ba6b75a51a8d tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:49:04.131170 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-e7bd1d3d-0ff1-4841-a043-ba6b75a51a8d tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:49:04.131640 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-e7bd1d3d-0ff1-4841-a043-ba6b75a51a8d tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:49:04.132080 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-e7bd1d3d-0ff1-4841-a043-ba6b75a51a8d tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:49:04.288205 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-e7bd1d3d-0ff1-4841-a043-ba6b75a51a8d tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7974c9be50c4a05b8d067fa0e4d0a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a2d9f0a96b4c8b82f343ecc8cc26ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:49:04.296535 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-e7bd1d3d-0ff1-4841-a043-ba6b75a51a8d tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] 10.222.0.84 "GET /compute/v2.1/servers/df3120c6-fa78-4576-acb8-7f8565f160b1" status: 200 len: 1314 microversion: 2.1 time: 0.180245 Aug 24 11:49:04.297149 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 691/1341] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:49:04 2022] GET /compute/v2.1/servers/df3120c6-fa78-4576-acb8-7f8565f160b1 => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:49:05.318002 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-0db17d55-2c9d-426a-a580-58a24441a51c tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:49:05.318616 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-0db17d55-2c9d-426a-a580-58a24441a51c tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] [instance: df3120c6-fa78-4576-acb8-7f8565f160b1] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:49:05.321057 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_cell0:SELECT=2 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:49:05.326921 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-0db17d55-2c9d-426a-a580-58a24441a51c tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:49:05.327409 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-0db17d55-2c9d-426a-a580-58a24441a51c tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:49:05.327852 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-0db17d55-2c9d-426a-a580-58a24441a51c tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:49:05.328562 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-0db17d55-2c9d-426a-a580-58a24441a51c tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:49:05.329046 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-0db17d55-2c9d-426a-a580-58a24441a51c tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:49:05.329474 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-0db17d55-2c9d-426a-a580-58a24441a51c tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:49:05.486445 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-0db17d55-2c9d-426a-a580-58a24441a51c tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7974c9be50c4a05b8d067fa0e4d0a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a2d9f0a96b4c8b82f343ecc8cc26ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:49:05.495087 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-0db17d55-2c9d-426a-a580-58a24441a51c tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] 10.222.0.84 "GET /compute/v2.1/servers/df3120c6-fa78-4576-acb8-7f8565f160b1" status: 200 len: 1314 microversion: 2.1 time: 0.180963 Aug 24 11:49:05.495953 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 651/1342] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:49:05 2022] GET /compute/v2.1/servers/df3120c6-fa78-4576-acb8-7f8565f160b1 => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:49:05.514194 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-ef9914f0-272b-4f78-a10c-0fd26d0573df tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Action: 'create', calling method: .version_select at 0x7f0e2a393790>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-335292085", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAKciEXwQuMDAGYLzdg1YDzQvyOxhCoBw4EytS4iN+jkjfQLoFNZ6WFKnH5y9kBIuj1MgExqJpyneGNK0iPoLZWthW6ULIRwFVnrb5tpdNOqOsiOE2mETCQlF/HmG3LwNw=="}} {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:49:05.520636 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG dbcounter [-] [124769] Writing DB stats nova_cell0:SELECT=2 {{(pid=124769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:49:05.534093 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.quota [None req-ef9914f0-272b-4f78-a10c-0fd26d0573df tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Getting quotas for project 9a70cdccbcb84216ae61c72d6736bd63. Resources: {'key_pairs'} {{(pid=124769) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:49:05.538202 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.quota [None req-ef9914f0-272b-4f78-a10c-0fd26d0573df tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Getting quotas for user 5591708bfed04ac185d4c610e8b76125 and project 9a70cdccbcb84216ae61c72d6736bd63. Resources: {'key_pairs'} {{(pid=124769) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:49:05.661852 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-ef9914f0-272b-4f78-a10c-0fd26d0573df tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] 10.222.0.84 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.151744 Aug 24 11:49:05.662475 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 692/1343] 10.222.0.84 () {60 vars in 1159 bytes} [Wed Aug 24 11:49:05 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:49:05.726393 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-18b29cf7-1b6a-4f6d-9348-b82bd84583ce tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-937114803", "imageRef": "f11feaf9-bfc9-4c17-8be3-03b7b9065cb7", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-335292085", "networks": [{"uuid": "d85aa695-2cf3-4f61-968c-d37f26de932d"}]}} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:49:05.737843 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_cell0:SELECT=8 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:49:05.788378 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.network.neutron [None req-18b29cf7-1b6a-4f6d-9348-b82bd84583ce tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] validate_networks() for [('d85aa695-2cf3-4f61-968c-d37f26de932d', None, None, None, None, None)] {{(pid=124770) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 11:49:06.255896 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.virt.hardware [None req-18b29cf7-1b6a-4f6d-9348-b82bd84583ce tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Flavor limits 0:0:0 {{(pid=124770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 11:49:06.256395 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.virt.hardware [None req-18b29cf7-1b6a-4f6d-9348-b82bd84583ce tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Image limits 0:0:0 {{(pid=124770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 11:49:06.256950 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.virt.hardware [None req-18b29cf7-1b6a-4f6d-9348-b82bd84583ce tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Flavor pref 0:0:0 {{(pid=124770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 11:49:06.257376 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.virt.hardware [None req-18b29cf7-1b6a-4f6d-9348-b82bd84583ce tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Image pref 0:0:0 {{(pid=124770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 11:49:06.257792 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.virt.hardware [None req-18b29cf7-1b6a-4f6d-9348-b82bd84583ce tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 11:49:06.268582 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-18b29cf7-1b6a-4f6d-9348-b82bd84583ce tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:49:06.270303 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-18b29cf7-1b6a-4f6d-9348-b82bd84583ce tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:49:06.270303 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-18b29cf7-1b6a-4f6d-9348-b82bd84583ce tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:49:06.271494 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-18b29cf7-1b6a-4f6d-9348-b82bd84583ce tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:49:06.272447 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-18b29cf7-1b6a-4f6d-9348-b82bd84583ce tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:49:06.273248 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-18b29cf7-1b6a-4f6d-9348-b82bd84583ce tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:49:06.296592 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.quota [None req-18b29cf7-1b6a-4f6d-9348-b82bd84583ce tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Getting quotas for project 9a70cdccbcb84216ae61c72d6736bd63. Resources: {'ram', 'cores', 'instances'} {{(pid=124770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:49:06.301592 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.quota [None req-18b29cf7-1b6a-4f6d-9348-b82bd84583ce tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Getting quotas for user 5591708bfed04ac185d4c610e8b76125 and project 9a70cdccbcb84216ae61c72d6736bd63. Resources: {'ram', 'cores', 'instances'} {{(pid=124770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:49:06.320165 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-18b29cf7-1b6a-4f6d-9348-b82bd84583ce tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Going to run 1 instances... {{(pid=124770) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 11:49:06.323754 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-18b29cf7-1b6a-4f6d-9348-b82bd84583ce tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] [instance: 33e87882-96cf-4d0a-be2c-f0b3474c1486] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f11feaf9-bfc9-4c17-8be3-03b7b9065cb7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124770) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 11:49:06.466444 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-18b29cf7-1b6a-4f6d-9348-b82bd84583ce tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] 10.222.0.84 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.743751 Aug 24 11:49:06.472916 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 652/1344] 10.222.0.84 () {60 vars in 1147 bytes} [Wed Aug 24 11:49:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 745 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 11:49:06.483937 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-97f163dd-73f3-4822-9e19-dce148b10b1e tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:49:06.486994 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-97f163dd-73f3-4822-9e19-dce148b10b1e tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] [instance: 33e87882-96cf-4d0a-be2c-f0b3474c1486] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:49:06.524112 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-55e29858-4cb0-48f4-aa34-ab9330836d8a tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:49:06.525450 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-55e29858-4cb0-48f4-aa34-ab9330836d8a tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] [instance: df3120c6-fa78-4576-acb8-7f8565f160b1] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:49:06.538440 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-55e29858-4cb0-48f4-aa34-ab9330836d8a tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:49:06.539286 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-55e29858-4cb0-48f4-aa34-ab9330836d8a tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:49:06.540053 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-55e29858-4cb0-48f4-aa34-ab9330836d8a tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:49:06.541350 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-55e29858-4cb0-48f4-aa34-ab9330836d8a tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:49:06.542174 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-55e29858-4cb0-48f4-aa34-ab9330836d8a tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:49:06.542941 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-55e29858-4cb0-48f4-aa34-ab9330836d8a tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:49:06.598917 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-97f163dd-73f3-4822-9e19-dce148b10b1e tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591708bfed04ac185d4c610e8b76125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a70cdccbcb84216ae61c72d6736bd63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:49:06.598917 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-97f163dd-73f3-4822-9e19-dce148b10b1e tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] 10.222.0.84 "GET /compute/v2.1/servers/33e87882-96cf-4d0a-be2c-f0b3474c1486" status: 200 len: 1257 microversion: 2.1 time: 0.112689 Aug 24 11:49:06.598917 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 693/1345] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:49:06 2022] GET /compute/v2.1/servers/33e87882-96cf-4d0a-be2c-f0b3474c1486 => generated 1257 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:49:06.707704 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-55e29858-4cb0-48f4-aa34-ab9330836d8a tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7974c9be50c4a05b8d067fa0e4d0a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a2d9f0a96b4c8b82f343ecc8cc26ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:49:06.716598 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-55e29858-4cb0-48f4-aa34-ab9330836d8a tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] 10.222.0.84 "GET /compute/v2.1/servers/df3120c6-fa78-4576-acb8-7f8565f160b1" status: 200 len: 1314 microversion: 2.1 time: 0.199066 Aug 24 11:49:06.717155 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 653/1346] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:49:06 2022] GET /compute/v2.1/servers/df3120c6-fa78-4576-acb8-7f8565f160b1 => generated 1314 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:49:07.617082 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-31092361-fdc7-4ae9-804e-ca0dac7d8b54 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:49:07.617745 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-31092361-fdc7-4ae9-804e-ca0dac7d8b54 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] [instance: 33e87882-96cf-4d0a-be2c-f0b3474c1486] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:49:07.675022 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-31092361-fdc7-4ae9-804e-ca0dac7d8b54 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591708bfed04ac185d4c610e8b76125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a70cdccbcb84216ae61c72d6736bd63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:49:07.682852 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-31092361-fdc7-4ae9-804e-ca0dac7d8b54 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] 10.222.0.84 "GET /compute/v2.1/servers/33e87882-96cf-4d0a-be2c-f0b3474c1486" status: 200 len: 1257 microversion: 2.1 time: 0.069549 Aug 24 11:49:07.683515 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 694/1347] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:49:07 2022] GET /compute/v2.1/servers/33e87882-96cf-4d0a-be2c-f0b3474c1486 => generated 1257 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:49:07.738473 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-c3e323b4-0a35-4ba1-9e74-e0158df3aaf6 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:49:07.739089 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-c3e323b4-0a35-4ba1-9e74-e0158df3aaf6 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] [instance: df3120c6-fa78-4576-acb8-7f8565f160b1] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:49:07.745793 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c3e323b4-0a35-4ba1-9e74-e0158df3aaf6 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:49:07.746271 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c3e323b4-0a35-4ba1-9e74-e0158df3aaf6 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:49:07.746703 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c3e323b4-0a35-4ba1-9e74-e0158df3aaf6 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:49:07.747387 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c3e323b4-0a35-4ba1-9e74-e0158df3aaf6 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:49:07.748554 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c3e323b4-0a35-4ba1-9e74-e0158df3aaf6 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:49:07.749016 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c3e323b4-0a35-4ba1-9e74-e0158df3aaf6 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:49:07.900595 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-c3e323b4-0a35-4ba1-9e74-e0158df3aaf6 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7974c9be50c4a05b8d067fa0e4d0a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a2d9f0a96b4c8b82f343ecc8cc26ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:49:07.914850 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-c3e323b4-0a35-4ba1-9e74-e0158df3aaf6 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] 10.222.0.84 "GET /compute/v2.1/servers/df3120c6-fa78-4576-acb8-7f8565f160b1" status: 200 len: 1314 microversion: 2.1 time: 0.180583 Aug 24 11:49:07.915767 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 654/1348] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:49:07 2022] GET /compute/v2.1/servers/df3120c6-fa78-4576-acb8-7f8565f160b1 => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:49:08.706004 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-13240417-70f6-439b-aa39-c6cb5cb4dc73 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:49:08.707664 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-13240417-70f6-439b-aa39-c6cb5cb4dc73 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] [instance: 33e87882-96cf-4d0a-be2c-f0b3474c1486] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:49:08.715840 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-13240417-70f6-439b-aa39-c6cb5cb4dc73 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:49:08.717142 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-13240417-70f6-439b-aa39-c6cb5cb4dc73 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:49:08.717737 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-13240417-70f6-439b-aa39-c6cb5cb4dc73 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:49:08.718715 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-13240417-70f6-439b-aa39-c6cb5cb4dc73 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:49:08.719491 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-13240417-70f6-439b-aa39-c6cb5cb4dc73 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:49:08.720087 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-13240417-70f6-439b-aa39-c6cb5cb4dc73 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:49:08.795854 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-13240417-70f6-439b-aa39-c6cb5cb4dc73 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591708bfed04ac185d4c610e8b76125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a70cdccbcb84216ae61c72d6736bd63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:49:08.806059 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-13240417-70f6-439b-aa39-c6cb5cb4dc73 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] 10.222.0.84 "GET /compute/v2.1/servers/33e87882-96cf-4d0a-be2c-f0b3474c1486" status: 200 len: 1253 microversion: 2.1 time: 0.104265 Aug 24 11:49:08.807347 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 695/1349] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:49:08 2022] GET /compute/v2.1/servers/33e87882-96cf-4d0a-be2c-f0b3474c1486 => generated 1253 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:49:08.944017 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-01563009-d4c5-4dd8-b7f4-8f28bb714b29 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:49:08.945635 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-01563009-d4c5-4dd8-b7f4-8f28bb714b29 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] [instance: df3120c6-fa78-4576-acb8-7f8565f160b1] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:49:08.953858 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-01563009-d4c5-4dd8-b7f4-8f28bb714b29 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:49:08.954634 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-01563009-d4c5-4dd8-b7f4-8f28bb714b29 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:49:08.955429 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-01563009-d4c5-4dd8-b7f4-8f28bb714b29 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:49:08.956202 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-01563009-d4c5-4dd8-b7f4-8f28bb714b29 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:49:08.956859 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-01563009-d4c5-4dd8-b7f4-8f28bb714b29 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:49:08.957491 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-01563009-d4c5-4dd8-b7f4-8f28bb714b29 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:49:09.127549 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-01563009-d4c5-4dd8-b7f4-8f28bb714b29 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7974c9be50c4a05b8d067fa0e4d0a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a2d9f0a96b4c8b82f343ecc8cc26ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:49:09.137599 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-01563009-d4c5-4dd8-b7f4-8f28bb714b29 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] 10.222.0.84 "GET /compute/v2.1/servers/df3120c6-fa78-4576-acb8-7f8565f160b1" status: 200 len: 1314 microversion: 2.1 time: 0.197689 Aug 24 11:49:09.152889 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 655/1350] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:49:08 2022] GET /compute/v2.1/servers/df3120c6-fa78-4576-acb8-7f8565f160b1 => generated 1314 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:49:09.832323 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-cb1f72b3-35a2-4cac-be7d-474a04ac6c14 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:49:09.833065 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-cb1f72b3-35a2-4cac-be7d-474a04ac6c14 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] [instance: 33e87882-96cf-4d0a-be2c-f0b3474c1486] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:49:09.839634 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-cb1f72b3-35a2-4cac-be7d-474a04ac6c14 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:49:09.840517 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-cb1f72b3-35a2-4cac-be7d-474a04ac6c14 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:49:09.841252 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-cb1f72b3-35a2-4cac-be7d-474a04ac6c14 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:49:09.843073 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-cb1f72b3-35a2-4cac-be7d-474a04ac6c14 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:49:09.843814 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-cb1f72b3-35a2-4cac-be7d-474a04ac6c14 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:49:09.844498 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-cb1f72b3-35a2-4cac-be7d-474a04ac6c14 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:49:09.962222 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-cb1f72b3-35a2-4cac-be7d-474a04ac6c14 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591708bfed04ac185d4c610e8b76125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a70cdccbcb84216ae61c72d6736bd63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:49:09.975096 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-cb1f72b3-35a2-4cac-be7d-474a04ac6c14 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] 10.222.0.84 "GET /compute/v2.1/servers/33e87882-96cf-4d0a-be2c-f0b3474c1486" status: 200 len: 1317 microversion: 2.1 time: 0.146446 Aug 24 11:49:09.976404 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 696/1351] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:49:09 2022] GET /compute/v2.1/servers/33e87882-96cf-4d0a-be2c-f0b3474c1486 => generated 1317 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:49:10.166769 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-11c7d54c-5de2-4ca4-a505-3581985d71a4 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:49:10.168510 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-11c7d54c-5de2-4ca4-a505-3581985d71a4 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] [instance: df3120c6-fa78-4576-acb8-7f8565f160b1] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:49:10.178387 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-11c7d54c-5de2-4ca4-a505-3581985d71a4 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:49:10.179300 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-11c7d54c-5de2-4ca4-a505-3581985d71a4 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:49:10.179986 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-11c7d54c-5de2-4ca4-a505-3581985d71a4 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:49:10.181840 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-11c7d54c-5de2-4ca4-a505-3581985d71a4 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:49:10.182810 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-11c7d54c-5de2-4ca4-a505-3581985d71a4 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:49:10.183666 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-11c7d54c-5de2-4ca4-a505-3581985d71a4 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:49:10.562637 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-11c7d54c-5de2-4ca4-a505-3581985d71a4 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7974c9be50c4a05b8d067fa0e4d0a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a2d9f0a96b4c8b82f343ecc8cc26ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:49:10.573114 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-11c7d54c-5de2-4ca4-a505-3581985d71a4 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] 10.222.0.84 "GET /compute/v2.1/servers/df3120c6-fa78-4576-acb8-7f8565f160b1" status: 200 len: 1314 microversion: 2.1 time: 0.411601 Aug 24 11:49:10.584562 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 656/1352] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:49:10 2022] GET /compute/v2.1/servers/df3120c6-fa78-4576-acb8-7f8565f160b1 => generated 1314 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:49:11.002152 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-93585cdc-e2cc-45b4-89dd-cd81e061e239 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:49:11.003739 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-93585cdc-e2cc-45b4-89dd-cd81e061e239 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] [instance: 33e87882-96cf-4d0a-be2c-f0b3474c1486] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:49:11.009925 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-93585cdc-e2cc-45b4-89dd-cd81e061e239 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:49:11.010396 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-93585cdc-e2cc-45b4-89dd-cd81e061e239 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:49:11.011044 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-93585cdc-e2cc-45b4-89dd-cd81e061e239 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:49:11.011744 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-93585cdc-e2cc-45b4-89dd-cd81e061e239 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:49:11.012217 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-93585cdc-e2cc-45b4-89dd-cd81e061e239 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:49:11.012618 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-93585cdc-e2cc-45b4-89dd-cd81e061e239 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:49:11.088218 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-93585cdc-e2cc-45b4-89dd-cd81e061e239 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591708bfed04ac185d4c610e8b76125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a70cdccbcb84216ae61c72d6736bd63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:49:11.097331 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-93585cdc-e2cc-45b4-89dd-cd81e061e239 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] 10.222.0.84 "GET /compute/v2.1/servers/33e87882-96cf-4d0a-be2c-f0b3474c1486" status: 200 len: 1315 microversion: 2.1 time: 0.099057 Aug 24 11:49:11.098139 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 697/1353] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:49:10 2022] GET /compute/v2.1/servers/33e87882-96cf-4d0a-be2c-f0b3474c1486 => generated 1315 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:49:11.612037 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-a05dee12-4a85-4b1b-8d11-0eefeacdd229 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:49:11.612037 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-a05dee12-4a85-4b1b-8d11-0eefeacdd229 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] [instance: df3120c6-fa78-4576-acb8-7f8565f160b1] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:49:11.631355 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a05dee12-4a85-4b1b-8d11-0eefeacdd229 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:49:11.631864 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a05dee12-4a85-4b1b-8d11-0eefeacdd229 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:49:11.632311 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a05dee12-4a85-4b1b-8d11-0eefeacdd229 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:49:11.633105 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a05dee12-4a85-4b1b-8d11-0eefeacdd229 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:49:11.644183 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a05dee12-4a85-4b1b-8d11-0eefeacdd229 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:49:11.645143 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a05dee12-4a85-4b1b-8d11-0eefeacdd229 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:49:12.120213 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-57da2193-2c1a-4bed-a954-5bfc1bab2c15 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:49:12.121143 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-57da2193-2c1a-4bed-a954-5bfc1bab2c15 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] [instance: 33e87882-96cf-4d0a-be2c-f0b3474c1486] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:49:12.132523 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-57da2193-2c1a-4bed-a954-5bfc1bab2c15 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:49:12.132995 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-57da2193-2c1a-4bed-a954-5bfc1bab2c15 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:49:12.133447 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-57da2193-2c1a-4bed-a954-5bfc1bab2c15 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:49:12.138267 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-57da2193-2c1a-4bed-a954-5bfc1bab2c15 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:49:12.139058 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-57da2193-2c1a-4bed-a954-5bfc1bab2c15 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:49:12.139855 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-57da2193-2c1a-4bed-a954-5bfc1bab2c15 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:49:12.151574 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-a05dee12-4a85-4b1b-8d11-0eefeacdd229 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7974c9be50c4a05b8d067fa0e4d0a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a2d9f0a96b4c8b82f343ecc8cc26ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:49:12.184348 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-a05dee12-4a85-4b1b-8d11-0eefeacdd229 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] 10.222.0.84 "GET /compute/v2.1/servers/df3120c6-fa78-4576-acb8-7f8565f160b1" status: 200 len: 1314 microversion: 2.1 time: 0.590489 Aug 24 11:49:12.202494 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 657/1354] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:49:11 2022] GET /compute/v2.1/servers/df3120c6-fa78-4576-acb8-7f8565f160b1 => generated 1314 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:49:12.207364 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG dbcounter [-] [124769] Writing DB stats nova_cell1:SELECT=100 {{(pid=124769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:49:12.461195 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-57da2193-2c1a-4bed-a954-5bfc1bab2c15 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591708bfed04ac185d4c610e8b76125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a70cdccbcb84216ae61c72d6736bd63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:49:12.501440 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-57da2193-2c1a-4bed-a954-5bfc1bab2c15 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] 10.222.0.84 "GET /compute/v2.1/servers/33e87882-96cf-4d0a-be2c-f0b3474c1486" status: 200 len: 1357 microversion: 2.1 time: 0.383312 Aug 24 11:49:12.519735 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 698/1355] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:49:12 2022] GET /compute/v2.1/servers/33e87882-96cf-4d0a-be2c-f0b3474c1486 => generated 1357 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:49:12.644964 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [req-3635dfef-0228-42d0-b36b-c000d07aa491 req-b9f423a4-255e-4c75-9be3-bb8e52af77cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df3120c6-fa78-4576-acb8-7f8565f160b1", "name": "network-vif-plugged", "status": "completed", "tag": "f2ab5dd0-0773-40fa-b50a-a510662962a5"}]} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:49:12.682058 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-3635dfef-0228-42d0-b36b-c000d07aa491 req-b9f423a4-255e-4c75-9be3-bb8e52af77cf service nova] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:49:12.683276 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-3635dfef-0228-42d0-b36b-c000d07aa491 req-b9f423a4-255e-4c75-9be3-bb8e52af77cf service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:49:12.683276 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-3635dfef-0228-42d0-b36b-c000d07aa491 req-b9f423a4-255e-4c75-9be3-bb8e52af77cf service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:49:12.711059 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.compute.server_external_events [req-3635dfef-0228-42d0-b36b-c000d07aa491 req-b9f423a4-255e-4c75-9be3-bb8e52af77cf service nova] Creating event network-vif-plugged:f2ab5dd0-0773-40fa-b50a-a510662962a5 for instance df3120c6-fa78-4576-acb8-7f8565f160b1 on hv-cinder-85427 Aug 24 11:49:12.726701 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [req-3635dfef-0228-42d0-b36b-c000d07aa491 req-b9f423a4-255e-4c75-9be3-bb8e52af77cf service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088390 Aug 24 11:49:12.727936 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 658/1356] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Aug 24 11:49:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:49:13.211812 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-c985d793-69cf-47d0-bb43-623eb5bb50dc tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:49:13.212575 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-c985d793-69cf-47d0-bb43-623eb5bb50dc tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] [instance: df3120c6-fa78-4576-acb8-7f8565f160b1] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:49:13.220478 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-c985d793-69cf-47d0-bb43-623eb5bb50dc tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:49:13.230658 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-c985d793-69cf-47d0-bb43-623eb5bb50dc tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:49:13.232767 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-c985d793-69cf-47d0-bb43-623eb5bb50dc tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:49:13.234329 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-c985d793-69cf-47d0-bb43-623eb5bb50dc tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:49:13.235146 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-c985d793-69cf-47d0-bb43-623eb5bb50dc tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:49:13.235982 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-c985d793-69cf-47d0-bb43-623eb5bb50dc tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:49:13.264222 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [req-5801be14-f8b2-41bb-a081-ad100e43be27 req-69271198-544d-46cb-99ac-b320321d4e4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33e87882-96cf-4d0a-be2c-f0b3474c1486", "tag": "98b115c3-c00e-4062-a2a6-3b720d6da9c7"}]} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:49:13.302192 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-5801be14-f8b2-41bb-a081-ad100e43be27 req-69271198-544d-46cb-99ac-b320321d4e4f service nova] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:49:13.304059 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-5801be14-f8b2-41bb-a081-ad100e43be27 req-69271198-544d-46cb-99ac-b320321d4e4f service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:49:13.304780 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-5801be14-f8b2-41bb-a081-ad100e43be27 req-69271198-544d-46cb-99ac-b320321d4e4f service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:49:13.332350 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.compute.server_external_events [req-5801be14-f8b2-41bb-a081-ad100e43be27 req-69271198-544d-46cb-99ac-b320321d4e4f service nova] Creating event network-changed:98b115c3-c00e-4062-a2a6-3b720d6da9c7 for instance 33e87882-96cf-4d0a-be2c-f0b3474c1486 on hv-cinder-85427 Aug 24 11:49:13.354593 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [req-5801be14-f8b2-41bb-a081-ad100e43be27 req-69271198-544d-46cb-99ac-b320321d4e4f service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095138 Aug 24 11:49:13.356230 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 659/1357] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Aug 24 11:49:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:49:13.511662 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-c985d793-69cf-47d0-bb43-623eb5bb50dc tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7974c9be50c4a05b8d067fa0e4d0a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a2d9f0a96b4c8b82f343ecc8cc26ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:49:13.524132 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-c985d793-69cf-47d0-bb43-623eb5bb50dc tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] 10.222.0.84 "GET /compute/v2.1/servers/df3120c6-fa78-4576-acb8-7f8565f160b1" status: 200 len: 1314 microversion: 2.1 time: 0.316374 Aug 24 11:49:13.540977 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 699/1358] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:49:13 2022] GET /compute/v2.1/servers/df3120c6-fa78-4576-acb8-7f8565f160b1 => generated 1314 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:49:13.547952 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-4ce5ff8a-78b7-44ba-ad21-513d1aeb7b02 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:49:13.550106 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-4ce5ff8a-78b7-44ba-ad21-513d1aeb7b02 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] [instance: 33e87882-96cf-4d0a-be2c-f0b3474c1486] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:49:13.574546 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4ce5ff8a-78b7-44ba-ad21-513d1aeb7b02 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:49:13.575348 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4ce5ff8a-78b7-44ba-ad21-513d1aeb7b02 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:49:13.577693 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4ce5ff8a-78b7-44ba-ad21-513d1aeb7b02 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:49:13.578732 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4ce5ff8a-78b7-44ba-ad21-513d1aeb7b02 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:49:13.579468 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4ce5ff8a-78b7-44ba-ad21-513d1aeb7b02 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:49:13.581562 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4ce5ff8a-78b7-44ba-ad21-513d1aeb7b02 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:49:13.983595 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-4ce5ff8a-78b7-44ba-ad21-513d1aeb7b02 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591708bfed04ac185d4c610e8b76125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a70cdccbcb84216ae61c72d6736bd63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:49:14.035913 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-4ce5ff8a-78b7-44ba-ad21-513d1aeb7b02 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] 10.222.0.84 "GET /compute/v2.1/servers/33e87882-96cf-4d0a-be2c-f0b3474c1486" status: 200 len: 1357 microversion: 2.1 time: 0.504737 Aug 24 11:49:14.050915 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 660/1359] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:49:13 2022] GET /compute/v2.1/servers/33e87882-96cf-4d0a-be2c-f0b3474c1486 => generated 1357 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:49:14.555667 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-7ad21cee-a332-4889-b612-f148d02d469e tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:49:14.557388 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-7ad21cee-a332-4889-b612-f148d02d469e tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] [instance: df3120c6-fa78-4576-acb8-7f8565f160b1] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:49:14.566260 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-7ad21cee-a332-4889-b612-f148d02d469e tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:49:14.567382 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-7ad21cee-a332-4889-b612-f148d02d469e tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:49:14.567818 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-7ad21cee-a332-4889-b612-f148d02d469e tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:49:14.568551 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-7ad21cee-a332-4889-b612-f148d02d469e tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:49:14.569108 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-7ad21cee-a332-4889-b612-f148d02d469e tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:49:14.569742 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-7ad21cee-a332-4889-b612-f148d02d469e tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:49:14.786025 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-7ad21cee-a332-4889-b612-f148d02d469e tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7974c9be50c4a05b8d067fa0e4d0a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a2d9f0a96b4c8b82f343ecc8cc26ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:49:14.799693 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-7ad21cee-a332-4889-b612-f148d02d469e tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] 10.222.0.84 "GET /compute/v2.1/servers/df3120c6-fa78-4576-acb8-7f8565f160b1" status: 200 len: 1314 microversion: 2.1 time: 0.249196 Aug 24 11:49:14.801842 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 700/1360] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:49:14 2022] GET /compute/v2.1/servers/df3120c6-fa78-4576-acb8-7f8565f160b1 => generated 1314 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:49:15.061762 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-0b952cba-c3a7-4a48-9cd7-39e8e4a17bbd tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:49:15.063647 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-0b952cba-c3a7-4a48-9cd7-39e8e4a17bbd tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] [instance: 33e87882-96cf-4d0a-be2c-f0b3474c1486] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:49:15.077183 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-0b952cba-c3a7-4a48-9cd7-39e8e4a17bbd tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:49:15.077664 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-0b952cba-c3a7-4a48-9cd7-39e8e4a17bbd tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:49:15.078195 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-0b952cba-c3a7-4a48-9cd7-39e8e4a17bbd tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:49:15.079012 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-0b952cba-c3a7-4a48-9cd7-39e8e4a17bbd tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:49:15.079610 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-0b952cba-c3a7-4a48-9cd7-39e8e4a17bbd tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:49:15.080147 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-0b952cba-c3a7-4a48-9cd7-39e8e4a17bbd tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:49:15.244244 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-0b952cba-c3a7-4a48-9cd7-39e8e4a17bbd tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591708bfed04ac185d4c610e8b76125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a70cdccbcb84216ae61c72d6736bd63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:49:15.256454 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-0b952cba-c3a7-4a48-9cd7-39e8e4a17bbd tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] 10.222.0.84 "GET /compute/v2.1/servers/33e87882-96cf-4d0a-be2c-f0b3474c1486" status: 200 len: 1357 microversion: 2.1 time: 0.201088 Aug 24 11:49:15.257162 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 661/1361] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:49:15 2022] GET /compute/v2.1/servers/33e87882-96cf-4d0a-be2c-f0b3474c1486 => generated 1357 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:49:15.823185 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-4284e809-54a5-442b-b215-e4d7f038aec3 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:49:15.823844 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-4284e809-54a5-442b-b215-e4d7f038aec3 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] [instance: df3120c6-fa78-4576-acb8-7f8565f160b1] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:49:15.831081 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-4284e809-54a5-442b-b215-e4d7f038aec3 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:49:15.831562 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-4284e809-54a5-442b-b215-e4d7f038aec3 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:49:15.832000 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-4284e809-54a5-442b-b215-e4d7f038aec3 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:49:15.832685 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-4284e809-54a5-442b-b215-e4d7f038aec3 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:49:15.833166 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-4284e809-54a5-442b-b215-e4d7f038aec3 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:49:15.833586 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-4284e809-54a5-442b-b215-e4d7f038aec3 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:49:16.003736 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-4284e809-54a5-442b-b215-e4d7f038aec3 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7974c9be50c4a05b8d067fa0e4d0a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a2d9f0a96b4c8b82f343ecc8cc26ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:49:16.012340 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-4284e809-54a5-442b-b215-e4d7f038aec3 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] 10.222.0.84 "GET /compute/v2.1/servers/df3120c6-fa78-4576-acb8-7f8565f160b1" status: 200 len: 1314 microversion: 2.1 time: 0.193012 Aug 24 11:49:16.013652 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 701/1362] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:49:15 2022] GET /compute/v2.1/servers/df3120c6-fa78-4576-acb8-7f8565f160b1 => generated 1314 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:49:16.279965 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-e8a05a69-519e-4118-bd0c-35f2918ebd35 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:49:16.281408 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-e8a05a69-519e-4118-bd0c-35f2918ebd35 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] [instance: 33e87882-96cf-4d0a-be2c-f0b3474c1486] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:49:16.299436 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_cell0:SELECT=2 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:49:16.301507 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e8a05a69-519e-4118-bd0c-35f2918ebd35 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:49:16.302129 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e8a05a69-519e-4118-bd0c-35f2918ebd35 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:49:16.302784 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e8a05a69-519e-4118-bd0c-35f2918ebd35 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:49:16.303534 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e8a05a69-519e-4118-bd0c-35f2918ebd35 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:49:16.304014 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e8a05a69-519e-4118-bd0c-35f2918ebd35 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:49:16.304574 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e8a05a69-519e-4118-bd0c-35f2918ebd35 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:49:16.313744 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_cell0:SELECT=6 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:49:16.556041 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-e8a05a69-519e-4118-bd0c-35f2918ebd35 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591708bfed04ac185d4c610e8b76125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a70cdccbcb84216ae61c72d6736bd63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:49:16.568785 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-e8a05a69-519e-4118-bd0c-35f2918ebd35 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] 10.222.0.84 "GET /compute/v2.1/servers/33e87882-96cf-4d0a-be2c-f0b3474c1486" status: 200 len: 1357 microversion: 2.1 time: 0.293672 Aug 24 11:49:16.569509 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 662/1363] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:49:16 2022] GET /compute/v2.1/servers/33e87882-96cf-4d0a-be2c-f0b3474c1486 => generated 1357 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:49:17.036279 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-104c2621-eeda-4e90-806b-6f63a351cfda tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:49:17.037230 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-104c2621-eeda-4e90-806b-6f63a351cfda tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] [instance: df3120c6-fa78-4576-acb8-7f8565f160b1] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:49:17.045299 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-104c2621-eeda-4e90-806b-6f63a351cfda tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:49:17.047268 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-104c2621-eeda-4e90-806b-6f63a351cfda tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:49:17.047268 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-104c2621-eeda-4e90-806b-6f63a351cfda tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:49:17.047268 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-104c2621-eeda-4e90-806b-6f63a351cfda tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:49:17.056318 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-104c2621-eeda-4e90-806b-6f63a351cfda tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:49:17.056780 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-104c2621-eeda-4e90-806b-6f63a351cfda tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:49:17.393470 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-104c2621-eeda-4e90-806b-6f63a351cfda tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7974c9be50c4a05b8d067fa0e4d0a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a2d9f0a96b4c8b82f343ecc8cc26ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:49:17.416911 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-104c2621-eeda-4e90-806b-6f63a351cfda tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] 10.222.0.84 "GET /compute/v2.1/servers/df3120c6-fa78-4576-acb8-7f8565f160b1" status: 200 len: 1464 microversion: 2.1 time: 0.385363 Aug 24 11:49:17.418244 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 702/1364] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:49:17 2022] GET /compute/v2.1/servers/df3120c6-fa78-4576-acb8-7f8565f160b1 => generated 1464 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:49:17.507314 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-b9388e8a-9af1-4ddc-8e94-7190cb3033d8 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:49:17.508457 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-b9388e8a-9af1-4ddc-8e94-7190cb3033d8 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] [instance: df3120c6-fa78-4576-acb8-7f8565f160b1] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:49:17.519921 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b9388e8a-9af1-4ddc-8e94-7190cb3033d8 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:49:17.522746 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b9388e8a-9af1-4ddc-8e94-7190cb3033d8 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:49:17.522746 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b9388e8a-9af1-4ddc-8e94-7190cb3033d8 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:49:17.523368 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b9388e8a-9af1-4ddc-8e94-7190cb3033d8 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:49:17.524389 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b9388e8a-9af1-4ddc-8e94-7190cb3033d8 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:49:17.525387 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b9388e8a-9af1-4ddc-8e94-7190cb3033d8 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:49:17.578546 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-b9388e8a-9af1-4ddc-8e94-7190cb3033d8 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] [instance: df3120c6-fa78-4576-acb8-7f8565f160b1] Going to try to terminate instance {{(pid=124770) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 11:49:17.605584 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-c0727449-10fa-4206-bd8a-935398d44908 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:49:17.606709 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-c0727449-10fa-4206-bd8a-935398d44908 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] [instance: 33e87882-96cf-4d0a-be2c-f0b3474c1486] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:49:17.621362 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-c0727449-10fa-4206-bd8a-935398d44908 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:49:17.622241 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-c0727449-10fa-4206-bd8a-935398d44908 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:49:17.631318 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-c0727449-10fa-4206-bd8a-935398d44908 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:49:17.633507 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-c0727449-10fa-4206-bd8a-935398d44908 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:49:17.635159 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-c0727449-10fa-4206-bd8a-935398d44908 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:49:17.636193 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-c0727449-10fa-4206-bd8a-935398d44908 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:49:17.690273 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG dbcounter [-] [124769] Writing DB stats nova_cell0:SELECT=8 {{(pid=124769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:49:17.997686 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-c0727449-10fa-4206-bd8a-935398d44908 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591708bfed04ac185d4c610e8b76125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a70cdccbcb84216ae61c72d6736bd63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:49:18.024389 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-c0727449-10fa-4206-bd8a-935398d44908 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] 10.222.0.84 "GET /compute/v2.1/servers/33e87882-96cf-4d0a-be2c-f0b3474c1486" status: 200 len: 1357 microversion: 2.1 time: 0.428847 Aug 24 11:49:18.041484 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 703/1365] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:49:17 2022] GET /compute/v2.1/servers/33e87882-96cf-4d0a-be2c-f0b3474c1486 => generated 1357 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:49:18.899911 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-b9388e8a-9af1-4ddc-8e94-7190cb3033d8 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] 10.222.0.84 "DELETE /compute/v2.1/servers/df3120c6-fa78-4576-acb8-7f8565f160b1" status: 204 len: 0 microversion: 2.1 time: 1.330113 Aug 24 11:49:18.899911 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 663/1366] 10.222.0.84 () {58 vars in 1239 bytes} [Wed Aug 24 11:49:17 2022] DELETE /compute/v2.1/servers/df3120c6-fa78-4576-acb8-7f8565f160b1 => generated 0 bytes in 1332 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 11:49:18.900914 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-0df70512-7867-4774-9dc9-5381448081e5 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:49:18.900914 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-0df70512-7867-4774-9dc9-5381448081e5 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] [instance: df3120c6-fa78-4576-acb8-7f8565f160b1] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:49:18.900914 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-0df70512-7867-4774-9dc9-5381448081e5 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:49:18.900914 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-0df70512-7867-4774-9dc9-5381448081e5 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:49:18.901344 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-0df70512-7867-4774-9dc9-5381448081e5 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:49:18.901344 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-0df70512-7867-4774-9dc9-5381448081e5 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:49:18.901344 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-0df70512-7867-4774-9dc9-5381448081e5 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:49:18.901344 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-0df70512-7867-4774-9dc9-5381448081e5 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:49:19.085273 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-15734188-a208-43e7-94f2-06aa687e793a tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:49:19.093191 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-15734188-a208-43e7-94f2-06aa687e793a tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] [instance: 33e87882-96cf-4d0a-be2c-f0b3474c1486] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:49:19.133263 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-15734188-a208-43e7-94f2-06aa687e793a tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:49:19.133841 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-15734188-a208-43e7-94f2-06aa687e793a tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:49:19.144204 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-15734188-a208-43e7-94f2-06aa687e793a tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:49:19.145201 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-15734188-a208-43e7-94f2-06aa687e793a tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:49:19.146042 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-15734188-a208-43e7-94f2-06aa687e793a tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:49:19.146656 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-15734188-a208-43e7-94f2-06aa687e793a tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:49:19.217794 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-0df70512-7867-4774-9dc9-5381448081e5 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7974c9be50c4a05b8d067fa0e4d0a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a2d9f0a96b4c8b82f343ecc8cc26ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:49:19.226471 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-0df70512-7867-4774-9dc9-5381448081e5 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] 10.222.0.84 "GET /compute/v2.1/servers/df3120c6-fa78-4576-acb8-7f8565f160b1" status: 200 len: 1470 microversion: 2.1 time: 0.393363 Aug 24 11:49:19.227415 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 704/1367] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:49:18 2022] GET /compute/v2.1/servers/df3120c6-fa78-4576-acb8-7f8565f160b1 => generated 1470 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:49:19.453081 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-15734188-a208-43e7-94f2-06aa687e793a tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591708bfed04ac185d4c610e8b76125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a70cdccbcb84216ae61c72d6736bd63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:49:19.469528 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-15734188-a208-43e7-94f2-06aa687e793a tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] 10.222.0.84 "GET /compute/v2.1/servers/33e87882-96cf-4d0a-be2c-f0b3474c1486" status: 200 len: 1357 microversion: 2.1 time: 0.412158 Aug 24 11:49:19.470816 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 664/1368] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:49:19 2022] GET /compute/v2.1/servers/33e87882-96cf-4d0a-be2c-f0b3474c1486 => generated 1357 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:49:20.258309 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-26c5a979-258c-479a-ae6e-8a2d96e66c1b tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:49:20.259039 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-26c5a979-258c-479a-ae6e-8a2d96e66c1b tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] [instance: df3120c6-fa78-4576-acb8-7f8565f160b1] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:49:20.271294 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-26c5a979-258c-479a-ae6e-8a2d96e66c1b tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:49:20.272418 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-26c5a979-258c-479a-ae6e-8a2d96e66c1b tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:49:20.273332 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-26c5a979-258c-479a-ae6e-8a2d96e66c1b tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:49:20.274741 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-26c5a979-258c-479a-ae6e-8a2d96e66c1b tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:49:20.275978 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-26c5a979-258c-479a-ae6e-8a2d96e66c1b tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:49:20.277103 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-26c5a979-258c-479a-ae6e-8a2d96e66c1b tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:49:20.494922 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-73185054-3578-4a39-9a85-70b6bc7df333 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:49:20.495863 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-73185054-3578-4a39-9a85-70b6bc7df333 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] [instance: 33e87882-96cf-4d0a-be2c-f0b3474c1486] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:49:20.504235 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-73185054-3578-4a39-9a85-70b6bc7df333 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:49:20.504887 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-73185054-3578-4a39-9a85-70b6bc7df333 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:49:20.507816 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-73185054-3578-4a39-9a85-70b6bc7df333 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:49:20.508667 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-73185054-3578-4a39-9a85-70b6bc7df333 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:49:20.509173 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-73185054-3578-4a39-9a85-70b6bc7df333 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:49:20.512344 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-73185054-3578-4a39-9a85-70b6bc7df333 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:49:20.525425 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-26c5a979-258c-479a-ae6e-8a2d96e66c1b tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7974c9be50c4a05b8d067fa0e4d0a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a2d9f0a96b4c8b82f343ecc8cc26ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:49:20.534819 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-26c5a979-258c-479a-ae6e-8a2d96e66c1b tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] 10.222.0.84 "GET /compute/v2.1/servers/df3120c6-fa78-4576-acb8-7f8565f160b1" status: 200 len: 1470 microversion: 2.1 time: 0.281960 Aug 24 11:49:20.536412 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 705/1369] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:49:20 2022] GET /compute/v2.1/servers/df3120c6-fa78-4576-acb8-7f8565f160b1 => generated 1470 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:49:20.745116 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-73185054-3578-4a39-9a85-70b6bc7df333 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591708bfed04ac185d4c610e8b76125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a70cdccbcb84216ae61c72d6736bd63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:49:20.757587 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-73185054-3578-4a39-9a85-70b6bc7df333 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] 10.222.0.84 "GET /compute/v2.1/servers/33e87882-96cf-4d0a-be2c-f0b3474c1486" status: 200 len: 1357 microversion: 2.1 time: 0.266481 Aug 24 11:49:20.775621 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 665/1370] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:49:20 2022] GET /compute/v2.1/servers/33e87882-96cf-4d0a-be2c-f0b3474c1486 => generated 1357 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:49:21.557836 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-4bfd55d4-e7c2-4529-8f86-2ac745f76928 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:49:21.574267 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-4bfd55d4-e7c2-4529-8f86-2ac745f76928 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] [instance: df3120c6-fa78-4576-acb8-7f8565f160b1] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:49:21.596660 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-4bfd55d4-e7c2-4529-8f86-2ac745f76928 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:49:21.598843 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-4bfd55d4-e7c2-4529-8f86-2ac745f76928 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:49:21.599592 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-4bfd55d4-e7c2-4529-8f86-2ac745f76928 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:49:21.601127 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-4bfd55d4-e7c2-4529-8f86-2ac745f76928 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:49:21.602411 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-4bfd55d4-e7c2-4529-8f86-2ac745f76928 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:49:21.603988 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-4bfd55d4-e7c2-4529-8f86-2ac745f76928 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:49:21.793564 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-de70f4ed-73d3-4390-9d25-85aefd5c670d tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:49:21.801711 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-de70f4ed-73d3-4390-9d25-85aefd5c670d tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] [instance: 33e87882-96cf-4d0a-be2c-f0b3474c1486] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:49:21.827033 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-de70f4ed-73d3-4390-9d25-85aefd5c670d tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:49:21.830258 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-de70f4ed-73d3-4390-9d25-85aefd5c670d tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:49:21.831764 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-de70f4ed-73d3-4390-9d25-85aefd5c670d tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:49:21.833872 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-de70f4ed-73d3-4390-9d25-85aefd5c670d tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:49:21.835378 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-de70f4ed-73d3-4390-9d25-85aefd5c670d tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:49:21.836957 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-de70f4ed-73d3-4390-9d25-85aefd5c670d tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:49:21.953753 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-4bfd55d4-e7c2-4529-8f86-2ac745f76928 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7974c9be50c4a05b8d067fa0e4d0a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a2d9f0a96b4c8b82f343ecc8cc26ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:49:21.963993 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-4bfd55d4-e7c2-4529-8f86-2ac745f76928 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] 10.222.0.84 "GET /compute/v2.1/servers/df3120c6-fa78-4576-acb8-7f8565f160b1" status: 200 len: 1470 microversion: 2.1 time: 0.410541 Aug 24 11:49:21.966922 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 706/1371] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:49:21 2022] GET /compute/v2.1/servers/df3120c6-fa78-4576-acb8-7f8565f160b1 => generated 1470 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:49:22.156891 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-de70f4ed-73d3-4390-9d25-85aefd5c670d tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591708bfed04ac185d4c610e8b76125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a70cdccbcb84216ae61c72d6736bd63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:49:22.164885 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:49:22.179441 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-de70f4ed-73d3-4390-9d25-85aefd5c670d tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] 10.222.0.84 "GET /compute/v2.1/servers/33e87882-96cf-4d0a-be2c-f0b3474c1486" status: 200 len: 1357 microversion: 2.1 time: 0.390889 Aug 24 11:49:22.184574 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 666/1372] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:49:21 2022] GET /compute/v2.1/servers/33e87882-96cf-4d0a-be2c-f0b3474c1486 => generated 1357 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:49:22.990515 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-9343010b-e707-4c57-a301-bd2cd60d3513 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:49:22.993826 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-9343010b-e707-4c57-a301-bd2cd60d3513 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] [instance: df3120c6-fa78-4576-acb8-7f8565f160b1] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:49:23.011915 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-9343010b-e707-4c57-a301-bd2cd60d3513 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:49:23.016034 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-9343010b-e707-4c57-a301-bd2cd60d3513 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:49:23.020462 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-9343010b-e707-4c57-a301-bd2cd60d3513 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:49:23.021840 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-9343010b-e707-4c57-a301-bd2cd60d3513 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:49:23.025312 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-9343010b-e707-4c57-a301-bd2cd60d3513 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:49:23.027703 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-9343010b-e707-4c57-a301-bd2cd60d3513 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:49:23.213028 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-9a0fd4e8-c7ff-4919-9bb8-044f6d97674e tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:49:23.213718 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-9a0fd4e8-c7ff-4919-9bb8-044f6d97674e tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] [instance: 33e87882-96cf-4d0a-be2c-f0b3474c1486] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:49:23.224158 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9a0fd4e8-c7ff-4919-9bb8-044f6d97674e tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:49:23.224158 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9a0fd4e8-c7ff-4919-9bb8-044f6d97674e tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:49:23.230655 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9a0fd4e8-c7ff-4919-9bb8-044f6d97674e tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:49:23.230655 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9a0fd4e8-c7ff-4919-9bb8-044f6d97674e tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:49:23.230655 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9a0fd4e8-c7ff-4919-9bb8-044f6d97674e tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:49:23.230655 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9a0fd4e8-c7ff-4919-9bb8-044f6d97674e tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:49:23.254213 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-9343010b-e707-4c57-a301-bd2cd60d3513 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7974c9be50c4a05b8d067fa0e4d0a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a2d9f0a96b4c8b82f343ecc8cc26ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:49:23.263811 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-9343010b-e707-4c57-a301-bd2cd60d3513 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] 10.222.0.84 "GET /compute/v2.1/servers/df3120c6-fa78-4576-acb8-7f8565f160b1" status: 200 len: 1470 microversion: 2.1 time: 0.280133 Aug 24 11:49:23.264843 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 707/1373] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:49:22 2022] GET /compute/v2.1/servers/df3120c6-fa78-4576-acb8-7f8565f160b1 => generated 1470 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:49:23.446077 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-9a0fd4e8-c7ff-4919-9bb8-044f6d97674e tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591708bfed04ac185d4c610e8b76125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a70cdccbcb84216ae61c72d6736bd63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:49:23.455662 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-9a0fd4e8-c7ff-4919-9bb8-044f6d97674e tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] 10.222.0.84 "GET /compute/v2.1/servers/33e87882-96cf-4d0a-be2c-f0b3474c1486" status: 200 len: 1357 microversion: 2.1 time: 0.247129 Aug 24 11:49:23.456247 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 667/1374] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:49:23 2022] GET /compute/v2.1/servers/33e87882-96cf-4d0a-be2c-f0b3474c1486 => generated 1357 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:49:24.291417 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-0cd1d8c9-3a54-4b26-8a92-b7b181477491 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:49:24.292871 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-0cd1d8c9-3a54-4b26-8a92-b7b181477491 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] [instance: df3120c6-fa78-4576-acb8-7f8565f160b1] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:49:24.302254 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG dbcounter [-] [124769] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=1 {{(pid=124769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:49:24.304433 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-0cd1d8c9-3a54-4b26-8a92-b7b181477491 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:49:24.305205 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-0cd1d8c9-3a54-4b26-8a92-b7b181477491 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:49:24.306020 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-0cd1d8c9-3a54-4b26-8a92-b7b181477491 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:49:24.306988 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-0cd1d8c9-3a54-4b26-8a92-b7b181477491 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:49:24.307662 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-0cd1d8c9-3a54-4b26-8a92-b7b181477491 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:49:24.308273 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-0cd1d8c9-3a54-4b26-8a92-b7b181477491 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:49:24.477778 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-70cad285-84a6-4d19-a506-f10a9c02b9fb tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:49:24.479428 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-70cad285-84a6-4d19-a506-f10a9c02b9fb tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] [instance: 33e87882-96cf-4d0a-be2c-f0b3474c1486] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:49:24.482311 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:49:24.501511 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-70cad285-84a6-4d19-a506-f10a9c02b9fb tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:49:24.503674 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-70cad285-84a6-4d19-a506-f10a9c02b9fb tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:49:24.504691 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-70cad285-84a6-4d19-a506-f10a9c02b9fb tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:49:24.506671 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-70cad285-84a6-4d19-a506-f10a9c02b9fb tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:49:24.507335 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-70cad285-84a6-4d19-a506-f10a9c02b9fb tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:49:24.514314 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-70cad285-84a6-4d19-a506-f10a9c02b9fb tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:49:24.554848 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-0cd1d8c9-3a54-4b26-8a92-b7b181477491 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7974c9be50c4a05b8d067fa0e4d0a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a2d9f0a96b4c8b82f343ecc8cc26ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:49:24.586707 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-0cd1d8c9-3a54-4b26-8a92-b7b181477491 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] 10.222.0.84 "GET /compute/v2.1/servers/df3120c6-fa78-4576-acb8-7f8565f160b1" status: 200 len: 1470 microversion: 2.1 time: 0.297930 Aug 24 11:49:24.594952 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 708/1375] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:49:24 2022] GET /compute/v2.1/servers/df3120c6-fa78-4576-acb8-7f8565f160b1 => generated 1470 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:49:24.793377 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-70cad285-84a6-4d19-a506-f10a9c02b9fb tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591708bfed04ac185d4c610e8b76125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a70cdccbcb84216ae61c72d6736bd63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:49:24.818804 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-70cad285-84a6-4d19-a506-f10a9c02b9fb tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] 10.222.0.84 "GET /compute/v2.1/servers/33e87882-96cf-4d0a-be2c-f0b3474c1486" status: 200 len: 1357 microversion: 2.1 time: 0.345997 Aug 24 11:49:24.819867 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 668/1376] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:49:24 2022] GET /compute/v2.1/servers/33e87882-96cf-4d0a-be2c-f0b3474c1486 => generated 1357 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:49:25.614047 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-a9dca32c-9dc8-48f4-bdd3-f287e4b0097c tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:49:25.615506 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-a9dca32c-9dc8-48f4-bdd3-f287e4b0097c tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] [instance: df3120c6-fa78-4576-acb8-7f8565f160b1] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:49:25.632763 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-a9dca32c-9dc8-48f4-bdd3-f287e4b0097c tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:49:25.633218 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-a9dca32c-9dc8-48f4-bdd3-f287e4b0097c tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:49:25.633786 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-a9dca32c-9dc8-48f4-bdd3-f287e4b0097c tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:49:25.634664 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-a9dca32c-9dc8-48f4-bdd3-f287e4b0097c tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:49:25.645423 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-a9dca32c-9dc8-48f4-bdd3-f287e4b0097c tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:49:25.646292 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-a9dca32c-9dc8-48f4-bdd3-f287e4b0097c tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:49:25.848737 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-35787f09-9ea5-4774-9fd7-5157b27eeef1 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:49:25.850101 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-35787f09-9ea5-4774-9fd7-5157b27eeef1 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] [instance: 33e87882-96cf-4d0a-be2c-f0b3474c1486] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:49:25.874114 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-35787f09-9ea5-4774-9fd7-5157b27eeef1 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:49:25.874114 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-35787f09-9ea5-4774-9fd7-5157b27eeef1 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:49:25.874114 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-35787f09-9ea5-4774-9fd7-5157b27eeef1 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:49:25.874778 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-35787f09-9ea5-4774-9fd7-5157b27eeef1 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:49:25.875247 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-35787f09-9ea5-4774-9fd7-5157b27eeef1 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:49:25.875671 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-35787f09-9ea5-4774-9fd7-5157b27eeef1 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:49:26.040531 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-a9dca32c-9dc8-48f4-bdd3-f287e4b0097c tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7974c9be50c4a05b8d067fa0e4d0a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a2d9f0a96b4c8b82f343ecc8cc26ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:49:26.084902 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-a9dca32c-9dc8-48f4-bdd3-f287e4b0097c tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] 10.222.0.84 "GET /compute/v2.1/servers/df3120c6-fa78-4576-acb8-7f8565f160b1" status: 200 len: 1470 microversion: 2.1 time: 0.475316 Aug 24 11:49:26.091352 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 709/1377] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:49:25 2022] GET /compute/v2.1/servers/df3120c6-fa78-4576-acb8-7f8565f160b1 => generated 1470 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:49:26.163556 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-35787f09-9ea5-4774-9fd7-5157b27eeef1 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591708bfed04ac185d4c610e8b76125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a70cdccbcb84216ae61c72d6736bd63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:49:26.177967 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-35787f09-9ea5-4774-9fd7-5157b27eeef1 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] 10.222.0.84 "GET /compute/v2.1/servers/33e87882-96cf-4d0a-be2c-f0b3474c1486" status: 200 len: 1357 microversion: 2.1 time: 0.333226 Aug 24 11:49:26.180078 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 669/1378] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:49:25 2022] GET /compute/v2.1/servers/33e87882-96cf-4d0a-be2c-f0b3474c1486 => generated 1357 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:49:27.108986 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-2d38f6fc-bbdf-4b65-9134-629280a85fb6 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:49:27.109676 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-2d38f6fc-bbdf-4b65-9134-629280a85fb6 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] [instance: df3120c6-fa78-4576-acb8-7f8565f160b1] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:49:27.116645 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-2d38f6fc-bbdf-4b65-9134-629280a85fb6 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:49:27.117279 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-2d38f6fc-bbdf-4b65-9134-629280a85fb6 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:49:27.117721 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-2d38f6fc-bbdf-4b65-9134-629280a85fb6 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:49:27.118451 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-2d38f6fc-bbdf-4b65-9134-629280a85fb6 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:49:27.118932 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-2d38f6fc-bbdf-4b65-9134-629280a85fb6 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:49:27.119387 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-2d38f6fc-bbdf-4b65-9134-629280a85fb6 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:49:27.207874 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-e61cf409-6d36-4959-91b2-690456727c29 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:49:27.210378 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-e61cf409-6d36-4959-91b2-690456727c29 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] [instance: 33e87882-96cf-4d0a-be2c-f0b3474c1486] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:49:27.222792 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e61cf409-6d36-4959-91b2-690456727c29 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:49:27.224203 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e61cf409-6d36-4959-91b2-690456727c29 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:49:27.225350 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e61cf409-6d36-4959-91b2-690456727c29 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:49:27.226921 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e61cf409-6d36-4959-91b2-690456727c29 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:49:27.228062 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e61cf409-6d36-4959-91b2-690456727c29 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:49:27.229214 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e61cf409-6d36-4959-91b2-690456727c29 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:49:27.412394 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-2d38f6fc-bbdf-4b65-9134-629280a85fb6 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7974c9be50c4a05b8d067fa0e4d0a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a2d9f0a96b4c8b82f343ecc8cc26ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:49:27.423004 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-2d38f6fc-bbdf-4b65-9134-629280a85fb6 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] 10.222.0.84 "GET /compute/v2.1/servers/df3120c6-fa78-4576-acb8-7f8565f160b1" status: 200 len: 1470 microversion: 2.1 time: 0.319096 Aug 24 11:49:27.434207 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 710/1379] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:49:27 2022] GET /compute/v2.1/servers/df3120c6-fa78-4576-acb8-7f8565f160b1 => generated 1470 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:49:27.464647 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-e61cf409-6d36-4959-91b2-690456727c29 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591708bfed04ac185d4c610e8b76125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a70cdccbcb84216ae61c72d6736bd63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:49:27.477745 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-e61cf409-6d36-4959-91b2-690456727c29 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] 10.222.0.84 "GET /compute/v2.1/servers/33e87882-96cf-4d0a-be2c-f0b3474c1486" status: 200 len: 1357 microversion: 2.1 time: 0.278597 Aug 24 11:49:27.478519 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 670/1380] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:49:27 2022] GET /compute/v2.1/servers/33e87882-96cf-4d0a-be2c-f0b3474c1486 => generated 1357 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:49:28.457628 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-de6de0fd-38ab-48ac-b944-40774a530a36 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:49:28.457628 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-de6de0fd-38ab-48ac-b944-40774a530a36 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] [instance: df3120c6-fa78-4576-acb8-7f8565f160b1] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:49:28.457628 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-de6de0fd-38ab-48ac-b944-40774a530a36 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:49:28.457628 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-de6de0fd-38ab-48ac-b944-40774a530a36 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:49:28.458342 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-de6de0fd-38ab-48ac-b944-40774a530a36 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:49:28.458342 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-de6de0fd-38ab-48ac-b944-40774a530a36 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:49:28.458342 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-de6de0fd-38ab-48ac-b944-40774a530a36 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:49:28.458342 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-de6de0fd-38ab-48ac-b944-40774a530a36 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:49:28.506925 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-3fe5046a-c610-414b-af2c-eeea01be187f tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:49:28.506925 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-3fe5046a-c610-414b-af2c-eeea01be187f tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] [instance: 33e87882-96cf-4d0a-be2c-f0b3474c1486] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:49:28.507936 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-3fe5046a-c610-414b-af2c-eeea01be187f tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:49:28.508430 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-3fe5046a-c610-414b-af2c-eeea01be187f tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:49:28.508885 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-3fe5046a-c610-414b-af2c-eeea01be187f tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:49:28.509584 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-3fe5046a-c610-414b-af2c-eeea01be187f tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:49:28.510061 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-3fe5046a-c610-414b-af2c-eeea01be187f tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:49:28.510480 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-3fe5046a-c610-414b-af2c-eeea01be187f tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:49:28.600699 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-de6de0fd-38ab-48ac-b944-40774a530a36 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7974c9be50c4a05b8d067fa0e4d0a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a2d9f0a96b4c8b82f343ecc8cc26ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:49:28.609151 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-de6de0fd-38ab-48ac-b944-40774a530a36 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] 10.222.0.84 "GET /compute/v2.1/servers/df3120c6-fa78-4576-acb8-7f8565f160b1" status: 200 len: 1470 microversion: 2.1 time: 0.166905 Aug 24 11:49:28.615923 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 711/1381] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:49:28 2022] GET /compute/v2.1/servers/df3120c6-fa78-4576-acb8-7f8565f160b1 => generated 1470 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:49:28.659612 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-3fe5046a-c610-414b-af2c-eeea01be187f tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591708bfed04ac185d4c610e8b76125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a70cdccbcb84216ae61c72d6736bd63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:49:28.667545 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-3fe5046a-c610-414b-af2c-eeea01be187f tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] 10.222.0.84 "GET /compute/v2.1/servers/33e87882-96cf-4d0a-be2c-f0b3474c1486" status: 200 len: 1357 microversion: 2.1 time: 0.171654 Aug 24 11:49:28.668110 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 671/1382] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:49:28 2022] GET /compute/v2.1/servers/33e87882-96cf-4d0a-be2c-f0b3474c1486 => generated 1357 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:49:29.631084 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-7fb5ef9b-9214-4462-807f-841d872f8aac tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:49:29.631704 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-7fb5ef9b-9214-4462-807f-841d872f8aac tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] [instance: df3120c6-fa78-4576-acb8-7f8565f160b1] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:49:29.644752 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-7fb5ef9b-9214-4462-807f-841d872f8aac tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:49:29.644752 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-7fb5ef9b-9214-4462-807f-841d872f8aac tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:49:29.644752 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-7fb5ef9b-9214-4462-807f-841d872f8aac tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:49:29.644752 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-7fb5ef9b-9214-4462-807f-841d872f8aac tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:49:29.645181 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-7fb5ef9b-9214-4462-807f-841d872f8aac tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:49:29.645181 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-7fb5ef9b-9214-4462-807f-841d872f8aac tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:49:29.688435 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-1a8723fe-3ec3-49ce-954a-2179156d2005 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:49:29.689304 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-1a8723fe-3ec3-49ce-954a-2179156d2005 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] [instance: 33e87882-96cf-4d0a-be2c-f0b3474c1486] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:49:29.695878 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1a8723fe-3ec3-49ce-954a-2179156d2005 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:49:29.696365 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1a8723fe-3ec3-49ce-954a-2179156d2005 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:49:29.696818 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1a8723fe-3ec3-49ce-954a-2179156d2005 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:49:29.697540 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1a8723fe-3ec3-49ce-954a-2179156d2005 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:49:29.697991 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1a8723fe-3ec3-49ce-954a-2179156d2005 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:49:29.698633 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1a8723fe-3ec3-49ce-954a-2179156d2005 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:49:29.820502 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-7fb5ef9b-9214-4462-807f-841d872f8aac tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7974c9be50c4a05b8d067fa0e4d0a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a2d9f0a96b4c8b82f343ecc8cc26ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:49:29.830212 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-7fb5ef9b-9214-4462-807f-841d872f8aac tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] 10.222.0.84 "GET /compute/v2.1/servers/df3120c6-fa78-4576-acb8-7f8565f160b1" status: 200 len: 1470 microversion: 2.1 time: 0.202876 Aug 24 11:49:29.835676 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 712/1383] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:49:29 2022] GET /compute/v2.1/servers/df3120c6-fa78-4576-acb8-7f8565f160b1 => generated 1470 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:49:29.845960 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-1a8723fe-3ec3-49ce-954a-2179156d2005 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591708bfed04ac185d4c610e8b76125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a70cdccbcb84216ae61c72d6736bd63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:49:29.865651 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-1a8723fe-3ec3-49ce-954a-2179156d2005 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] 10.222.0.84 "GET /compute/v2.1/servers/33e87882-96cf-4d0a-be2c-f0b3474c1486" status: 200 len: 1357 microversion: 2.1 time: 0.175416 Aug 24 11:49:29.865651 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 672/1384] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:49:29 2022] GET /compute/v2.1/servers/33e87882-96cf-4d0a-be2c-f0b3474c1486 => generated 1357 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:49:30.115959 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [req-7a4449bd-f546-49ac-84ae-9178c3f14fc4 req-3909c5e0-f77a-4ccb-ab17-907d0263b1c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df3120c6-fa78-4576-acb8-7f8565f160b1", "name": "network-vif-deleted", "tag": "f2ab5dd0-0773-40fa-b50a-a510662962a5"}]} {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:49:30.126384 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [req-7a4449bd-f546-49ac-84ae-9178c3f14fc4 req-3909c5e0-f77a-4ccb-ab17-907d0263b1c6 service nova] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:49:30.130741 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [req-7a4449bd-f546-49ac-84ae-9178c3f14fc4 req-3909c5e0-f77a-4ccb-ab17-907d0263b1c6 service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:49:30.130741 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [req-7a4449bd-f546-49ac-84ae-9178c3f14fc4 req-3909c5e0-f77a-4ccb-ab17-907d0263b1c6 service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:49:30.138663 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.compute.server_external_events [req-7a4449bd-f546-49ac-84ae-9178c3f14fc4 req-3909c5e0-f77a-4ccb-ab17-907d0263b1c6 service nova] Creating event network-vif-deleted:f2ab5dd0-0773-40fa-b50a-a510662962a5 for instance df3120c6-fa78-4576-acb8-7f8565f160b1 on hv-cinder-85427 Aug 24 11:49:30.143913 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [req-7a4449bd-f546-49ac-84ae-9178c3f14fc4 req-3909c5e0-f77a-4ccb-ab17-907d0263b1c6 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.163569 Aug 24 11:49:30.144491 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 713/1385] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Aug 24 11:49:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:49:30.852407 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-87180d0d-de2b-467f-9e6f-4ef5ceeb966c tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:49:30.853065 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-87180d0d-de2b-467f-9e6f-4ef5ceeb966c tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] [instance: df3120c6-fa78-4576-acb8-7f8565f160b1] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:49:30.859589 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-87180d0d-de2b-467f-9e6f-4ef5ceeb966c tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:49:30.860066 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-87180d0d-de2b-467f-9e6f-4ef5ceeb966c tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:49:30.860502 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-87180d0d-de2b-467f-9e6f-4ef5ceeb966c tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:49:30.861212 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-87180d0d-de2b-467f-9e6f-4ef5ceeb966c tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:49:30.861663 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-87180d0d-de2b-467f-9e6f-4ef5ceeb966c tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:49:30.862079 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-87180d0d-de2b-467f-9e6f-4ef5ceeb966c tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:49:30.890760 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-3699983f-fcd1-425e-b443-271c7fa1793d tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:49:30.891460 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-3699983f-fcd1-425e-b443-271c7fa1793d tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] [instance: 33e87882-96cf-4d0a-be2c-f0b3474c1486] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:49:30.898181 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-3699983f-fcd1-425e-b443-271c7fa1793d tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:49:30.898663 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-3699983f-fcd1-425e-b443-271c7fa1793d tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:49:30.899094 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-3699983f-fcd1-425e-b443-271c7fa1793d tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:49:30.899791 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-3699983f-fcd1-425e-b443-271c7fa1793d tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:49:30.900440 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-3699983f-fcd1-425e-b443-271c7fa1793d tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:49:30.900883 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-3699983f-fcd1-425e-b443-271c7fa1793d tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:49:30.932401 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-87180d0d-de2b-467f-9e6f-4ef5ceeb966c tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7974c9be50c4a05b8d067fa0e4d0a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a2d9f0a96b4c8b82f343ecc8cc26ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:49:30.943297 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-87180d0d-de2b-467f-9e6f-4ef5ceeb966c tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] 10.222.0.84 "GET /compute/v2.1/servers/df3120c6-fa78-4576-acb8-7f8565f160b1" status: 200 len: 1428 microversion: 2.1 time: 0.094585 Aug 24 11:49:30.943923 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 673/1386] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:49:30 2022] GET /compute/v2.1/servers/df3120c6-fa78-4576-acb8-7f8565f160b1 => generated 1428 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:49:31.043808 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-3699983f-fcd1-425e-b443-271c7fa1793d tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591708bfed04ac185d4c610e8b76125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a70cdccbcb84216ae61c72d6736bd63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:49:31.051857 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-3699983f-fcd1-425e-b443-271c7fa1793d tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] 10.222.0.84 "GET /compute/v2.1/servers/33e87882-96cf-4d0a-be2c-f0b3474c1486" status: 200 len: 1357 microversion: 2.1 time: 0.166945 Aug 24 11:49:31.052429 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 714/1387] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:49:30 2022] GET /compute/v2.1/servers/33e87882-96cf-4d0a-be2c-f0b3474c1486 => generated 1357 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:49:31.966421 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-6f0468c0-4c9f-4da3-b997-2bc7dbb57b90 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:49:31.967011 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-6f0468c0-4c9f-4da3-b997-2bc7dbb57b90 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] [instance: df3120c6-fa78-4576-acb8-7f8565f160b1] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:49:31.974283 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6f0468c0-4c9f-4da3-b997-2bc7dbb57b90 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:49:31.974782 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6f0468c0-4c9f-4da3-b997-2bc7dbb57b90 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:49:31.975200 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6f0468c0-4c9f-4da3-b997-2bc7dbb57b90 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:49:31.975889 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6f0468c0-4c9f-4da3-b997-2bc7dbb57b90 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:49:31.976335 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6f0468c0-4c9f-4da3-b997-2bc7dbb57b90 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:49:31.976754 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6f0468c0-4c9f-4da3-b997-2bc7dbb57b90 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:49:32.046048 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-6f0468c0-4c9f-4da3-b997-2bc7dbb57b90 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7974c9be50c4a05b8d067fa0e4d0a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a2d9f0a96b4c8b82f343ecc8cc26ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:49:32.053976 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-6f0468c0-4c9f-4da3-b997-2bc7dbb57b90 tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] 10.222.0.84 "GET /compute/v2.1/servers/df3120c6-fa78-4576-acb8-7f8565f160b1" status: 200 len: 1428 microversion: 2.1 time: 0.091364 Aug 24 11:49:32.054548 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 674/1388] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:49:31 2022] GET /compute/v2.1/servers/df3120c6-fa78-4576-acb8-7f8565f160b1 => generated 1428 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:49:32.076327 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-1a09b898-5098-450f-8902-6d5f08b1946c tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:49:32.076327 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-1a09b898-5098-450f-8902-6d5f08b1946c tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] [instance: 33e87882-96cf-4d0a-be2c-f0b3474c1486] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:49:32.081344 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-1a09b898-5098-450f-8902-6d5f08b1946c tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:49:32.082071 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-1a09b898-5098-450f-8902-6d5f08b1946c tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:49:32.082501 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-1a09b898-5098-450f-8902-6d5f08b1946c tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:49:32.083194 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-1a09b898-5098-450f-8902-6d5f08b1946c tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:49:32.083642 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-1a09b898-5098-450f-8902-6d5f08b1946c tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:49:32.084063 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-1a09b898-5098-450f-8902-6d5f08b1946c tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:49:32.219323 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-1a09b898-5098-450f-8902-6d5f08b1946c tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591708bfed04ac185d4c610e8b76125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a70cdccbcb84216ae61c72d6736bd63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:49:32.222859 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG dbcounter [-] [124769] Writing DB stats nova_cell1:SELECT=100 {{(pid=124769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:49:32.227258 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-1a09b898-5098-450f-8902-6d5f08b1946c tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] 10.222.0.84 "GET /compute/v2.1/servers/33e87882-96cf-4d0a-be2c-f0b3474c1486" status: 200 len: 1357 microversion: 2.1 time: 0.157337 Aug 24 11:49:32.227827 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 715/1389] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:49:32 2022] GET /compute/v2.1/servers/33e87882-96cf-4d0a-be2c-f0b3474c1486 => generated 1357 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:49:33.082007 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-d672ce6e-610d-4383-ba36-f5c2b41d1a3a tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:49:33.082007 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-d672ce6e-610d-4383-ba36-f5c2b41d1a3a tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] [instance: df3120c6-fa78-4576-acb8-7f8565f160b1] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:49:33.087019 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d672ce6e-610d-4383-ba36-f5c2b41d1a3a tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:49:33.087691 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d672ce6e-610d-4383-ba36-f5c2b41d1a3a tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:49:33.088282 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d672ce6e-610d-4383-ba36-f5c2b41d1a3a tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:49:33.089389 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d672ce6e-610d-4383-ba36-f5c2b41d1a3a tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:49:33.090133 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d672ce6e-610d-4383-ba36-f5c2b41d1a3a tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:49:33.090760 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d672ce6e-610d-4383-ba36-f5c2b41d1a3a tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:49:33.124905 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d672ce6e-610d-4383-ba36-f5c2b41d1a3a tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:49:33.125393 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d672ce6e-610d-4383-ba36-f5c2b41d1a3a tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:49:33.125829 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d672ce6e-610d-4383-ba36-f5c2b41d1a3a tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:49:33.126277 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.objects.instance [None req-d672ce6e-610d-4383-ba36-f5c2b41d1a3a tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Lazy-loading 'fault' on Instance uuid df3120c6-fa78-4576-acb8-7f8565f160b1 {{(pid=124770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:49:33.167384 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-d672ce6e-610d-4383-ba36-f5c2b41d1a3a tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7974c9be50c4a05b8d067fa0e4d0a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a2d9f0a96b4c8b82f343ecc8cc26ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:49:33.177074 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-d672ce6e-610d-4383-ba36-f5c2b41d1a3a tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] 10.222.0.84 "GET /compute/v2.1/servers/df3120c6-fa78-4576-acb8-7f8565f160b1" status: 200 len: 1304 microversion: 2.1 time: 0.104296 Aug 24 11:49:33.177651 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 675/1390] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:49:33 2022] GET /compute/v2.1/servers/df3120c6-fa78-4576-acb8-7f8565f160b1 => generated 1304 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:49:33.250664 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-8597a764-d4e3-4030-8b5f-3d45c2f2e87c tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:49:33.251386 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-8597a764-d4e3-4030-8b5f-3d45c2f2e87c tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] [instance: 33e87882-96cf-4d0a-be2c-f0b3474c1486] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:49:33.258637 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-8597a764-d4e3-4030-8b5f-3d45c2f2e87c tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:49:33.259122 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-8597a764-d4e3-4030-8b5f-3d45c2f2e87c tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:49:33.259566 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-8597a764-d4e3-4030-8b5f-3d45c2f2e87c tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:49:33.260262 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-8597a764-d4e3-4030-8b5f-3d45c2f2e87c tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:49:33.260721 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-8597a764-d4e3-4030-8b5f-3d45c2f2e87c tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:49:33.261256 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-8597a764-d4e3-4030-8b5f-3d45c2f2e87c tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:49:33.397324 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-8597a764-d4e3-4030-8b5f-3d45c2f2e87c tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591708bfed04ac185d4c610e8b76125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a70cdccbcb84216ae61c72d6736bd63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:49:33.405655 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-8597a764-d4e3-4030-8b5f-3d45c2f2e87c tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] 10.222.0.84 "GET /compute/v2.1/servers/33e87882-96cf-4d0a-be2c-f0b3474c1486" status: 200 len: 1357 microversion: 2.1 time: 0.159232 Aug 24 11:49:33.406419 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 716/1391] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:49:33 2022] GET /compute/v2.1/servers/33e87882-96cf-4d0a-be2c-f0b3474c1486 => generated 1357 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:49:34.199576 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-7d392cd2-41af-4063-b708-b79fa22bb9df tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:49:34.200222 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-7d392cd2-41af-4063-b708-b79fa22bb9df tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] [instance: df3120c6-fa78-4576-acb8-7f8565f160b1] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:49:34.208120 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-7d392cd2-41af-4063-b708-b79fa22bb9df tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:49:34.208526 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-7d392cd2-41af-4063-b708-b79fa22bb9df tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:49:34.208998 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-7d392cd2-41af-4063-b708-b79fa22bb9df tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:49:34.209718 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-7d392cd2-41af-4063-b708-b79fa22bb9df tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:49:34.210176 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-7d392cd2-41af-4063-b708-b79fa22bb9df tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:49:34.210620 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-7d392cd2-41af-4063-b708-b79fa22bb9df tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:49:34.226898 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.wsgi [None req-7d392cd2-41af-4063-b708-b79fa22bb9df tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] HTTP exception thrown: Instance df3120c6-fa78-4576-acb8-7f8565f160b1 could not be found. Aug 24 11:49:34.228953 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-7d392cd2-41af-4063-b708-b79fa22bb9df tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Request method failure captured: Aug 24 11:49:34.228953 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: request: GET /compute/v2.1/servers/df3120c6-fa78-4576-acb8-7f8565f160b1 HTTP/1.1 Aug 24 11:49:34.228953 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Accept: application/json Aug 24 11:49:34.228953 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Accept-Encoding: identity Aug 24 11:49:34.228953 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Connection: close Aug 24 11:49:34.228953 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Content-Length: 0 Aug 24 11:49:34.228953 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Content-Type: application/json Aug 24 11:49:34.228953 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Host: 10.222.0.84 Aug 24 11:49:34.228953 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Openstack-System-Scope: None Aug 24 11:49:34.228953 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: User-Agent: python-urllib3/1.26.11 Aug 24 11:49:34.228953 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Auth-Token: gAAAAABjBhAiNjuc41VIXUwvxqA5C8ZBYcI8MEKGAluaSe9C_DC8VjJlCmtuKr1gLO_rr0Y2EXhABJwqlgCjvCzRfD9kTziCj12gDtS3YYKFN_ACnsVov8lxfV9pm379lcgsuKsAQrSLhEo8ODw7WtVh8V_FJMfm7EIgU0kcdr-oxrlnrEjIGmQ Aug 24 11:49:34.228953 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Domain-Id: None Aug 24 11:49:34.228953 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Domain-Name: None Aug 24 11:49:34.228953 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Identity-Status: Confirmed Aug 24 11:49:34.228953 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Is-Admin-Project: True Aug 24 11:49:34.228953 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Project-Domain-Id: default Aug 24 11:49:34.228953 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Project-Domain-Name: Default Aug 24 11:49:34.228953 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Project-Id: 71a2d9f0a96b4c8b82f343ecc8cc26ba Aug 24 11:49:34.228953 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Project-Name: tempest-VolumesNegativeTest-1692106509 Aug 24 11:49:34.228953 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Role: reader,member Aug 24 11:49:34.228953 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Roles: reader,member Aug 24 11:49:34.230617 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/volume/v3/71a2d9f0a96b4c8b82f343ecc8cc26ba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/volume/v3/71a2d9f0a96b4c8b82f343ecc8cc26ba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/compute/v2/71a2d9f0a96b4c8b82f343ecc8cc26ba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84:8080/v1/AUTH_71a2d9f0a96b4c8b82f343ecc8cc26ba", "adminURL": "http://10.222.0.84:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/placement"}]}] Aug 24 11:49:34.230617 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Tenant: tempest-VolumesNegativeTest-1692106509 Aug 24 11:49:34.230617 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Tenant-Id: 71a2d9f0a96b4c8b82f343ecc8cc26ba Aug 24 11:49:34.230617 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Tenant-Name: tempest-VolumesNegativeTest-1692106509 Aug 24 11:49:34.230617 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User: tempest-VolumesNegativeTest-1692106509-project Aug 24 11:49:34.230617 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User-Domain-Id: default Aug 24 11:49:34.230617 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User-Domain-Name: Default Aug 24 11:49:34.230617 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User-Id: c7974c9be50c4a05b8d067fa0e4d0a96 Aug 24 11:49:34.230617 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User-Name: tempest-VolumesNegativeTest-1692106509-project Aug 24 11:49:34.230617 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: method: > Aug 24 11:49:34.230617 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: exception: Instance df3120c6-fa78-4576-acb8-7f8565f160b1 could not be found. Aug 24 11:49:34.230617 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: action_args: {'id': 'df3120c6-fa78-4576-acb8-7f8565f160b1'} Aug 24 11:49:34.231549 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:49:34.231549 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:49:34.231549 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:49:34.231549 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:49:34.231549 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:49:34.231549 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:49:34.231549 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:49:34.231549 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:49:34.231549 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:49:34.231549 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:49:34.231549 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df3120c6-fa78-4576-acb8-7f8565f160b1 could not be found. Aug 24 11:49:34.231549 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:49:34.231549 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:49:34.231549 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:49:34.231549 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:49:34.231549 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:49:34.231549 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:49:34.231549 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:49:34.231549 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:49:34.231549 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:49:34.234320 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:49:34.234320 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:49:34.234320 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:49:34.234320 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:49:34.234320 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:49:34.234320 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:49:34.234320 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:49:34.234320 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df3120c6-fa78-4576-acb8-7f8565f160b1 could not be found. Aug 24 11:49:34.234320 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:49:34.234320 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:49:34.234320 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:49:34.234320 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:49:34.234320 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:49:34.234320 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:49:34.234320 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:49:34.234320 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:49:34.234320 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df3120c6-fa78-4576-acb8-7f8565f160b1 could not be found. Aug 24 11:49:34.234320 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:49:34.235927 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-7d392cd2-41af-4063-b708-b79fa22bb9df tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] Returning 404 to user: Instance df3120c6-fa78-4576-acb8-7f8565f160b1 could not be found. {{(pid=124770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:49:34.235927 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-7d392cd2-41af-4063-b708-b79fa22bb9df tempest-VolumesNegativeTest-1692106509 tempest-VolumesNegativeTest-1692106509-project] 10.222.0.84 "GET /compute/v2.1/servers/df3120c6-fa78-4576-acb8-7f8565f160b1" status: 404 len: 111 microversion: 2.1 time: 0.034847 Aug 24 11:49:34.235927 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 676/1392] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:49:34 2022] GET /compute/v2.1/servers/df3120c6-fa78-4576-acb8-7f8565f160b1 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:49:34.428467 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-83da1484-d6f9-4c2d-bc62-4ff7f14f9bb0 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:49:34.435652 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-83da1484-d6f9-4c2d-bc62-4ff7f14f9bb0 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] [instance: 33e87882-96cf-4d0a-be2c-f0b3474c1486] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:49:34.442388 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-83da1484-d6f9-4c2d-bc62-4ff7f14f9bb0 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:49:34.442885 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-83da1484-d6f9-4c2d-bc62-4ff7f14f9bb0 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:49:34.443329 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-83da1484-d6f9-4c2d-bc62-4ff7f14f9bb0 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:49:34.444676 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-83da1484-d6f9-4c2d-bc62-4ff7f14f9bb0 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:49:34.444676 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-83da1484-d6f9-4c2d-bc62-4ff7f14f9bb0 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:49:34.444919 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-83da1484-d6f9-4c2d-bc62-4ff7f14f9bb0 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:49:34.586149 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-83da1484-d6f9-4c2d-bc62-4ff7f14f9bb0 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591708bfed04ac185d4c610e8b76125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a70cdccbcb84216ae61c72d6736bd63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:49:34.594212 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-83da1484-d6f9-4c2d-bc62-4ff7f14f9bb0 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] 10.222.0.84 "GET /compute/v2.1/servers/33e87882-96cf-4d0a-be2c-f0b3474c1486" status: 200 len: 1357 microversion: 2.1 time: 0.170287 Aug 24 11:49:34.594775 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 717/1393] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:49:34 2022] GET /compute/v2.1/servers/33e87882-96cf-4d0a-be2c-f0b3474c1486 => generated 1357 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:49:35.615884 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-2487c66a-fda4-468b-bdf2-eabd61acb5a3 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:49:35.616507 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-2487c66a-fda4-468b-bdf2-eabd61acb5a3 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] [instance: 33e87882-96cf-4d0a-be2c-f0b3474c1486] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:49:35.623126 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-2487c66a-fda4-468b-bdf2-eabd61acb5a3 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:49:35.623826 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-2487c66a-fda4-468b-bdf2-eabd61acb5a3 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:49:35.624341 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-2487c66a-fda4-468b-bdf2-eabd61acb5a3 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:49:35.625104 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-2487c66a-fda4-468b-bdf2-eabd61acb5a3 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:49:35.625631 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-2487c66a-fda4-468b-bdf2-eabd61acb5a3 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:49:35.626637 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-2487c66a-fda4-468b-bdf2-eabd61acb5a3 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:49:35.772844 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-2487c66a-fda4-468b-bdf2-eabd61acb5a3 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591708bfed04ac185d4c610e8b76125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a70cdccbcb84216ae61c72d6736bd63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:49:35.782003 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-2487c66a-fda4-468b-bdf2-eabd61acb5a3 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] 10.222.0.84 "GET /compute/v2.1/servers/33e87882-96cf-4d0a-be2c-f0b3474c1486" status: 200 len: 1357 microversion: 2.1 time: 0.170532 Aug 24 11:49:35.782687 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 677/1394] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:49:35 2022] GET /compute/v2.1/servers/33e87882-96cf-4d0a-be2c-f0b3474c1486 => generated 1357 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:49:36.299642 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [req-01d6bd80-3bdd-490b-8f2d-5ca9be3e4bd8 req-4ec4f56e-5f54-4e47-bbc7-bcf094cec64d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33e87882-96cf-4d0a-be2c-f0b3474c1486", "name": "network-vif-plugged", "status": "completed", "tag": "98b115c3-c00e-4062-a2a6-3b720d6da9c7"}]} {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:49:36.309488 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [req-01d6bd80-3bdd-490b-8f2d-5ca9be3e4bd8 req-4ec4f56e-5f54-4e47-bbc7-bcf094cec64d service nova] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:49:36.309958 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [req-01d6bd80-3bdd-490b-8f2d-5ca9be3e4bd8 req-4ec4f56e-5f54-4e47-bbc7-bcf094cec64d service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:49:36.310380 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [req-01d6bd80-3bdd-490b-8f2d-5ca9be3e4bd8 req-4ec4f56e-5f54-4e47-bbc7-bcf094cec64d service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:49:36.321264 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.compute.server_external_events [req-01d6bd80-3bdd-490b-8f2d-5ca9be3e4bd8 req-4ec4f56e-5f54-4e47-bbc7-bcf094cec64d service nova] Creating event network-vif-plugged:98b115c3-c00e-4062-a2a6-3b720d6da9c7 for instance 33e87882-96cf-4d0a-be2c-f0b3474c1486 on hv-cinder-85427 Aug 24 11:49:36.326138 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [req-01d6bd80-3bdd-490b-8f2d-5ca9be3e4bd8 req-4ec4f56e-5f54-4e47-bbc7-bcf094cec64d service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030213 Aug 24 11:49:36.327463 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 718/1395] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Aug 24 11:49:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:49:36.803328 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-d6d2f71f-697b-4a2e-8d8f-d86c35164df4 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:49:36.803328 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-d6d2f71f-697b-4a2e-8d8f-d86c35164df4 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] [instance: 33e87882-96cf-4d0a-be2c-f0b3474c1486] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:49:36.809916 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d6d2f71f-697b-4a2e-8d8f-d86c35164df4 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:49:36.810406 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d6d2f71f-697b-4a2e-8d8f-d86c35164df4 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:49:36.811802 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d6d2f71f-697b-4a2e-8d8f-d86c35164df4 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:49:36.811802 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d6d2f71f-697b-4a2e-8d8f-d86c35164df4 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:49:36.812090 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d6d2f71f-697b-4a2e-8d8f-d86c35164df4 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:49:36.812516 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d6d2f71f-697b-4a2e-8d8f-d86c35164df4 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:49:36.953363 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-d6d2f71f-697b-4a2e-8d8f-d86c35164df4 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591708bfed04ac185d4c610e8b76125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a70cdccbcb84216ae61c72d6736bd63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:49:36.961500 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-d6d2f71f-697b-4a2e-8d8f-d86c35164df4 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] 10.222.0.84 "GET /compute/v2.1/servers/33e87882-96cf-4d0a-be2c-f0b3474c1486" status: 200 len: 1357 microversion: 2.1 time: 0.162135 Aug 24 11:49:36.961735 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 678/1396] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:49:36 2022] GET /compute/v2.1/servers/33e87882-96cf-4d0a-be2c-f0b3474c1486 => generated 1357 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:49:37.982953 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-b4450da0-82a8-4885-b61f-36173b1f5eb7 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:49:37.985260 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-b4450da0-82a8-4885-b61f-36173b1f5eb7 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] [instance: 33e87882-96cf-4d0a-be2c-f0b3474c1486] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:49:37.990567 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-b4450da0-82a8-4885-b61f-36173b1f5eb7 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:49:37.990981 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-b4450da0-82a8-4885-b61f-36173b1f5eb7 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:49:37.991405 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-b4450da0-82a8-4885-b61f-36173b1f5eb7 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:49:37.992096 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-b4450da0-82a8-4885-b61f-36173b1f5eb7 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:49:37.992533 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-b4450da0-82a8-4885-b61f-36173b1f5eb7 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:49:37.992988 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-b4450da0-82a8-4885-b61f-36173b1f5eb7 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:49:38.146040 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-b4450da0-82a8-4885-b61f-36173b1f5eb7 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591708bfed04ac185d4c610e8b76125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a70cdccbcb84216ae61c72d6736bd63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:49:38.153993 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-b4450da0-82a8-4885-b61f-36173b1f5eb7 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] 10.222.0.84 "GET /compute/v2.1/servers/33e87882-96cf-4d0a-be2c-f0b3474c1486" status: 200 len: 1357 microversion: 2.1 time: 0.175750 Aug 24 11:49:38.154568 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 719/1397] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:49:37 2022] GET /compute/v2.1/servers/33e87882-96cf-4d0a-be2c-f0b3474c1486 => generated 1357 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:49:39.176014 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-2c176b74-5fe9-416f-a656-2fcef454f5e8 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:49:39.176629 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-2c176b74-5fe9-416f-a656-2fcef454f5e8 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] [instance: 33e87882-96cf-4d0a-be2c-f0b3474c1486] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:49:39.184256 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-2c176b74-5fe9-416f-a656-2fcef454f5e8 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:49:39.184725 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-2c176b74-5fe9-416f-a656-2fcef454f5e8 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:49:39.185413 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-2c176b74-5fe9-416f-a656-2fcef454f5e8 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:49:39.185892 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-2c176b74-5fe9-416f-a656-2fcef454f5e8 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:49:39.186379 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-2c176b74-5fe9-416f-a656-2fcef454f5e8 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:49:39.187017 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-2c176b74-5fe9-416f-a656-2fcef454f5e8 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:49:39.325650 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-2c176b74-5fe9-416f-a656-2fcef454f5e8 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591708bfed04ac185d4c610e8b76125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a70cdccbcb84216ae61c72d6736bd63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:49:39.334275 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-2c176b74-5fe9-416f-a656-2fcef454f5e8 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] 10.222.0.84 "GET /compute/v2.1/servers/33e87882-96cf-4d0a-be2c-f0b3474c1486" status: 200 len: 1548 microversion: 2.1 time: 0.162712 Aug 24 11:49:39.334883 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 679/1398] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:49:39 2022] GET /compute/v2.1/servers/33e87882-96cf-4d0a-be2c-f0b3474c1486 => generated 1548 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:49:39.354902 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-6e432b36-865a-4360-8d0b-9b3b01be50fa tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:49:39.355511 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-6e432b36-865a-4360-8d0b-9b3b01be50fa tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] [instance: 33e87882-96cf-4d0a-be2c-f0b3474c1486] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:49:39.361902 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-6e432b36-865a-4360-8d0b-9b3b01be50fa tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:49:39.363069 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-6e432b36-865a-4360-8d0b-9b3b01be50fa tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:49:39.363069 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-6e432b36-865a-4360-8d0b-9b3b01be50fa tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:49:39.363461 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-6e432b36-865a-4360-8d0b-9b3b01be50fa tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:49:39.363919 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-6e432b36-865a-4360-8d0b-9b3b01be50fa tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:49:39.364323 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-6e432b36-865a-4360-8d0b-9b3b01be50fa tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:49:39.511755 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-6e432b36-865a-4360-8d0b-9b3b01be50fa tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591708bfed04ac185d4c610e8b76125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a70cdccbcb84216ae61c72d6736bd63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:49:39.519961 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-6e432b36-865a-4360-8d0b-9b3b01be50fa tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] 10.222.0.84 "GET /compute/v2.1/servers/33e87882-96cf-4d0a-be2c-f0b3474c1486" status: 200 len: 1548 microversion: 2.1 time: 0.168984 Aug 24 11:49:39.523756 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 720/1399] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:49:39 2022] GET /compute/v2.1/servers/33e87882-96cf-4d0a-be2c-f0b3474c1486 => generated 1548 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:49:39.540040 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-71c2196e-4131-4fcc-8fb3-908955195f1f tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:49:39.544656 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-71c2196e-4131-4fcc-8fb3-908955195f1f tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5591708bfed04ac185d4c610e8b76125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a70cdccbcb84216ae61c72d6736bd63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:49:39.546074 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-71c2196e-4131-4fcc-8fb3-908955195f1f tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Searching by: {'deleted': False, 'project_id': '9a70cdccbcb84216ae61c72d6736bd63'} {{(pid=124770) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 11:49:39.552776 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-71c2196e-4131-4fcc-8fb3-908955195f1f tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:49:39.553288 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-71c2196e-4131-4fcc-8fb3-908955195f1f tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:49:39.553737 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-71c2196e-4131-4fcc-8fb3-908955195f1f tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:49:39.554448 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-71c2196e-4131-4fcc-8fb3-908955195f1f tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:49:39.554900 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-71c2196e-4131-4fcc-8fb3-908955195f1f tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:49:39.555339 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-71c2196e-4131-4fcc-8fb3-908955195f1f tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:49:39.649693 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.multi_cell_list [None req-71c2196e-4131-4fcc-8fb3-908955195f1f tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=124770) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 24 11:49:39.748157 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-71c2196e-4131-4fcc-8fb3-908955195f1f tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] 10.222.0.84 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.211778 Aug 24 11:49:39.748855 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 680/1400] 10.222.0.84 () {58 vars in 1125 bytes} [Wed Aug 24 11:49:39 2022] GET /compute/v2.1/servers => generated 342 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:49:39.760342 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-cfe1c696-48d9-471d-b12f-37dd15b0e90f tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:49:39.760988 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-cfe1c696-48d9-471d-b12f-37dd15b0e90f tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] [instance: 33e87882-96cf-4d0a-be2c-f0b3474c1486] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:49:39.767723 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-cfe1c696-48d9-471d-b12f-37dd15b0e90f tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:49:39.768200 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-cfe1c696-48d9-471d-b12f-37dd15b0e90f tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:49:39.768629 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-cfe1c696-48d9-471d-b12f-37dd15b0e90f tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:49:39.769448 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-cfe1c696-48d9-471d-b12f-37dd15b0e90f tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:49:39.769878 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-cfe1c696-48d9-471d-b12f-37dd15b0e90f tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:49:39.770312 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-cfe1c696-48d9-471d-b12f-37dd15b0e90f tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:49:39.902352 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-cfe1c696-48d9-471d-b12f-37dd15b0e90f tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591708bfed04ac185d4c610e8b76125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a70cdccbcb84216ae61c72d6736bd63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:49:39.911025 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-cfe1c696-48d9-471d-b12f-37dd15b0e90f tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] 10.222.0.84 "GET /compute/v2.1/servers/33e87882-96cf-4d0a-be2c-f0b3474c1486" status: 200 len: 1548 microversion: 2.1 time: 0.154514 Aug 24 11:49:39.911603 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 721/1401] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:49:39 2022] GET /compute/v2.1/servers/33e87882-96cf-4d0a-be2c-f0b3474c1486 => generated 1548 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:49:42.922708 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-f91ff15e-7795-436c-aa53-1a32ae0fd9db tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6ba788b3-584a-426f-98bf-8ac87941cb14"}} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:49:42.924946 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-f91ff15e-7795-436c-aa53-1a32ae0fd9db tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] [instance: 33e87882-96cf-4d0a-be2c-f0b3474c1486] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:49:42.931359 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-f91ff15e-7795-436c-aa53-1a32ae0fd9db tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:49:42.931843 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-f91ff15e-7795-436c-aa53-1a32ae0fd9db tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:49:42.932281 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-f91ff15e-7795-436c-aa53-1a32ae0fd9db tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:49:42.933076 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-f91ff15e-7795-436c-aa53-1a32ae0fd9db tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:49:42.936713 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-f91ff15e-7795-436c-aa53-1a32ae0fd9db tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:49:42.936713 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-f91ff15e-7795-436c-aa53-1a32ae0fd9db tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:49:43.786976 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-f91ff15e-7795-436c-aa53-1a32ae0fd9db tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] 10.222.0.84 "POST /compute/v2.1/servers/33e87882-96cf-4d0a-be2c-f0b3474c1486/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.868775 Aug 24 11:49:43.787701 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 681/1402] 10.222.0.84 () {60 vars in 1323 bytes} [Wed Aug 24 11:49:42 2022] POST /compute/v2.1/servers/33e87882-96cf-4d0a-be2c-f0b3474c1486/os-volume_attachments => generated 194 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:49:52.463466 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-e1f804d2-fddb-41ad-9e52-8aab2242ebba tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:49:52.464140 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-e1f804d2-fddb-41ad-9e52-8aab2242ebba tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] [instance: 33e87882-96cf-4d0a-be2c-f0b3474c1486] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:49:52.466802 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG dbcounter [-] [124769] Writing DB stats nova_api:SELECT=27 {{(pid=124769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:49:52.467501 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG dbcounter [-] [124769] Writing DB stats nova_cell1:SELECT=32 {{(pid=124769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:49:52.473102 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-e1f804d2-fddb-41ad-9e52-8aab2242ebba tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:49:52.473594 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-e1f804d2-fddb-41ad-9e52-8aab2242ebba tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:49:52.474028 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-e1f804d2-fddb-41ad-9e52-8aab2242ebba tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:49:52.474725 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-e1f804d2-fddb-41ad-9e52-8aab2242ebba tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:49:52.475180 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-e1f804d2-fddb-41ad-9e52-8aab2242ebba tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:49:52.475610 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-e1f804d2-fddb-41ad-9e52-8aab2242ebba tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:49:52.605330 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-e1f804d2-fddb-41ad-9e52-8aab2242ebba tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591708bfed04ac185d4c610e8b76125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a70cdccbcb84216ae61c72d6736bd63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:49:52.613457 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-e1f804d2-fddb-41ad-9e52-8aab2242ebba tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] 10.222.0.84 "GET /compute/v2.1/servers/33e87882-96cf-4d0a-be2c-f0b3474c1486" status: 200 len: 1594 microversion: 2.1 time: 0.153911 Aug 24 11:49:52.614020 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 722/1403] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:49:52 2022] GET /compute/v2.1/servers/33e87882-96cf-4d0a-be2c-f0b3474c1486 => generated 1594 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:49:54.947477 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_cell0:SELECT=2 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:49:54.953086 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_api:SELECT=29 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:49:54.954341 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:49:54.959625 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [req-4f500024-d9a6-4f84-85ce-b3e135c5ec09 req-68828e65-02bb-4929-b0b5-b0390208c947 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33e87882-96cf-4d0a-be2c-f0b3474c1486", "tag": "98b115c3-c00e-4062-a2a6-3b720d6da9c7"}]} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:49:54.971178 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-4f500024-d9a6-4f84-85ce-b3e135c5ec09 req-68828e65-02bb-4929-b0b5-b0390208c947 service nova] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:49:54.971672 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-4f500024-d9a6-4f84-85ce-b3e135c5ec09 req-68828e65-02bb-4929-b0b5-b0390208c947 service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:49:54.972106 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-4f500024-d9a6-4f84-85ce-b3e135c5ec09 req-68828e65-02bb-4929-b0b5-b0390208c947 service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:49:54.983842 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.compute.server_external_events [req-4f500024-d9a6-4f84-85ce-b3e135c5ec09 req-68828e65-02bb-4929-b0b5-b0390208c947 service nova] Creating event network-changed:98b115c3-c00e-4062-a2a6-3b720d6da9c7 for instance 33e87882-96cf-4d0a-be2c-f0b3474c1486 on hv-cinder-85427 Aug 24 11:49:54.990236 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [req-4f500024-d9a6-4f84-85ce-b3e135c5ec09 req-68828e65-02bb-4929-b0b5-b0390208c947 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044360 Aug 24 11:49:54.991184 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 682/1404] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Aug 24 11:49:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:49:58.243955 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-4c1f0d12-bd1a-4cf5-9474-3a25d7fcefc4 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1703050376"}} {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:49:58.244557 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-4c1f0d12-bd1a-4cf5-9474-3a25d7fcefc4 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] [instance: 33e87882-96cf-4d0a-be2c-f0b3474c1486] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:49:58.251562 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-4c1f0d12-bd1a-4cf5-9474-3a25d7fcefc4 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:49:58.252044 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-4c1f0d12-bd1a-4cf5-9474-3a25d7fcefc4 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:49:58.252836 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-4c1f0d12-bd1a-4cf5-9474-3a25d7fcefc4 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:49:58.253202 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-4c1f0d12-bd1a-4cf5-9474-3a25d7fcefc4 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:49:58.253944 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-4c1f0d12-bd1a-4cf5-9474-3a25d7fcefc4 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:49:58.254808 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-4c1f0d12-bd1a-4cf5-9474-3a25d7fcefc4 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:49:58.388072 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.network.security_group_api [None req-4c1f0d12-bd1a-4cf5-9474-3a25d7fcefc4 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Adding security group a05eb41f-8524-449c-a2d6-93df2b76772d to port 98b115c3-c00e-4062-a2a6-3b720d6da9c7 Aug 24 11:49:58.817503 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-4c1f0d12-bd1a-4cf5-9474-3a25d7fcefc4 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] 10.222.0.84 "POST /compute/v2.1/servers/33e87882-96cf-4d0a-be2c-f0b3474c1486/action" status: 202 len: 0 microversion: 2.1 time: 0.577419 Aug 24 11:49:58.818129 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 723/1405] 10.222.0.84 () {60 vars in 1278 bytes} [Wed Aug 24 11:49:58 2022] POST /compute/v2.1/servers/33e87882-96cf-4d0a-be2c-f0b3474c1486/action => generated 0 bytes in 579 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:49:58.826678 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-63d474d9-863d-43c2-94e1-4c7c6f75b550 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:49:58.827268 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [req-d7d86a68-8167-437f-a0af-6bf60e5a484b req-b552ef94-55de-475f-ae08-26b3afa44071 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33e87882-96cf-4d0a-be2c-f0b3474c1486", "tag": "98b115c3-c00e-4062-a2a6-3b720d6da9c7"}]} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:49:58.827795 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-63d474d9-863d-43c2-94e1-4c7c6f75b550 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] [instance: 33e87882-96cf-4d0a-be2c-f0b3474c1486] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:49:58.834607 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-63d474d9-863d-43c2-94e1-4c7c6f75b550 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:49:58.835119 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-63d474d9-863d-43c2-94e1-4c7c6f75b550 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:49:58.835530 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-63d474d9-863d-43c2-94e1-4c7c6f75b550 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:49:58.836456 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-63d474d9-863d-43c2-94e1-4c7c6f75b550 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:49:58.837128 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-63d474d9-863d-43c2-94e1-4c7c6f75b550 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:49:58.838386 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-63d474d9-863d-43c2-94e1-4c7c6f75b550 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:49:58.843396 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-d7d86a68-8167-437f-a0af-6bf60e5a484b req-b552ef94-55de-475f-ae08-26b3afa44071 service nova] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:49:58.844060 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-d7d86a68-8167-437f-a0af-6bf60e5a484b req-b552ef94-55de-475f-ae08-26b3afa44071 service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:49:58.844646 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-d7d86a68-8167-437f-a0af-6bf60e5a484b req-b552ef94-55de-475f-ae08-26b3afa44071 service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:49:58.857947 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.compute.server_external_events [req-d7d86a68-8167-437f-a0af-6bf60e5a484b req-b552ef94-55de-475f-ae08-26b3afa44071 service nova] Creating event network-changed:98b115c3-c00e-4062-a2a6-3b720d6da9c7 for instance 33e87882-96cf-4d0a-be2c-f0b3474c1486 on hv-cinder-85427 Aug 24 11:49:58.864205 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [req-d7d86a68-8167-437f-a0af-6bf60e5a484b req-b552ef94-55de-475f-ae08-26b3afa44071 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042071 Aug 24 11:49:58.865481 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 683/1406] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Aug 24 11:49:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:49:59.079416 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-63d474d9-863d-43c2-94e1-4c7c6f75b550 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591708bfed04ac185d4c610e8b76125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a70cdccbcb84216ae61c72d6736bd63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:49:59.092999 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-63d474d9-863d-43c2-94e1-4c7c6f75b550 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] 10.222.0.84 "GET /compute/v2.1/servers/33e87882-96cf-4d0a-be2c-f0b3474c1486" status: 200 len: 1760 microversion: 2.1 time: 0.269632 Aug 24 11:49:59.094772 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 724/1407] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:49:58 2022] GET /compute/v2.1/servers/33e87882-96cf-4d0a-be2c-f0b3474c1486 => generated 1760 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:50:09.551275 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 11:50:09.551900 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Wed Aug 24 11:50:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 11:50:59.744887 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_api:SELECT=4 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:50:59.749431 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-7b04aeac-8e81-49bd-9686-45959d233638 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:50:59.751702 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-7b04aeac-8e81-49bd-9686-45959d233638 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] [instance: 33e87882-96cf-4d0a-be2c-f0b3474c1486] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:50:59.759261 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-7b04aeac-8e81-49bd-9686-45959d233638 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:50:59.763283 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-7b04aeac-8e81-49bd-9686-45959d233638 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:50:59.763283 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-7b04aeac-8e81-49bd-9686-45959d233638 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:50:59.763283 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-7b04aeac-8e81-49bd-9686-45959d233638 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:50:59.763283 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-7b04aeac-8e81-49bd-9686-45959d233638 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:50:59.763728 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-7b04aeac-8e81-49bd-9686-45959d233638 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:51:00.066843 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-7b04aeac-8e81-49bd-9686-45959d233638 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] 10.222.0.84 "POST /compute/v2.1/servers/33e87882-96cf-4d0a-be2c-f0b3474c1486/action" status: 202 len: 0 microversion: 2.1 time: 0.323255 Aug 24 11:51:00.072974 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 684/1408] 10.222.0.84 () {60 vars in 1278 bytes} [Wed Aug 24 11:50:59 2022] POST /compute/v2.1/servers/33e87882-96cf-4d0a-be2c-f0b3474c1486/action => generated 0 bytes in 326 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:51:00.074655 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG dbcounter [-] [124769] Writing DB stats nova_api:SELECT=6 {{(pid=124769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:51:00.075461 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG dbcounter [-] [124769] Writing DB stats nova_cell1:SELECT=16 {{(pid=124769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:51:00.079525 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-5310933e-936b-49a3-b0f8-97bd375ae07a tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:51:00.080144 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-5310933e-936b-49a3-b0f8-97bd375ae07a tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] [instance: 33e87882-96cf-4d0a-be2c-f0b3474c1486] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:51:00.086586 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-5310933e-936b-49a3-b0f8-97bd375ae07a tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:51:00.087064 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-5310933e-936b-49a3-b0f8-97bd375ae07a tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:51:00.087500 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-5310933e-936b-49a3-b0f8-97bd375ae07a tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:51:00.088182 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-5310933e-936b-49a3-b0f8-97bd375ae07a tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:51:00.088624 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-5310933e-936b-49a3-b0f8-97bd375ae07a tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:51:00.089070 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-5310933e-936b-49a3-b0f8-97bd375ae07a tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:51:00.241226 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-5310933e-936b-49a3-b0f8-97bd375ae07a tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591708bfed04ac185d4c610e8b76125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a70cdccbcb84216ae61c72d6736bd63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:51:00.249855 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-5310933e-936b-49a3-b0f8-97bd375ae07a tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] 10.222.0.84 "GET /compute/v2.1/servers/33e87882-96cf-4d0a-be2c-f0b3474c1486" status: 200 len: 1752 microversion: 2.1 time: 0.177011 Aug 24 11:51:00.253259 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 725/1409] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:51:00 2022] GET /compute/v2.1/servers/33e87882-96cf-4d0a-be2c-f0b3474c1486 => generated 1752 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:51:01.273330 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-129e2e5a-7cee-4d87-a35d-17b386af7935 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:51:01.274245 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-129e2e5a-7cee-4d87-a35d-17b386af7935 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] [instance: 33e87882-96cf-4d0a-be2c-f0b3474c1486] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:51:01.280541 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-129e2e5a-7cee-4d87-a35d-17b386af7935 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:51:01.281055 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-129e2e5a-7cee-4d87-a35d-17b386af7935 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:51:01.281521 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-129e2e5a-7cee-4d87-a35d-17b386af7935 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:51:01.282194 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-129e2e5a-7cee-4d87-a35d-17b386af7935 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:51:01.282644 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-129e2e5a-7cee-4d87-a35d-17b386af7935 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:51:01.283074 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-129e2e5a-7cee-4d87-a35d-17b386af7935 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:51:01.446640 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-129e2e5a-7cee-4d87-a35d-17b386af7935 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591708bfed04ac185d4c610e8b76125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a70cdccbcb84216ae61c72d6736bd63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:51:01.454999 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-129e2e5a-7cee-4d87-a35d-17b386af7935 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] 10.222.0.84 "GET /compute/v2.1/servers/33e87882-96cf-4d0a-be2c-f0b3474c1486" status: 200 len: 1757 microversion: 2.1 time: 0.187364 Aug 24 11:51:01.455562 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 685/1410] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:51:01 2022] GET /compute/v2.1/servers/33e87882-96cf-4d0a-be2c-f0b3474c1486 => generated 1757 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:51:02.475731 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-0db1b76c-095b-4f08-9f0a-81dcb1762901 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:51:02.476322 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-0db1b76c-095b-4f08-9f0a-81dcb1762901 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] [instance: 33e87882-96cf-4d0a-be2c-f0b3474c1486] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:51:02.483267 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-0db1b76c-095b-4f08-9f0a-81dcb1762901 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:51:02.488347 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-0db1b76c-095b-4f08-9f0a-81dcb1762901 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:51:02.488347 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-0db1b76c-095b-4f08-9f0a-81dcb1762901 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:51:02.488347 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-0db1b76c-095b-4f08-9f0a-81dcb1762901 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:51:02.488347 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-0db1b76c-095b-4f08-9f0a-81dcb1762901 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:51:02.488935 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-0db1b76c-095b-4f08-9f0a-81dcb1762901 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:51:02.635496 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-0db1b76c-095b-4f08-9f0a-81dcb1762901 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591708bfed04ac185d4c610e8b76125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a70cdccbcb84216ae61c72d6736bd63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:51:02.644703 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-0db1b76c-095b-4f08-9f0a-81dcb1762901 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] 10.222.0.84 "GET /compute/v2.1/servers/33e87882-96cf-4d0a-be2c-f0b3474c1486" status: 200 len: 1757 microversion: 2.1 time: 0.172182 Aug 24 11:51:02.645733 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 726/1411] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:51:02 2022] GET /compute/v2.1/servers/33e87882-96cf-4d0a-be2c-f0b3474c1486 => generated 1757 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:51:03.671475 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-70bd6b03-0451-4d98-bc9b-cab88d4916b9 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:51:03.672092 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-70bd6b03-0451-4d98-bc9b-cab88d4916b9 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] [instance: 33e87882-96cf-4d0a-be2c-f0b3474c1486] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:51:03.679071 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-70bd6b03-0451-4d98-bc9b-cab88d4916b9 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:51:03.679552 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-70bd6b03-0451-4d98-bc9b-cab88d4916b9 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:51:03.680141 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-70bd6b03-0451-4d98-bc9b-cab88d4916b9 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:51:03.680861 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-70bd6b03-0451-4d98-bc9b-cab88d4916b9 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:51:03.681249 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-70bd6b03-0451-4d98-bc9b-cab88d4916b9 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:51:03.681675 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-70bd6b03-0451-4d98-bc9b-cab88d4916b9 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:51:03.826818 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-70bd6b03-0451-4d98-bc9b-cab88d4916b9 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591708bfed04ac185d4c610e8b76125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a70cdccbcb84216ae61c72d6736bd63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:51:03.836075 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-70bd6b03-0451-4d98-bc9b-cab88d4916b9 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] 10.222.0.84 "GET /compute/v2.1/servers/33e87882-96cf-4d0a-be2c-f0b3474c1486" status: 200 len: 1757 microversion: 2.1 time: 0.169966 Aug 24 11:51:03.836649 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 686/1412] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:51:03 2022] GET /compute/v2.1/servers/33e87882-96cf-4d0a-be2c-f0b3474c1486 => generated 1757 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:51:04.857654 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-a3ccedfe-9177-4a7c-ac31-336083d2aacb tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:51:04.858302 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-a3ccedfe-9177-4a7c-ac31-336083d2aacb tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] [instance: 33e87882-96cf-4d0a-be2c-f0b3474c1486] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:51:04.865018 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-a3ccedfe-9177-4a7c-ac31-336083d2aacb tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:51:04.865493 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-a3ccedfe-9177-4a7c-ac31-336083d2aacb tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:51:04.865920 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-a3ccedfe-9177-4a7c-ac31-336083d2aacb tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:51:04.866601 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-a3ccedfe-9177-4a7c-ac31-336083d2aacb tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:51:04.867042 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-a3ccedfe-9177-4a7c-ac31-336083d2aacb tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:51:04.867459 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-a3ccedfe-9177-4a7c-ac31-336083d2aacb tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:51:05.013380 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-a3ccedfe-9177-4a7c-ac31-336083d2aacb tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591708bfed04ac185d4c610e8b76125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a70cdccbcb84216ae61c72d6736bd63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:51:05.023352 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-a3ccedfe-9177-4a7c-ac31-336083d2aacb tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] 10.222.0.84 "GET /compute/v2.1/servers/33e87882-96cf-4d0a-be2c-f0b3474c1486" status: 200 len: 1757 microversion: 2.1 time: 0.169574 Aug 24 11:51:05.023917 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 727/1413] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:51:04 2022] GET /compute/v2.1/servers/33e87882-96cf-4d0a-be2c-f0b3474c1486 => generated 1757 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:51:06.045463 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-a8f6fd3b-08e4-4add-b6f1-f8f2c4ef6517 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:51:06.046058 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-a8f6fd3b-08e4-4add-b6f1-f8f2c4ef6517 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] [instance: 33e87882-96cf-4d0a-be2c-f0b3474c1486] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:51:06.053995 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a8f6fd3b-08e4-4add-b6f1-f8f2c4ef6517 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:51:06.054572 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a8f6fd3b-08e4-4add-b6f1-f8f2c4ef6517 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:51:06.055137 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a8f6fd3b-08e4-4add-b6f1-f8f2c4ef6517 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:51:06.056353 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a8f6fd3b-08e4-4add-b6f1-f8f2c4ef6517 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:51:06.057121 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a8f6fd3b-08e4-4add-b6f1-f8f2c4ef6517 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:51:06.057559 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a8f6fd3b-08e4-4add-b6f1-f8f2c4ef6517 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:51:06.252992 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-a8f6fd3b-08e4-4add-b6f1-f8f2c4ef6517 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591708bfed04ac185d4c610e8b76125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a70cdccbcb84216ae61c72d6736bd63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:51:06.262334 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-a8f6fd3b-08e4-4add-b6f1-f8f2c4ef6517 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] 10.222.0.84 "GET /compute/v2.1/servers/33e87882-96cf-4d0a-be2c-f0b3474c1486" status: 200 len: 1757 microversion: 2.1 time: 0.220752 Aug 24 11:51:06.262920 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 687/1414] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:51:06 2022] GET /compute/v2.1/servers/33e87882-96cf-4d0a-be2c-f0b3474c1486 => generated 1757 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:51:07.283903 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-235b2dfa-2254-4816-ae12-3cb9e5b31a43 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:51:07.284576 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-235b2dfa-2254-4816-ae12-3cb9e5b31a43 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] [instance: 33e87882-96cf-4d0a-be2c-f0b3474c1486] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:51:07.292162 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-235b2dfa-2254-4816-ae12-3cb9e5b31a43 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:51:07.292648 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-235b2dfa-2254-4816-ae12-3cb9e5b31a43 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:51:07.293125 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-235b2dfa-2254-4816-ae12-3cb9e5b31a43 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:51:07.293830 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-235b2dfa-2254-4816-ae12-3cb9e5b31a43 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:51:07.294274 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-235b2dfa-2254-4816-ae12-3cb9e5b31a43 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:51:07.294699 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-235b2dfa-2254-4816-ae12-3cb9e5b31a43 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:51:07.444734 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-235b2dfa-2254-4816-ae12-3cb9e5b31a43 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591708bfed04ac185d4c610e8b76125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a70cdccbcb84216ae61c72d6736bd63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:51:07.452920 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-235b2dfa-2254-4816-ae12-3cb9e5b31a43 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] 10.222.0.84 "GET /compute/v2.1/servers/33e87882-96cf-4d0a-be2c-f0b3474c1486" status: 200 len: 1757 microversion: 2.1 time: 0.172926 Aug 24 11:51:07.453484 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 728/1415] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:51:07 2022] GET /compute/v2.1/servers/33e87882-96cf-4d0a-be2c-f0b3474c1486 => generated 1757 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:51:08.473144 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-512828d5-4d93-4fbb-b9a2-19cd42edf533 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:51:08.473759 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-512828d5-4d93-4fbb-b9a2-19cd42edf533 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] [instance: 33e87882-96cf-4d0a-be2c-f0b3474c1486] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:51:08.480143 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-512828d5-4d93-4fbb-b9a2-19cd42edf533 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:51:08.480617 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-512828d5-4d93-4fbb-b9a2-19cd42edf533 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:51:08.481087 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-512828d5-4d93-4fbb-b9a2-19cd42edf533 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:51:08.481774 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-512828d5-4d93-4fbb-b9a2-19cd42edf533 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:51:08.482227 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-512828d5-4d93-4fbb-b9a2-19cd42edf533 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:51:08.482647 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-512828d5-4d93-4fbb-b9a2-19cd42edf533 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:51:08.625753 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-512828d5-4d93-4fbb-b9a2-19cd42edf533 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591708bfed04ac185d4c610e8b76125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a70cdccbcb84216ae61c72d6736bd63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:51:08.635279 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-512828d5-4d93-4fbb-b9a2-19cd42edf533 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] 10.222.0.84 "GET /compute/v2.1/servers/33e87882-96cf-4d0a-be2c-f0b3474c1486" status: 200 len: 1757 microversion: 2.1 time: 0.166022 Aug 24 11:51:08.635861 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 688/1416] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:51:08 2022] GET /compute/v2.1/servers/33e87882-96cf-4d0a-be2c-f0b3474c1486 => generated 1757 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:51:09.657314 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-d4e343c0-999c-4f08-b27f-ec8c5e352db1 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:51:09.657924 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-d4e343c0-999c-4f08-b27f-ec8c5e352db1 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] [instance: 33e87882-96cf-4d0a-be2c-f0b3474c1486] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:51:09.664658 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-d4e343c0-999c-4f08-b27f-ec8c5e352db1 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:51:09.665176 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-d4e343c0-999c-4f08-b27f-ec8c5e352db1 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:51:09.665613 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-d4e343c0-999c-4f08-b27f-ec8c5e352db1 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:51:09.666293 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-d4e343c0-999c-4f08-b27f-ec8c5e352db1 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:51:09.666738 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-d4e343c0-999c-4f08-b27f-ec8c5e352db1 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:51:09.667154 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-d4e343c0-999c-4f08-b27f-ec8c5e352db1 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:51:09.812448 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-d4e343c0-999c-4f08-b27f-ec8c5e352db1 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591708bfed04ac185d4c610e8b76125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a70cdccbcb84216ae61c72d6736bd63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:51:09.821137 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-d4e343c0-999c-4f08-b27f-ec8c5e352db1 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] 10.222.0.84 "GET /compute/v2.1/servers/33e87882-96cf-4d0a-be2c-f0b3474c1486" status: 200 len: 1757 microversion: 2.1 time: 0.167886 Aug 24 11:51:09.821723 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 729/1417] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:51:09 2022] GET /compute/v2.1/servers/33e87882-96cf-4d0a-be2c-f0b3474c1486 => generated 1757 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:51:10.843388 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-5ff5f625-09eb-401e-b853-3452c4315c7a tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:51:10.896210 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-5ff5f625-09eb-401e-b853-3452c4315c7a tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] [instance: 33e87882-96cf-4d0a-be2c-f0b3474c1486] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:51:10.896210 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5ff5f625-09eb-401e-b853-3452c4315c7a tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:51:10.896210 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5ff5f625-09eb-401e-b853-3452c4315c7a tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:51:10.896210 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5ff5f625-09eb-401e-b853-3452c4315c7a tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:51:10.896659 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5ff5f625-09eb-401e-b853-3452c4315c7a tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:51:10.896659 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5ff5f625-09eb-401e-b853-3452c4315c7a tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:51:10.896659 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5ff5f625-09eb-401e-b853-3452c4315c7a tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:51:10.996623 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-5ff5f625-09eb-401e-b853-3452c4315c7a tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591708bfed04ac185d4c610e8b76125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a70cdccbcb84216ae61c72d6736bd63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:51:11.005657 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-5ff5f625-09eb-401e-b853-3452c4315c7a tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] 10.222.0.84 "GET /compute/v2.1/servers/33e87882-96cf-4d0a-be2c-f0b3474c1486" status: 200 len: 1757 microversion: 2.1 time: 0.166493 Aug 24 11:51:11.006227 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 689/1418] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:51:10 2022] GET /compute/v2.1/servers/33e87882-96cf-4d0a-be2c-f0b3474c1486 => generated 1757 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:51:12.027466 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-3c099dc8-90e2-4e15-95e5-b2687387a93c tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:51:12.028022 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-3c099dc8-90e2-4e15-95e5-b2687387a93c tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] [instance: 33e87882-96cf-4d0a-be2c-f0b3474c1486] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:51:12.034664 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-3c099dc8-90e2-4e15-95e5-b2687387a93c tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:51:12.035193 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-3c099dc8-90e2-4e15-95e5-b2687387a93c tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:51:12.035630 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-3c099dc8-90e2-4e15-95e5-b2687387a93c tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:51:12.036312 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-3c099dc8-90e2-4e15-95e5-b2687387a93c tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:51:12.036763 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-3c099dc8-90e2-4e15-95e5-b2687387a93c tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:51:12.037216 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-3c099dc8-90e2-4e15-95e5-b2687387a93c tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:51:12.183610 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-3c099dc8-90e2-4e15-95e5-b2687387a93c tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591708bfed04ac185d4c610e8b76125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a70cdccbcb84216ae61c72d6736bd63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:51:12.192415 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-3c099dc8-90e2-4e15-95e5-b2687387a93c tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] 10.222.0.84 "GET /compute/v2.1/servers/33e87882-96cf-4d0a-be2c-f0b3474c1486" status: 200 len: 1757 microversion: 2.1 time: 0.169035 Aug 24 11:51:12.193010 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 730/1419] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:51:12 2022] GET /compute/v2.1/servers/33e87882-96cf-4d0a-be2c-f0b3474c1486 => generated 1757 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:51:13.213874 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-493d5fb5-ed54-4a7e-a66c-83b685c40ba7 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:51:13.214469 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-493d5fb5-ed54-4a7e-a66c-83b685c40ba7 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] [instance: 33e87882-96cf-4d0a-be2c-f0b3474c1486] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:51:13.220964 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-493d5fb5-ed54-4a7e-a66c-83b685c40ba7 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:51:13.221441 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-493d5fb5-ed54-4a7e-a66c-83b685c40ba7 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:51:13.221871 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-493d5fb5-ed54-4a7e-a66c-83b685c40ba7 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:51:13.223066 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-493d5fb5-ed54-4a7e-a66c-83b685c40ba7 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:51:13.223512 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-493d5fb5-ed54-4a7e-a66c-83b685c40ba7 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:51:13.223926 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-493d5fb5-ed54-4a7e-a66c-83b685c40ba7 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:51:13.375189 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-493d5fb5-ed54-4a7e-a66c-83b685c40ba7 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591708bfed04ac185d4c610e8b76125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a70cdccbcb84216ae61c72d6736bd63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:51:13.383954 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-493d5fb5-ed54-4a7e-a66c-83b685c40ba7 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] 10.222.0.84 "GET /compute/v2.1/servers/33e87882-96cf-4d0a-be2c-f0b3474c1486" status: 200 len: 1757 microversion: 2.1 time: 0.173953 Aug 24 11:51:13.384697 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 690/1420] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:51:13 2022] GET /compute/v2.1/servers/33e87882-96cf-4d0a-be2c-f0b3474c1486 => generated 1757 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:51:14.405642 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-f105670f-f7d7-4864-a8ab-e983b330f08b tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:51:14.406259 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-f105670f-f7d7-4864-a8ab-e983b330f08b tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] [instance: 33e87882-96cf-4d0a-be2c-f0b3474c1486] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:51:14.413629 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f105670f-f7d7-4864-a8ab-e983b330f08b tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:51:14.414113 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f105670f-f7d7-4864-a8ab-e983b330f08b tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:51:14.414550 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f105670f-f7d7-4864-a8ab-e983b330f08b tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:51:14.415243 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f105670f-f7d7-4864-a8ab-e983b330f08b tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:51:14.415692 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f105670f-f7d7-4864-a8ab-e983b330f08b tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:51:14.416117 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-f105670f-f7d7-4864-a8ab-e983b330f08b tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:51:14.560909 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-f105670f-f7d7-4864-a8ab-e983b330f08b tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591708bfed04ac185d4c610e8b76125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a70cdccbcb84216ae61c72d6736bd63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:51:14.570394 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-f105670f-f7d7-4864-a8ab-e983b330f08b tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] 10.222.0.84 "GET /compute/v2.1/servers/33e87882-96cf-4d0a-be2c-f0b3474c1486" status: 200 len: 1757 microversion: 2.1 time: 0.168600 Aug 24 11:51:14.570965 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 731/1421] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:51:14 2022] GET /compute/v2.1/servers/33e87882-96cf-4d0a-be2c-f0b3474c1486 => generated 1757 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:51:15.591304 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-eb568db5-4ca7-4710-a4a2-2f40ece8a8fb tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:51:15.591890 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-eb568db5-4ca7-4710-a4a2-2f40ece8a8fb tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] [instance: 33e87882-96cf-4d0a-be2c-f0b3474c1486] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:51:15.598500 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-eb568db5-4ca7-4710-a4a2-2f40ece8a8fb tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:51:15.598969 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-eb568db5-4ca7-4710-a4a2-2f40ece8a8fb tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:51:15.599396 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-eb568db5-4ca7-4710-a4a2-2f40ece8a8fb tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:51:15.600073 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-eb568db5-4ca7-4710-a4a2-2f40ece8a8fb tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:51:15.600515 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-eb568db5-4ca7-4710-a4a2-2f40ece8a8fb tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:51:15.600966 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-eb568db5-4ca7-4710-a4a2-2f40ece8a8fb tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:51:15.742649 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-eb568db5-4ca7-4710-a4a2-2f40ece8a8fb tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591708bfed04ac185d4c610e8b76125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a70cdccbcb84216ae61c72d6736bd63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:51:15.750839 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-eb568db5-4ca7-4710-a4a2-2f40ece8a8fb tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] 10.222.0.84 "GET /compute/v2.1/servers/33e87882-96cf-4d0a-be2c-f0b3474c1486" status: 200 len: 1757 microversion: 2.1 time: 0.163386 Aug 24 11:51:15.751395 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 691/1422] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:51:15 2022] GET /compute/v2.1/servers/33e87882-96cf-4d0a-be2c-f0b3474c1486 => generated 1757 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:51:16.773639 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-93866ee1-db8b-4c58-a6eb-c8dc6fa7e6a1 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:51:16.774280 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-93866ee1-db8b-4c58-a6eb-c8dc6fa7e6a1 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] [instance: 33e87882-96cf-4d0a-be2c-f0b3474c1486] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:51:16.780710 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-93866ee1-db8b-4c58-a6eb-c8dc6fa7e6a1 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:51:16.781228 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-93866ee1-db8b-4c58-a6eb-c8dc6fa7e6a1 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:51:16.781667 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-93866ee1-db8b-4c58-a6eb-c8dc6fa7e6a1 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:51:16.782415 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-93866ee1-db8b-4c58-a6eb-c8dc6fa7e6a1 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:51:16.782871 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-93866ee1-db8b-4c58-a6eb-c8dc6fa7e6a1 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:51:16.783297 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-93866ee1-db8b-4c58-a6eb-c8dc6fa7e6a1 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:51:16.937855 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-93866ee1-db8b-4c58-a6eb-c8dc6fa7e6a1 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591708bfed04ac185d4c610e8b76125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a70cdccbcb84216ae61c72d6736bd63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:51:16.947000 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-93866ee1-db8b-4c58-a6eb-c8dc6fa7e6a1 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] 10.222.0.84 "GET /compute/v2.1/servers/33e87882-96cf-4d0a-be2c-f0b3474c1486" status: 200 len: 1757 microversion: 2.1 time: 0.177918 Aug 24 11:51:16.947580 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 732/1423] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:51:16 2022] GET /compute/v2.1/servers/33e87882-96cf-4d0a-be2c-f0b3474c1486 => generated 1757 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:51:17.967581 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-f3140aae-df66-42a5-8e57-ce6d0b37b2c4 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:51:17.968120 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-f3140aae-df66-42a5-8e57-ce6d0b37b2c4 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] [instance: 33e87882-96cf-4d0a-be2c-f0b3474c1486] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:51:17.974545 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-f3140aae-df66-42a5-8e57-ce6d0b37b2c4 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:51:17.975031 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-f3140aae-df66-42a5-8e57-ce6d0b37b2c4 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:51:17.975469 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-f3140aae-df66-42a5-8e57-ce6d0b37b2c4 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:51:17.976159 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-f3140aae-df66-42a5-8e57-ce6d0b37b2c4 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:51:17.976610 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-f3140aae-df66-42a5-8e57-ce6d0b37b2c4 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:51:17.977075 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-f3140aae-df66-42a5-8e57-ce6d0b37b2c4 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:51:18.125435 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-f3140aae-df66-42a5-8e57-ce6d0b37b2c4 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591708bfed04ac185d4c610e8b76125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a70cdccbcb84216ae61c72d6736bd63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:51:18.133904 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-f3140aae-df66-42a5-8e57-ce6d0b37b2c4 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] 10.222.0.84 "GET /compute/v2.1/servers/33e87882-96cf-4d0a-be2c-f0b3474c1486" status: 200 len: 1760 microversion: 2.1 time: 0.170308 Aug 24 11:51:18.134474 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 692/1424] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:51:17 2022] GET /compute/v2.1/servers/33e87882-96cf-4d0a-be2c-f0b3474c1486 => generated 1760 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:51:43.624005 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 11:51:43.624654 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Wed Aug 24 11:51:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 11:51:45.186128 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 11:51:45.186724 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Wed Aug 24 11:51:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 11:51:46.625209 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 11:51:46.625894 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Wed Aug 24 11:51:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 11:52:06.314481 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 11:52:06.315285 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Wed Aug 24 11:52:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 11:52:15.414934 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-ad503095-f643-4aa8-81bf-f8f7729186d8 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1703050376"}} {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:52:15.415636 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-ad503095-f643-4aa8-81bf-f8f7729186d8 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] [instance: 33e87882-96cf-4d0a-be2c-f0b3474c1486] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:52:15.417795 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG dbcounter [-] [124769] Writing DB stats nova_api:SELECT=16 {{(pid=124769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:52:15.418447 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG dbcounter [-] [124769] Writing DB stats nova_cell1:SELECT=48 {{(pid=124769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:52:15.423058 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-ad503095-f643-4aa8-81bf-f8f7729186d8 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:52:15.423528 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-ad503095-f643-4aa8-81bf-f8f7729186d8 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:52:15.423956 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-ad503095-f643-4aa8-81bf-f8f7729186d8 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:52:15.425410 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-ad503095-f643-4aa8-81bf-f8f7729186d8 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:52:15.425873 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-ad503095-f643-4aa8-81bf-f8f7729186d8 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:52:15.426298 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-ad503095-f643-4aa8-81bf-f8f7729186d8 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:52:15.555930 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.network.security_group_api [None req-ad503095-f643-4aa8-81bf-f8f7729186d8 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Removing security group a05eb41f-8524-449c-a2d6-93df2b76772d from port 98b115c3-c00e-4062-a2a6-3b720d6da9c7 Aug 24 11:52:15.969803 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-ad503095-f643-4aa8-81bf-f8f7729186d8 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] 10.222.0.84 "POST /compute/v2.1/servers/33e87882-96cf-4d0a-be2c-f0b3474c1486/action" status: 202 len: 0 microversion: 2.1 time: 0.557655 Aug 24 11:52:15.973587 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 733/1425] 10.222.0.84 () {60 vars in 1278 bytes} [Wed Aug 24 11:52:15 2022] POST /compute/v2.1/servers/33e87882-96cf-4d0a-be2c-f0b3474c1486/action => generated 0 bytes in 561 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:52:15.978037 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_api:SELECT=18 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:52:15.978037 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:52:15.982902 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [req-605848f7-a4f8-48bf-8752-07640bf910a6 req-635f6119-7f6c-481f-9734-428cdb71eb63 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33e87882-96cf-4d0a-be2c-f0b3474c1486", "tag": "98b115c3-c00e-4062-a2a6-3b720d6da9c7"}]} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:52:15.993187 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-605848f7-a4f8-48bf-8752-07640bf910a6 req-635f6119-7f6c-481f-9734-428cdb71eb63 service nova] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:52:15.994385 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-605848f7-a4f8-48bf-8752-07640bf910a6 req-635f6119-7f6c-481f-9734-428cdb71eb63 service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:52:15.994385 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-605848f7-a4f8-48bf-8752-07640bf910a6 req-635f6119-7f6c-481f-9734-428cdb71eb63 service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:52:16.007593 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.compute.server_external_events [req-605848f7-a4f8-48bf-8752-07640bf910a6 req-635f6119-7f6c-481f-9734-428cdb71eb63 service nova] Creating event network-changed:98b115c3-c00e-4062-a2a6-3b720d6da9c7 for instance 33e87882-96cf-4d0a-be2c-f0b3474c1486 on hv-cinder-85427 Aug 24 11:52:16.014040 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [req-605848f7-a4f8-48bf-8752-07640bf910a6 req-635f6119-7f6c-481f-9734-428cdb71eb63 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040408 Aug 24 11:52:16.016017 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 693/1426] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Aug 24 11:52:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:52:17.351294 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-afcd8f2a-1187-4a11-9c50-ee0f4f8def15 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:52:17.351844 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [req-9170e528-5bdd-4b59-b0e0-17c99484e76d req-882c14bb-3e08-4d92-9af3-ac2198b10e48 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33e87882-96cf-4d0a-be2c-f0b3474c1486", "tag": "98b115c3-c00e-4062-a2a6-3b720d6da9c7"}]} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:52:17.352262 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-afcd8f2a-1187-4a11-9c50-ee0f4f8def15 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] [instance: 33e87882-96cf-4d0a-be2c-f0b3474c1486] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:52:17.360238 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-afcd8f2a-1187-4a11-9c50-ee0f4f8def15 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:52:17.361197 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-afcd8f2a-1187-4a11-9c50-ee0f4f8def15 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:52:17.361809 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-afcd8f2a-1187-4a11-9c50-ee0f4f8def15 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:52:17.362549 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-afcd8f2a-1187-4a11-9c50-ee0f4f8def15 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:52:17.363160 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-afcd8f2a-1187-4a11-9c50-ee0f4f8def15 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:52:17.363414 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-afcd8f2a-1187-4a11-9c50-ee0f4f8def15 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:52:17.363542 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-9170e528-5bdd-4b59-b0e0-17c99484e76d req-882c14bb-3e08-4d92-9af3-ac2198b10e48 service nova] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:52:17.363930 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-9170e528-5bdd-4b59-b0e0-17c99484e76d req-882c14bb-3e08-4d92-9af3-ac2198b10e48 service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:52:17.364362 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-9170e528-5bdd-4b59-b0e0-17c99484e76d req-882c14bb-3e08-4d92-9af3-ac2198b10e48 service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:52:17.375500 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.compute.server_external_events [req-9170e528-5bdd-4b59-b0e0-17c99484e76d req-882c14bb-3e08-4d92-9af3-ac2198b10e48 service nova] Creating event network-changed:98b115c3-c00e-4062-a2a6-3b720d6da9c7 for instance 33e87882-96cf-4d0a-be2c-f0b3474c1486 on hv-cinder-85427 Aug 24 11:52:17.382092 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [req-9170e528-5bdd-4b59-b0e0-17c99484e76d req-882c14bb-3e08-4d92-9af3-ac2198b10e48 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034851 Aug 24 11:52:17.383229 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 694/1427] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Aug 24 11:52:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:52:17.453416 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.objects.instance [None req-afcd8f2a-1187-4a11-9c50-ee0f4f8def15 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lazy-loading 'services' on Instance uuid 33e87882-96cf-4d0a-be2c-f0b3474c1486 {{(pid=124769) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:52:17.677713 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-afcd8f2a-1187-4a11-9c50-ee0f4f8def15 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] 10.222.0.84 "DELETE /compute/v2.1/servers/33e87882-96cf-4d0a-be2c-f0b3474c1486/os-volume_attachments/6ba788b3-584a-426f-98bf-8ac87941cb14" status: 202 len: 0 microversion: 2.1 time: 0.332390 Aug 24 11:52:17.679078 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 734/1428] 10.222.0.84 () {58 vars in 1416 bytes} [Wed Aug 24 11:52:17 2022] DELETE /compute/v2.1/servers/33e87882-96cf-4d0a-be2c-f0b3474c1486/os-volume_attachments/6ba788b3-584a-426f-98bf-8ac87941cb14 => generated 0 bytes in 335 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:52:17.687833 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-f66c4667-a050-4e95-954a-5a2d13a88857 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:52:17.692121 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-f66c4667-a050-4e95-954a-5a2d13a88857 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] [instance: 33e87882-96cf-4d0a-be2c-f0b3474c1486] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:52:17.700032 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-f66c4667-a050-4e95-954a-5a2d13a88857 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:52:17.700785 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-f66c4667-a050-4e95-954a-5a2d13a88857 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:52:17.701474 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-f66c4667-a050-4e95-954a-5a2d13a88857 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:52:17.702314 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-f66c4667-a050-4e95-954a-5a2d13a88857 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:52:17.702798 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-f66c4667-a050-4e95-954a-5a2d13a88857 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:52:17.703414 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-f66c4667-a050-4e95-954a-5a2d13a88857 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:52:17.742997 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-f66c4667-a050-4e95-954a-5a2d13a88857 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] 10.222.0.84 "GET /compute/v2.1/servers/33e87882-96cf-4d0a-be2c-f0b3474c1486/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059395 Aug 24 11:52:17.743724 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 695/1429] 10.222.0.84 () {58 vars in 1302 bytes} [Wed Aug 24 11:52:17 2022] GET /compute/v2.1/servers/33e87882-96cf-4d0a-be2c-f0b3474c1486/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:52:18.757535 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-ce80185f-0e35-4715-beb3-d72f8b9ecb67 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:52:18.759877 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-ce80185f-0e35-4715-beb3-d72f8b9ecb67 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] [instance: 33e87882-96cf-4d0a-be2c-f0b3474c1486] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:52:18.766533 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-ce80185f-0e35-4715-beb3-d72f8b9ecb67 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:52:18.767015 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-ce80185f-0e35-4715-beb3-d72f8b9ecb67 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:52:18.767448 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-ce80185f-0e35-4715-beb3-d72f8b9ecb67 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:52:18.768705 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-ce80185f-0e35-4715-beb3-d72f8b9ecb67 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:52:18.769521 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-ce80185f-0e35-4715-beb3-d72f8b9ecb67 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:52:18.769971 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-ce80185f-0e35-4715-beb3-d72f8b9ecb67 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:52:18.802259 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-ce80185f-0e35-4715-beb3-d72f8b9ecb67 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] 10.222.0.84 "GET /compute/v2.1/servers/33e87882-96cf-4d0a-be2c-f0b3474c1486/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050001 Aug 24 11:52:18.802843 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 735/1430] 10.222.0.84 () {58 vars in 1302 bytes} [Wed Aug 24 11:52:18 2022] GET /compute/v2.1/servers/33e87882-96cf-4d0a-be2c-f0b3474c1486/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:52:19.815394 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-5a921ed9-2f90-4a35-90db-0d3fd05c1a29 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:52:19.817518 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-5a921ed9-2f90-4a35-90db-0d3fd05c1a29 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] [instance: 33e87882-96cf-4d0a-be2c-f0b3474c1486] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:52:19.824253 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5a921ed9-2f90-4a35-90db-0d3fd05c1a29 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:52:19.824730 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5a921ed9-2f90-4a35-90db-0d3fd05c1a29 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:52:19.825247 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5a921ed9-2f90-4a35-90db-0d3fd05c1a29 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:52:19.825935 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5a921ed9-2f90-4a35-90db-0d3fd05c1a29 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:52:19.826388 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5a921ed9-2f90-4a35-90db-0d3fd05c1a29 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:52:19.826814 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5a921ed9-2f90-4a35-90db-0d3fd05c1a29 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:52:19.855818 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-5a921ed9-2f90-4a35-90db-0d3fd05c1a29 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] 10.222.0.84 "GET /compute/v2.1/servers/33e87882-96cf-4d0a-be2c-f0b3474c1486/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044759 Aug 24 11:52:19.856399 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 696/1431] 10.222.0.84 () {58 vars in 1302 bytes} [Wed Aug 24 11:52:19 2022] GET /compute/v2.1/servers/33e87882-96cf-4d0a-be2c-f0b3474c1486/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 11:52:19.868157 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-09dc731d-640e-4e5d-b32b-3609e59f6b89 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:52:19.868675 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-09dc731d-640e-4e5d-b32b-3609e59f6b89 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] [instance: 33e87882-96cf-4d0a-be2c-f0b3474c1486] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:52:19.875258 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-09dc731d-640e-4e5d-b32b-3609e59f6b89 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:52:19.875740 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-09dc731d-640e-4e5d-b32b-3609e59f6b89 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:52:19.876187 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-09dc731d-640e-4e5d-b32b-3609e59f6b89 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:52:19.876907 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-09dc731d-640e-4e5d-b32b-3609e59f6b89 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:52:19.877357 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-09dc731d-640e-4e5d-b32b-3609e59f6b89 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:52:19.877791 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-09dc731d-640e-4e5d-b32b-3609e59f6b89 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:52:19.955425 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.wsgi [None req-09dc731d-640e-4e5d-b32b-3609e59f6b89 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] HTTP exception thrown: Instance 33e87882-96cf-4d0a-be2c-f0b3474c1486 is not attached to volume 6ba788b3-584a-426f-98bf-8ac87941cb14 Aug 24 11:52:19.958556 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-09dc731d-640e-4e5d-b32b-3609e59f6b89 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Request method failure captured: Aug 24 11:52:19.958556 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: request: DELETE /compute/v2.1/servers/33e87882-96cf-4d0a-be2c-f0b3474c1486/os-volume_attachments/6ba788b3-584a-426f-98bf-8ac87941cb14 HTTP/1.1 Aug 24 11:52:19.958556 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Accept: application/json Aug 24 11:52:19.958556 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Accept-Encoding: identity Aug 24 11:52:19.958556 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Connection: close Aug 24 11:52:19.958556 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Content-Length: 0 Aug 24 11:52:19.958556 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Content-Type: application/json Aug 24 11:52:19.958556 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Host: 10.222.0.84 Aug 24 11:52:19.958556 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Openstack-System-Scope: None Aug 24 11:52:19.958556 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: User-Agent: python-urllib3/1.26.11 Aug 24 11:52:19.958556 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Auth-Token: gAAAAABjBhAbG3dAa6zMbjAGAkHdDTgDHZIcx0cfcktU-DEunqxjrIB2ytai5RtEC2T_GR51TFHSEVc_VTfCTneVb5HEOq8EgFZ4iogA5wa8btsKNiazqU-xc4cJ3DI-4brX26LuzrpXQHTB5I0pr87g3ZlHOYJWBZDVPri64JBpTI3UH4g5DNg Aug 24 11:52:19.958556 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Domain-Id: None Aug 24 11:52:19.958556 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Domain-Name: None Aug 24 11:52:19.958556 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Identity-Status: Confirmed Aug 24 11:52:19.958556 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Is-Admin-Project: True Aug 24 11:52:19.958556 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Project-Domain-Id: default Aug 24 11:52:19.958556 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Project-Domain-Name: Default Aug 24 11:52:19.958556 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Project-Id: 9a70cdccbcb84216ae61c72d6736bd63 Aug 24 11:52:19.958556 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Project-Name: tempest-TestMinimumBasicScenario-1996097571 Aug 24 11:52:19.958556 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Role: reader,member Aug 24 11:52:19.958556 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Roles: reader,member Aug 24 11:52:19.960384 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/volume/v3/9a70cdccbcb84216ae61c72d6736bd63"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/volume/v3/9a70cdccbcb84216ae61c72d6736bd63"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/compute/v2/9a70cdccbcb84216ae61c72d6736bd63"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84:8080/v1/AUTH_9a70cdccbcb84216ae61c72d6736bd63", "adminURL": "http://10.222.0.84:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/placement"}]}] Aug 24 11:52:19.960384 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Tenant: tempest-TestMinimumBasicScenario-1996097571 Aug 24 11:52:19.960384 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Tenant-Id: 9a70cdccbcb84216ae61c72d6736bd63 Aug 24 11:52:19.960384 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1996097571 Aug 24 11:52:19.960384 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-User: tempest-TestMinimumBasicScenario-1996097571-project Aug 24 11:52:19.960384 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-User-Domain-Id: default Aug 24 11:52:19.960384 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-User-Domain-Name: Default Aug 24 11:52:19.960384 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-User-Id: 5591708bfed04ac185d4c610e8b76125 Aug 24 11:52:19.960384 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: X-User-Name: tempest-TestMinimumBasicScenario-1996097571-project Aug 24 11:52:19.960384 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: method: > Aug 24 11:52:19.960384 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: exception: Instance 33e87882-96cf-4d0a-be2c-f0b3474c1486 is not attached to volume 6ba788b3-584a-426f-98bf-8ac87941cb14 Aug 24 11:52:19.961383 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: action_args: {'server_id': '33e87882-96cf-4d0a-be2c-f0b3474c1486', 'id': '6ba788b3-584a-426f-98bf-8ac87941cb14'} Aug 24 11:52:19.961383 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:52:19.961383 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:52:19.961383 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 24 11:52:19.961383 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 24 11:52:19.961383 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 11:52:19.961383 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 11:52:19.961383 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 24 11:52:19.961383 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 24 11:52:19.961383 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 6ba788b3-584a-426f-98bf-8ac87941cb14. Aug 24 11:52:19.961383 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Aug 24 11:52:19.961383 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:52:19.961383 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Aug 24 11:52:19.961383 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:52:19.961383 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:52:19.961383 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:52:19.961383 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:52:19.961383 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:52:19.961383 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:52:19.962989 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:52:19.962989 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 24 11:52:19.962989 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 24 11:52:19.962989 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33e87882-96cf-4d0a-be2c-f0b3474c1486 is not attached to volume 6ba788b3-584a-426f-98bf-8ac87941cb14 Aug 24 11:52:19.962989 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Aug 24 11:52:19.962989 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:52:19.962989 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Aug 24 11:52:19.962989 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:52:19.962989 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:52:19.962989 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:52:19.962989 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:52:19.962989 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:52:19.962989 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33e87882-96cf-4d0a-be2c-f0b3474c1486 is not attached to volume 6ba788b3-584a-426f-98bf-8ac87941cb14 Aug 24 11:52:19.962989 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: ERROR nova.api.openstack.wsgi Aug 24 11:52:19.962989 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-09dc731d-640e-4e5d-b32b-3609e59f6b89 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Returning 404 to user: Instance 33e87882-96cf-4d0a-be2c-f0b3474c1486 is not attached to volume 6ba788b3-584a-426f-98bf-8ac87941cb14 {{(pid=124769) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:52:19.964224 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-09dc731d-640e-4e5d-b32b-3609e59f6b89 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] 10.222.0.84 "DELETE /compute/v2.1/servers/33e87882-96cf-4d0a-be2c-f0b3474c1486/os-volume_attachments/6ba788b3-584a-426f-98bf-8ac87941cb14" status: 404 len: 154 microversion: 2.1 time: 0.096694 Aug 24 11:52:19.964224 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 736/1432] 10.222.0.84 () {58 vars in 1416 bytes} [Wed Aug 24 11:52:19 2022] DELETE /compute/v2.1/servers/33e87882-96cf-4d0a-be2c-f0b3474c1486/os-volume_attachments/6ba788b3-584a-426f-98bf-8ac87941cb14 => generated 154 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:52:21.314603 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-71f2a8ff-a9b0-4dc0-8515-f99bb1c33f6b tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:52:21.315170 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-71f2a8ff-a9b0-4dc0-8515-f99bb1c33f6b tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] [instance: 33e87882-96cf-4d0a-be2c-f0b3474c1486] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:52:21.322182 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-71f2a8ff-a9b0-4dc0-8515-f99bb1c33f6b tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:52:21.322656 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-71f2a8ff-a9b0-4dc0-8515-f99bb1c33f6b tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:52:21.323084 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-71f2a8ff-a9b0-4dc0-8515-f99bb1c33f6b tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:52:21.323792 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-71f2a8ff-a9b0-4dc0-8515-f99bb1c33f6b tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:52:21.324239 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-71f2a8ff-a9b0-4dc0-8515-f99bb1c33f6b tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:52:21.324658 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-71f2a8ff-a9b0-4dc0-8515-f99bb1c33f6b tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:52:21.350164 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-71f2a8ff-a9b0-4dc0-8515-f99bb1c33f6b tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] [instance: 33e87882-96cf-4d0a-be2c-f0b3474c1486] Going to try to terminate instance {{(pid=124770) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 11:52:21.654350 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-71f2a8ff-a9b0-4dc0-8515-f99bb1c33f6b tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] 10.222.0.84 "DELETE /compute/v2.1/servers/33e87882-96cf-4d0a-be2c-f0b3474c1486" status: 204 len: 0 microversion: 2.1 time: 0.343836 Aug 24 11:52:21.654936 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 697/1433] 10.222.0.84 () {58 vars in 1239 bytes} [Wed Aug 24 11:52:21 2022] DELETE /compute/v2.1/servers/33e87882-96cf-4d0a-be2c-f0b3474c1486 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 11:52:21.663830 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-fbec6b65-46cd-40db-9d2c-53e0f9c04b14 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:52:21.664490 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-fbec6b65-46cd-40db-9d2c-53e0f9c04b14 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] [instance: 33e87882-96cf-4d0a-be2c-f0b3474c1486] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:52:21.671077 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-fbec6b65-46cd-40db-9d2c-53e0f9c04b14 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:52:21.672558 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-fbec6b65-46cd-40db-9d2c-53e0f9c04b14 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:52:21.672558 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-fbec6b65-46cd-40db-9d2c-53e0f9c04b14 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:52:21.673522 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-fbec6b65-46cd-40db-9d2c-53e0f9c04b14 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:52:21.673522 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-fbec6b65-46cd-40db-9d2c-53e0f9c04b14 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:52:21.673906 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-fbec6b65-46cd-40db-9d2c-53e0f9c04b14 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:52:21.810513 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-fbec6b65-46cd-40db-9d2c-53e0f9c04b14 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591708bfed04ac185d4c610e8b76125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a70cdccbcb84216ae61c72d6736bd63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:52:21.818927 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-fbec6b65-46cd-40db-9d2c-53e0f9c04b14 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] 10.222.0.84 "GET /compute/v2.1/servers/33e87882-96cf-4d0a-be2c-f0b3474c1486" status: 200 len: 1554 microversion: 2.1 time: 0.159560 Aug 24 11:52:21.819493 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 737/1434] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:52:21 2022] GET /compute/v2.1/servers/33e87882-96cf-4d0a-be2c-f0b3474c1486 => generated 1554 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:52:22.841246 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-71e52086-636c-41af-bac8-19f81a92000d tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:52:22.841951 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-71e52086-636c-41af-bac8-19f81a92000d tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] [instance: 33e87882-96cf-4d0a-be2c-f0b3474c1486] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:52:22.849181 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-71e52086-636c-41af-bac8-19f81a92000d tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:52:22.849665 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-71e52086-636c-41af-bac8-19f81a92000d tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:52:22.850103 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-71e52086-636c-41af-bac8-19f81a92000d tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:52:22.850805 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-71e52086-636c-41af-bac8-19f81a92000d tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:52:22.851252 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-71e52086-636c-41af-bac8-19f81a92000d tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:52:22.851667 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-71e52086-636c-41af-bac8-19f81a92000d tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:52:22.991202 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-71e52086-636c-41af-bac8-19f81a92000d tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591708bfed04ac185d4c610e8b76125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a70cdccbcb84216ae61c72d6736bd63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:52:22.999369 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-71e52086-636c-41af-bac8-19f81a92000d tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] 10.222.0.84 "GET /compute/v2.1/servers/33e87882-96cf-4d0a-be2c-f0b3474c1486" status: 200 len: 1554 microversion: 2.1 time: 0.162292 Aug 24 11:52:23.000024 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 698/1435] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:52:22 2022] GET /compute/v2.1/servers/33e87882-96cf-4d0a-be2c-f0b3474c1486 => generated 1554 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:52:24.021912 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-80d483d3-6ae6-40ab-9e86-c0bb5d40be97 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:52:24.022552 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-80d483d3-6ae6-40ab-9e86-c0bb5d40be97 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] [instance: 33e87882-96cf-4d0a-be2c-f0b3474c1486] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:52:24.029263 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-80d483d3-6ae6-40ab-9e86-c0bb5d40be97 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:52:24.030060 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-80d483d3-6ae6-40ab-9e86-c0bb5d40be97 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:52:24.036028 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-80d483d3-6ae6-40ab-9e86-c0bb5d40be97 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:52:24.036028 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-80d483d3-6ae6-40ab-9e86-c0bb5d40be97 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:52:24.036028 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-80d483d3-6ae6-40ab-9e86-c0bb5d40be97 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:52:24.036028 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-80d483d3-6ae6-40ab-9e86-c0bb5d40be97 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:52:24.255158 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-80d483d3-6ae6-40ab-9e86-c0bb5d40be97 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591708bfed04ac185d4c610e8b76125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a70cdccbcb84216ae61c72d6736bd63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:52:24.263317 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-80d483d3-6ae6-40ab-9e86-c0bb5d40be97 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] 10.222.0.84 "GET /compute/v2.1/servers/33e87882-96cf-4d0a-be2c-f0b3474c1486" status: 200 len: 1554 microversion: 2.1 time: 0.246101 Aug 24 11:52:24.263890 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 738/1436] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:52:24 2022] GET /compute/v2.1/servers/33e87882-96cf-4d0a-be2c-f0b3474c1486 => generated 1554 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:52:24.652024 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [req-533c569a-37a3-40fa-9f69-c59c3632333c req-ecb76d16-e7eb-4ef4-a74c-0676d6fb57b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33e87882-96cf-4d0a-be2c-f0b3474c1486", "name": "network-vif-deleted", "tag": "98b115c3-c00e-4062-a2a6-3b720d6da9c7"}]} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:52:24.662447 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-533c569a-37a3-40fa-9f69-c59c3632333c req-ecb76d16-e7eb-4ef4-a74c-0676d6fb57b7 service nova] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:52:24.664469 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-533c569a-37a3-40fa-9f69-c59c3632333c req-ecb76d16-e7eb-4ef4-a74c-0676d6fb57b7 service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:52:24.664469 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-533c569a-37a3-40fa-9f69-c59c3632333c req-ecb76d16-e7eb-4ef4-a74c-0676d6fb57b7 service nova] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:52:24.676958 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.compute.server_external_events [req-533c569a-37a3-40fa-9f69-c59c3632333c req-ecb76d16-e7eb-4ef4-a74c-0676d6fb57b7 service nova] Creating event network-vif-deleted:98b115c3-c00e-4062-a2a6-3b720d6da9c7 for instance 33e87882-96cf-4d0a-be2c-f0b3474c1486 on hv-cinder-85427 Aug 24 11:52:24.681772 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [req-533c569a-37a3-40fa-9f69-c59c3632333c req-ecb76d16-e7eb-4ef4-a74c-0676d6fb57b7 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033534 Aug 24 11:52:24.682374 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 699/1437] 10.222.0.84 () {64 vars in 1317 bytes} [Wed Aug 24 11:52:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:52:25.284905 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-cef5d74b-86cf-4247-a16d-9305d6e3b6cd tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Calling method '>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:52:25.285512 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.compute.api [None req-cef5d74b-86cf-4247-a16d-9305d6e3b6cd tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] [instance: 33e87882-96cf-4d0a-be2c-f0b3474c1486] Fetching instance by UUID {{(pid=124769) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:52:25.292614 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-cef5d74b-86cf-4247-a16d-9305d6e3b6cd tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:52:25.293140 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-cef5d74b-86cf-4247-a16d-9305d6e3b6cd tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:52:25.293577 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-cef5d74b-86cf-4247-a16d-9305d6e3b6cd tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:52:25.294273 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-cef5d74b-86cf-4247-a16d-9305d6e3b6cd tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:52:25.294722 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-cef5d74b-86cf-4247-a16d-9305d6e3b6cd tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:52:25.295144 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-cef5d74b-86cf-4247-a16d-9305d6e3b6cd tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:52:25.326009 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-cef5d74b-86cf-4247-a16d-9305d6e3b6cd tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:52:25.326483 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-cef5d74b-86cf-4247-a16d-9305d6e3b6cd tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:52:25.326917 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG oslo_concurrency.lockutils [None req-cef5d74b-86cf-4247-a16d-9305d6e3b6cd tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:52:25.327367 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.objects.instance [None req-cef5d74b-86cf-4247-a16d-9305d6e3b6cd tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lazy-loading 'fault' on Instance uuid 33e87882-96cf-4d0a-be2c-f0b3474c1486 {{(pid=124769) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:52:25.373139 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.policy [None req-cef5d74b-86cf-4247-a16d-9305d6e3b6cd tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591708bfed04ac185d4c610e8b76125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a70cdccbcb84216ae61c72d6736bd63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:52:25.381164 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-cef5d74b-86cf-4247-a16d-9305d6e3b6cd tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] 10.222.0.84 "GET /compute/v2.1/servers/33e87882-96cf-4d0a-be2c-f0b3474c1486" status: 200 len: 1347 microversion: 2.1 time: 0.100414 Aug 24 11:52:25.381735 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 739/1438] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:52:25 2022] GET /compute/v2.1/servers/33e87882-96cf-4d0a-be2c-f0b3474c1486 => generated 1347 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:52:26.403632 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-c6cfe8ec-417f-4597-8732-b33ca1a06322 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:52:26.404319 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-c6cfe8ec-417f-4597-8732-b33ca1a06322 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] [instance: 33e87882-96cf-4d0a-be2c-f0b3474c1486] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:52:26.410422 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c6cfe8ec-417f-4597-8732-b33ca1a06322 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:52:26.410893 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c6cfe8ec-417f-4597-8732-b33ca1a06322 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:52:26.411893 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c6cfe8ec-417f-4597-8732-b33ca1a06322 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:52:26.412571 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c6cfe8ec-417f-4597-8732-b33ca1a06322 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Acquiring lock "65f11403-e029-4cba-8205-60fa018f7cd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:52:26.413048 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c6cfe8ec-417f-4597-8732-b33ca1a06322 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:52:26.413463 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c6cfe8ec-417f-4597-8732-b33ca1a06322 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Lock "65f11403-e029-4cba-8205-60fa018f7cd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:52:26.426377 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.wsgi [None req-c6cfe8ec-417f-4597-8732-b33ca1a06322 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] HTTP exception thrown: Instance 33e87882-96cf-4d0a-be2c-f0b3474c1486 could not be found. Aug 24 11:52:26.428643 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-c6cfe8ec-417f-4597-8732-b33ca1a06322 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Request method failure captured: Aug 24 11:52:26.428643 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: request: GET /compute/v2.1/servers/33e87882-96cf-4d0a-be2c-f0b3474c1486 HTTP/1.1 Aug 24 11:52:26.428643 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Accept: application/json Aug 24 11:52:26.428643 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Accept-Encoding: identity Aug 24 11:52:26.428643 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Connection: close Aug 24 11:52:26.428643 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Content-Length: 0 Aug 24 11:52:26.428643 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Content-Type: application/json Aug 24 11:52:26.428643 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Host: 10.222.0.84 Aug 24 11:52:26.428643 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Openstack-System-Scope: None Aug 24 11:52:26.428643 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: User-Agent: python-urllib3/1.26.11 Aug 24 11:52:26.428643 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Auth-Token: gAAAAABjBhAbG3dAa6zMbjAGAkHdDTgDHZIcx0cfcktU-DEunqxjrIB2ytai5RtEC2T_GR51TFHSEVc_VTfCTneVb5HEOq8EgFZ4iogA5wa8btsKNiazqU-xc4cJ3DI-4brX26LuzrpXQHTB5I0pr87g3ZlHOYJWBZDVPri64JBpTI3UH4g5DNg Aug 24 11:52:26.428643 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Domain-Id: None Aug 24 11:52:26.428643 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Domain-Name: None Aug 24 11:52:26.428643 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Identity-Status: Confirmed Aug 24 11:52:26.428643 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Is-Admin-Project: True Aug 24 11:52:26.428643 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Project-Domain-Id: default Aug 24 11:52:26.428643 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Project-Domain-Name: Default Aug 24 11:52:26.428643 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Project-Id: 9a70cdccbcb84216ae61c72d6736bd63 Aug 24 11:52:26.428643 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Project-Name: tempest-TestMinimumBasicScenario-1996097571 Aug 24 11:52:26.428643 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Role: reader,member Aug 24 11:52:26.428643 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Roles: reader,member Aug 24 11:52:26.430396 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/volume/v3/9a70cdccbcb84216ae61c72d6736bd63"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/volume/v3/9a70cdccbcb84216ae61c72d6736bd63"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/compute/v2/9a70cdccbcb84216ae61c72d6736bd63"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84:8080/v1/AUTH_9a70cdccbcb84216ae61c72d6736bd63", "adminURL": "http://10.222.0.84:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.84/placement"}]}] Aug 24 11:52:26.430396 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Tenant: tempest-TestMinimumBasicScenario-1996097571 Aug 24 11:52:26.430396 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Tenant-Id: 9a70cdccbcb84216ae61c72d6736bd63 Aug 24 11:52:26.430396 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1996097571 Aug 24 11:52:26.430396 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User: tempest-TestMinimumBasicScenario-1996097571-project Aug 24 11:52:26.430396 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User-Domain-Id: default Aug 24 11:52:26.430396 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User-Domain-Name: Default Aug 24 11:52:26.430396 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User-Id: 5591708bfed04ac185d4c610e8b76125 Aug 24 11:52:26.430396 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: X-User-Name: tempest-TestMinimumBasicScenario-1996097571-project Aug 24 11:52:26.430396 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: method: > Aug 24 11:52:26.430396 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: exception: Instance 33e87882-96cf-4d0a-be2c-f0b3474c1486 could not be found. Aug 24 11:52:26.430396 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: action_args: {'id': '33e87882-96cf-4d0a-be2c-f0b3474c1486'} Aug 24 11:52:26.431417 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:52:26.431417 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:52:26.431417 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:52:26.431417 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:52:26.431417 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:52:26.431417 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:52:26.431417 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:52:26.431417 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:52:26.431417 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:52:26.431417 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:52:26.431417 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33e87882-96cf-4d0a-be2c-f0b3474c1486 could not be found. Aug 24 11:52:26.431417 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:52:26.431417 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:52:26.431417 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:52:26.431417 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:52:26.431417 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:52:26.431417 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:52:26.431417 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:52:26.431417 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:52:26.431417 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:52:26.433100 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:52:26.433100 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:52:26.433100 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:52:26.433100 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:52:26.433100 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:52:26.433100 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:52:26.433100 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:52:26.433100 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33e87882-96cf-4d0a-be2c-f0b3474c1486 could not be found. Aug 24 11:52:26.433100 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:52:26.433100 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:52:26.433100 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:52:26.433100 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:52:26.433100 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:52:26.433100 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:52:26.433100 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:52:26.433100 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:52:26.433100 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33e87882-96cf-4d0a-be2c-f0b3474c1486 could not be found. Aug 24 11:52:26.433100 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Aug 24 11:52:26.434558 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-c6cfe8ec-417f-4597-8732-b33ca1a06322 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Returning 404 to user: Instance 33e87882-96cf-4d0a-be2c-f0b3474c1486 could not be found. {{(pid=124770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:52:26.434558 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-c6cfe8ec-417f-4597-8732-b33ca1a06322 tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] 10.222.0.84 "GET /compute/v2.1/servers/33e87882-96cf-4d0a-be2c-f0b3474c1486" status: 404 len: 111 microversion: 2.1 time: 0.031403 Aug 24 11:52:26.434558 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 700/1439] 10.222.0.84 () {58 vars in 1236 bytes} [Wed Aug 24 11:52:26 2022] GET /compute/v2.1/servers/33e87882-96cf-4d0a-be2c-f0b3474c1486 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:52:26.438601 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: DEBUG nova.api.openstack.wsgi [None req-2672b338-6af8-467a-b1e9-cc0b5b9a004d tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] Calling method '.version_select at 0x7f0e2a38eca0>' {{(pid=124769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:52:26.539320 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO nova.api.openstack.requestlog [None req-2672b338-6af8-467a-b1e9-cc0b5b9a004d tempest-TestMinimumBasicScenario-1996097571 tempest-TestMinimumBasicScenario-1996097571-project] 10.222.0.84 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-335292085" status: 202 len: 0 microversion: 2.1 time: 0.104343 Aug 24 11:52:26.539965 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: [pid: 124769|app: 0|req: 740/1440] 10.222.0.84 () {58 vars in 1269 bytes} [Wed Aug 24 11:52:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-335292085 => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:53:29.559967 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 11:53:29.560717 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Wed Aug 24 11:53:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 11:55:03.632377 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 11:55:03.633499 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Wed Aug 24 11:55:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 11:55:05.194558 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 11:55:05.195170 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Wed Aug 24 11:55:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 11:55:06.634440 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 11:55:06.635272 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Wed Aug 24 11:55:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 11:55:25.264999 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 11:55:25.265680 dv-cinder-854274-2-iscsi devstack@n-api.service[124770]: Wed Aug 24 11:55:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 11:55:26.323822 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 11:55:26.324454 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Wed Aug 24 11:55:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 11:56:49.568167 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 11:56:49.569445 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Wed Aug 24 11:56:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 11:58:23.641119 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 11:58:23.641849 dv-cinder-854274-2-iscsi devstack@n-api.service[124769]: Wed Aug 24 11:58:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!